=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-032002 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-032002 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m34.3491842s)
-- stdout --
* [old-k8s-version-032002] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=19530
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19530-11185/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19530-11185/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Downloading driver docker-machine-driver-kvm2:
* Starting "old-k8s-version-032002" primary control-plane node in "old-k8s-version-032002" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0829 20:16:08.572330 61858 out.go:345] Setting OutFile to fd 1 ...
I0829 20:16:08.572834 61858 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0829 20:16:08.572846 61858 out.go:358] Setting ErrFile to fd 2...
I0829 20:16:08.572853 61858 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0829 20:16:08.573382 61858 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19530-11185/.minikube/bin
I0829 20:16:08.574409 61858 out.go:352] Setting JSON to false
I0829 20:16:08.575315 61858 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":7116,"bootTime":1724955453,"procs":208,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1067-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0829 20:16:08.575378 61858 start.go:139] virtualization: kvm guest
I0829 20:16:08.577168 61858 out.go:177] * [old-k8s-version-032002] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
I0829 20:16:08.578832 61858 out.go:177] - MINIKUBE_LOCATION=19530
I0829 20:16:08.578877 61858 notify.go:220] Checking for updates...
I0829 20:16:08.581194 61858 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0829 20:16:08.582597 61858 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19530-11185/kubeconfig
I0829 20:16:08.583964 61858 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19530-11185/.minikube
I0829 20:16:08.585302 61858 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0829 20:16:08.586568 61858 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0829 20:16:08.588218 61858 config.go:182] Loaded profile config "cert-expiration-621378": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.0
I0829 20:16:08.588330 61858 driver.go:392] Setting default libvirt URI to qemu:///system
I0829 20:16:08.628167 61858 out.go:177] * Using the kvm2 driver based on user configuration
I0829 20:16:08.629600 61858 start.go:297] selected driver: kvm2
I0829 20:16:08.629620 61858 start.go:901] validating driver "kvm2" against <nil>
I0829 20:16:08.629635 61858 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0829 20:16:08.630640 61858 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0829 20:16:09.830039 61858 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19530-11185/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/testdata/kvm2-driver-older-version:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0829 20:16:09.861509 61858 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/testdata/kvm2-driver-older-version/docker-machine-driver-kvm2 version is 1.1.1
W0829 20:16:09.861560 61858 install.go:62] docker-machine-driver-kvm2: docker-machine-driver-kvm2 is version 1.1.1, want 1.33.1
I0829 20:16:09.863542 61858 out.go:177] * Downloading driver docker-machine-driver-kvm2:
I0829 20:16:09.864910 61858 download.go:107] Downloading: https://github.com/kubernetes/minikube/releases/download/v1.33.1/docker-machine-driver-kvm2-amd64?checksum=file:https://github.com/kubernetes/minikube/releases/download/v1.33.1/docker-machine-driver-kvm2-amd64.sha256 -> /home/jenkins/minikube-integration/19530-11185/.minikube/bin/docker-machine-driver-kvm2
I0829 20:16:11.140867 61858 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0829 20:16:11.141181 61858 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0829 20:16:11.141255 61858 cni.go:84] Creating CNI manager for ""
I0829 20:16:11.141274 61858 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0829 20:16:11.141290 61858 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0829 20:16:11.141381 61858 start.go:340] cluster config:
{Name:old-k8s-version-032002 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-032002 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0829 20:16:11.141501 61858 iso.go:125] acquiring lock: {Name:mk1c9d3ac7f423dd4657884e37bdf4359f6328d2 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0829 20:16:11.143384 61858 out.go:177] * Starting "old-k8s-version-032002" primary control-plane node in "old-k8s-version-032002" cluster
I0829 20:16:11.144522 61858 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0829 20:16:11.144562 61858 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19530-11185/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0829 20:16:11.144571 61858 cache.go:56] Caching tarball of preloaded images
I0829 20:16:11.144650 61858 preload.go:172] Found /home/jenkins/minikube-integration/19530-11185/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0829 20:16:11.144664 61858 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0829 20:16:11.144752 61858 profile.go:143] Saving config to /home/jenkins/minikube-integration/19530-11185/.minikube/profiles/old-k8s-version-032002/config.json ...
I0829 20:16:11.144769 61858 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19530-11185/.minikube/profiles/old-k8s-version-032002/config.json: {Name:mk9e46fc58052eda77f734f2fc6c86275a741969 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0829 20:16:11.144917 61858 start.go:360] acquireMachinesLock for old-k8s-version-032002: {Name:mk7bbdf93fa2a8e913f7adca47ba2f24c1fa817a Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0829 20:16:11.144959 61858 start.go:364] duration metric: took 22.494µs to acquireMachinesLock for "old-k8s-version-032002"
I0829 20:16:11.144979 61858 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-032002 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19530/minikube-v1.33.1-1724862017-19530-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-032002 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0829 20:16:11.145070 61858 start.go:125] createHost starting for "" (driver="kvm2")
I0829 20:16:11.146795 61858 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0829 20:16:11.147012 61858 main.go:141] libmachine: Found binary path at /home/jenkins/minikube-integration/19530-11185/.minikube/bin/docker-machine-driver-kvm2
I0829 20:16:11.147066 61858 main.go:141] libmachine: Launching plugin server for driver kvm2
I0829 20:16:11.163870 61858 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35529
I0829 20:16:11.164443 61858 main.go:141] libmachine: () Calling .GetVersion
I0829 20:16:11.165139 61858 main.go:141] libmachine: Using API Version 1
I0829 20:16:11.165162 61858 main.go:141] libmachine: () Calling .SetConfigRaw
I0829 20:16:11.165685 61858 main.go:141] libmachine: () Calling .GetMachineName
I0829 20:16:11.165969 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetMachineName
I0829 20:16:11.166640 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .DriverName
I0829 20:16:11.166872 61858 start.go:159] libmachine.API.Create for "old-k8s-version-032002" (driver="kvm2")
I0829 20:16:11.166904 61858 client.go:168] LocalClient.Create starting
I0829 20:16:11.166934 61858 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19530-11185/.minikube/certs/ca.pem
I0829 20:16:11.166976 61858 main.go:141] libmachine: Decoding PEM data...
I0829 20:16:11.166996 61858 main.go:141] libmachine: Parsing certificate...
I0829 20:16:11.167056 61858 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19530-11185/.minikube/certs/cert.pem
I0829 20:16:11.167080 61858 main.go:141] libmachine: Decoding PEM data...
I0829 20:16:11.167092 61858 main.go:141] libmachine: Parsing certificate...
I0829 20:16:11.167113 61858 main.go:141] libmachine: Running pre-create checks...
I0829 20:16:11.167123 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .PreCreateCheck
I0829 20:16:11.167545 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetConfigRaw
I0829 20:16:11.167983 61858 main.go:141] libmachine: Creating machine...
I0829 20:16:11.167997 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .Create
I0829 20:16:11.168141 61858 main.go:141] libmachine: (old-k8s-version-032002) Creating KVM machine...
I0829 20:16:11.170130 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | found existing default KVM network
I0829 20:16:11.171373 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | I0829 20:16:11.171104 62590 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00012db50}
I0829 20:16:11.171423 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | created network xml:
I0829 20:16:11.171443 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | <network>
I0829 20:16:11.171452 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | <name>mk-old-k8s-version-032002</name>
I0829 20:16:11.171465 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | <dns enable='no'/>
I0829 20:16:11.171495 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG |
I0829 20:16:11.171520 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | <ip address='192.168.39.1' netmask='255.255.255.0'>
I0829 20:16:11.171544 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | <dhcp>
I0829 20:16:11.171557 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | <range start='192.168.39.2' end='192.168.39.253'/>
I0829 20:16:11.171570 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | </dhcp>
I0829 20:16:11.171582 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | </ip>
I0829 20:16:11.171594 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG |
I0829 20:16:11.171618 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | </network>
I0829 20:16:11.171633 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG |
I0829 20:16:11.177671 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | trying to create private KVM network mk-old-k8s-version-032002 192.168.39.0/24...
I0829 20:16:11.255253 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | private KVM network mk-old-k8s-version-032002 192.168.39.0/24 created
I0829 20:16:11.255281 61858 main.go:141] libmachine: (old-k8s-version-032002) Setting up store path in /home/jenkins/minikube-integration/19530-11185/.minikube/machines/old-k8s-version-032002 ...
I0829 20:16:11.255294 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | I0829 20:16:11.255235 62590 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19530-11185/.minikube
I0829 20:16:11.255321 61858 main.go:141] libmachine: (old-k8s-version-032002) Building disk image from file:///home/jenkins/minikube-integration/19530-11185/.minikube/cache/iso/amd64/minikube-v1.33.1-1724862017-19530-amd64.iso
I0829 20:16:11.255489 61858 main.go:141] libmachine: (old-k8s-version-032002) Downloading /home/jenkins/minikube-integration/19530-11185/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19530-11185/.minikube/cache/iso/amd64/minikube-v1.33.1-1724862017-19530-amd64.iso...
I0829 20:16:11.524278 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | I0829 20:16:11.524168 62590 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19530-11185/.minikube/machines/old-k8s-version-032002/id_rsa...
I0829 20:16:11.603669 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | I0829 20:16:11.603569 62590 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19530-11185/.minikube/machines/old-k8s-version-032002/old-k8s-version-032002.rawdisk...
I0829 20:16:11.603751 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | Writing magic tar header
I0829 20:16:11.603777 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | Writing SSH key tar header
I0829 20:16:11.603793 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | I0829 20:16:11.603758 62590 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19530-11185/.minikube/machines/old-k8s-version-032002 ...
I0829 20:16:11.603906 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19530-11185/.minikube/machines/old-k8s-version-032002
I0829 20:16:11.603942 61858 main.go:141] libmachine: (old-k8s-version-032002) Setting executable bit set on /home/jenkins/minikube-integration/19530-11185/.minikube/machines/old-k8s-version-032002 (perms=drwx------)
I0829 20:16:11.603955 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19530-11185/.minikube/machines
I0829 20:16:11.603986 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19530-11185/.minikube
I0829 20:16:11.603998 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19530-11185
I0829 20:16:11.604013 61858 main.go:141] libmachine: (old-k8s-version-032002) Setting executable bit set on /home/jenkins/minikube-integration/19530-11185/.minikube/machines (perms=drwxr-xr-x)
I0829 20:16:11.604030 61858 main.go:141] libmachine: (old-k8s-version-032002) Setting executable bit set on /home/jenkins/minikube-integration/19530-11185/.minikube (perms=drwxr-xr-x)
I0829 20:16:11.604045 61858 main.go:141] libmachine: (old-k8s-version-032002) Setting executable bit set on /home/jenkins/minikube-integration/19530-11185 (perms=drwxrwxr-x)
I0829 20:16:11.604061 61858 main.go:141] libmachine: (old-k8s-version-032002) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0829 20:16:11.604080 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0829 20:16:11.604099 61858 main.go:141] libmachine: (old-k8s-version-032002) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0829 20:16:11.604109 61858 main.go:141] libmachine: (old-k8s-version-032002) Creating domain...
I0829 20:16:11.604119 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | Checking permissions on dir: /home/jenkins
I0829 20:16:11.604133 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | Checking permissions on dir: /home
I0829 20:16:11.604144 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | Skipping /home - not owner
I0829 20:16:11.605442 61858 main.go:141] libmachine: (old-k8s-version-032002) define libvirt domain using xml:
I0829 20:16:11.605467 61858 main.go:141] libmachine: (old-k8s-version-032002) <domain type='kvm'>
I0829 20:16:11.605477 61858 main.go:141] libmachine: (old-k8s-version-032002) <name>old-k8s-version-032002</name>
I0829 20:16:11.605492 61858 main.go:141] libmachine: (old-k8s-version-032002) <memory unit='MiB'>2200</memory>
I0829 20:16:11.605505 61858 main.go:141] libmachine: (old-k8s-version-032002) <vcpu>2</vcpu>
I0829 20:16:11.605512 61858 main.go:141] libmachine: (old-k8s-version-032002) <features>
I0829 20:16:11.605525 61858 main.go:141] libmachine: (old-k8s-version-032002) <acpi/>
I0829 20:16:11.605535 61858 main.go:141] libmachine: (old-k8s-version-032002) <apic/>
I0829 20:16:11.605544 61858 main.go:141] libmachine: (old-k8s-version-032002) <pae/>
I0829 20:16:11.605554 61858 main.go:141] libmachine: (old-k8s-version-032002)
I0829 20:16:11.605566 61858 main.go:141] libmachine: (old-k8s-version-032002) </features>
I0829 20:16:11.605578 61858 main.go:141] libmachine: (old-k8s-version-032002) <cpu mode='host-passthrough'>
I0829 20:16:11.605591 61858 main.go:141] libmachine: (old-k8s-version-032002)
I0829 20:16:11.605598 61858 main.go:141] libmachine: (old-k8s-version-032002) </cpu>
I0829 20:16:11.605609 61858 main.go:141] libmachine: (old-k8s-version-032002) <os>
I0829 20:16:11.605619 61858 main.go:141] libmachine: (old-k8s-version-032002) <type>hvm</type>
I0829 20:16:11.605627 61858 main.go:141] libmachine: (old-k8s-version-032002) <boot dev='cdrom'/>
I0829 20:16:11.605643 61858 main.go:141] libmachine: (old-k8s-version-032002) <boot dev='hd'/>
I0829 20:16:11.605678 61858 main.go:141] libmachine: (old-k8s-version-032002) <bootmenu enable='no'/>
I0829 20:16:11.605701 61858 main.go:141] libmachine: (old-k8s-version-032002) </os>
I0829 20:16:11.605715 61858 main.go:141] libmachine: (old-k8s-version-032002) <devices>
I0829 20:16:11.605727 61858 main.go:141] libmachine: (old-k8s-version-032002) <disk type='file' device='cdrom'>
I0829 20:16:11.605773 61858 main.go:141] libmachine: (old-k8s-version-032002) <source file='/home/jenkins/minikube-integration/19530-11185/.minikube/machines/old-k8s-version-032002/boot2docker.iso'/>
I0829 20:16:11.605798 61858 main.go:141] libmachine: (old-k8s-version-032002) <target dev='hdc' bus='scsi'/>
I0829 20:16:11.605813 61858 main.go:141] libmachine: (old-k8s-version-032002) <readonly/>
I0829 20:16:11.605825 61858 main.go:141] libmachine: (old-k8s-version-032002) </disk>
I0829 20:16:11.605836 61858 main.go:141] libmachine: (old-k8s-version-032002) <disk type='file' device='disk'>
I0829 20:16:11.605855 61858 main.go:141] libmachine: (old-k8s-version-032002) <driver name='qemu' type='raw' cache='default' io='threads' />
I0829 20:16:11.605877 61858 main.go:141] libmachine: (old-k8s-version-032002) <source file='/home/jenkins/minikube-integration/19530-11185/.minikube/machines/old-k8s-version-032002/old-k8s-version-032002.rawdisk'/>
I0829 20:16:11.605889 61858 main.go:141] libmachine: (old-k8s-version-032002) <target dev='hda' bus='virtio'/>
I0829 20:16:11.605899 61858 main.go:141] libmachine: (old-k8s-version-032002) </disk>
I0829 20:16:11.605914 61858 main.go:141] libmachine: (old-k8s-version-032002) <interface type='network'>
I0829 20:16:11.605942 61858 main.go:141] libmachine: (old-k8s-version-032002) <source network='mk-old-k8s-version-032002'/>
I0829 20:16:11.606041 61858 main.go:141] libmachine: (old-k8s-version-032002) <model type='virtio'/>
I0829 20:16:11.606058 61858 main.go:141] libmachine: (old-k8s-version-032002) </interface>
I0829 20:16:11.606072 61858 main.go:141] libmachine: (old-k8s-version-032002) <interface type='network'>
I0829 20:16:11.606084 61858 main.go:141] libmachine: (old-k8s-version-032002) <source network='default'/>
I0829 20:16:11.606094 61858 main.go:141] libmachine: (old-k8s-version-032002) <model type='virtio'/>
I0829 20:16:11.606101 61858 main.go:141] libmachine: (old-k8s-version-032002) </interface>
I0829 20:16:11.606125 61858 main.go:141] libmachine: (old-k8s-version-032002) <serial type='pty'>
I0829 20:16:11.606146 61858 main.go:141] libmachine: (old-k8s-version-032002) <target port='0'/>
I0829 20:16:11.606158 61858 main.go:141] libmachine: (old-k8s-version-032002) </serial>
I0829 20:16:11.606168 61858 main.go:141] libmachine: (old-k8s-version-032002) <console type='pty'>
I0829 20:16:11.606181 61858 main.go:141] libmachine: (old-k8s-version-032002) <target type='serial' port='0'/>
I0829 20:16:11.606191 61858 main.go:141] libmachine: (old-k8s-version-032002) </console>
I0829 20:16:11.606205 61858 main.go:141] libmachine: (old-k8s-version-032002) <rng model='virtio'>
I0829 20:16:11.606215 61858 main.go:141] libmachine: (old-k8s-version-032002) <backend model='random'>/dev/random</backend>
I0829 20:16:11.606224 61858 main.go:141] libmachine: (old-k8s-version-032002) </rng>
I0829 20:16:11.606236 61858 main.go:141] libmachine: (old-k8s-version-032002)
I0829 20:16:11.606245 61858 main.go:141] libmachine: (old-k8s-version-032002)
I0829 20:16:11.606253 61858 main.go:141] libmachine: (old-k8s-version-032002) </devices>
I0829 20:16:11.606261 61858 main.go:141] libmachine: (old-k8s-version-032002) </domain>
I0829 20:16:11.606291 61858 main.go:141] libmachine: (old-k8s-version-032002)
I0829 20:16:11.610796 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined MAC address 52:54:00:96:4b:bd in network default
I0829 20:16:11.611660 61858 main.go:141] libmachine: (old-k8s-version-032002) Ensuring networks are active...
I0829 20:16:11.611681 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:11.612667 61858 main.go:141] libmachine: (old-k8s-version-032002) Ensuring network default is active
I0829 20:16:11.613083 61858 main.go:141] libmachine: (old-k8s-version-032002) Ensuring network mk-old-k8s-version-032002 is active
I0829 20:16:11.613614 61858 main.go:141] libmachine: (old-k8s-version-032002) Getting domain xml...
I0829 20:16:11.614376 61858 main.go:141] libmachine: (old-k8s-version-032002) Creating domain...
I0829 20:16:13.116331 61858 main.go:141] libmachine: (old-k8s-version-032002) Waiting to get IP...
I0829 20:16:13.117236 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:13.117679 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | unable to find current IP address of domain old-k8s-version-032002 in network mk-old-k8s-version-032002
I0829 20:16:13.117740 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | I0829 20:16:13.117666 62590 retry.go:31] will retry after 198.951949ms: waiting for machine to come up
I0829 20:16:13.318339 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:13.318964 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | unable to find current IP address of domain old-k8s-version-032002 in network mk-old-k8s-version-032002
I0829 20:16:13.318994 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | I0829 20:16:13.318900 62590 retry.go:31] will retry after 237.314194ms: waiting for machine to come up
I0829 20:16:13.557489 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:13.558011 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | unable to find current IP address of domain old-k8s-version-032002 in network mk-old-k8s-version-032002
I0829 20:16:13.558042 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | I0829 20:16:13.557967 62590 retry.go:31] will retry after 440.132537ms: waiting for machine to come up
I0829 20:16:13.999570 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:14.000080 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | unable to find current IP address of domain old-k8s-version-032002 in network mk-old-k8s-version-032002
I0829 20:16:14.000119 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | I0829 20:16:14.000057 62590 retry.go:31] will retry after 518.427431ms: waiting for machine to come up
I0829 20:16:14.519658 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:14.520175 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | unable to find current IP address of domain old-k8s-version-032002 in network mk-old-k8s-version-032002
I0829 20:16:14.520202 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | I0829 20:16:14.520134 62590 retry.go:31] will retry after 543.654878ms: waiting for machine to come up
I0829 20:16:15.066130 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:15.066739 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | unable to find current IP address of domain old-k8s-version-032002 in network mk-old-k8s-version-032002
I0829 20:16:15.066778 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | I0829 20:16:15.066714 62590 retry.go:31] will retry after 632.425588ms: waiting for machine to come up
I0829 20:16:15.700481 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:15.701005 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | unable to find current IP address of domain old-k8s-version-032002 in network mk-old-k8s-version-032002
I0829 20:16:15.701046 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | I0829 20:16:15.700939 62590 retry.go:31] will retry after 865.615308ms: waiting for machine to come up
I0829 20:16:16.568584 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:16.569004 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | unable to find current IP address of domain old-k8s-version-032002 in network mk-old-k8s-version-032002
I0829 20:16:16.569031 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | I0829 20:16:16.568959 62590 retry.go:31] will retry after 1.165821145s: waiting for machine to come up
I0829 20:16:17.736470 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:17.736971 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | unable to find current IP address of domain old-k8s-version-032002 in network mk-old-k8s-version-032002
I0829 20:16:17.737000 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | I0829 20:16:17.736922 62590 retry.go:31] will retry after 1.764094552s: waiting for machine to come up
I0829 20:16:19.503962 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:19.504422 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | unable to find current IP address of domain old-k8s-version-032002 in network mk-old-k8s-version-032002
I0829 20:16:19.504444 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | I0829 20:16:19.504402 62590 retry.go:31] will retry after 1.889654337s: waiting for machine to come up
I0829 20:16:21.395973 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:21.396532 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | unable to find current IP address of domain old-k8s-version-032002 in network mk-old-k8s-version-032002
I0829 20:16:21.396583 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | I0829 20:16:21.396485 62590 retry.go:31] will retry after 2.725787985s: waiting for machine to come up
I0829 20:16:24.125379 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:24.125829 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | unable to find current IP address of domain old-k8s-version-032002 in network mk-old-k8s-version-032002
I0829 20:16:24.125855 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | I0829 20:16:24.125786 62590 retry.go:31] will retry after 3.209715166s: waiting for machine to come up
I0829 20:16:27.337363 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:27.337751 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | unable to find current IP address of domain old-k8s-version-032002 in network mk-old-k8s-version-032002
I0829 20:16:27.337778 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | I0829 20:16:27.337714 62590 retry.go:31] will retry after 3.442723049s: waiting for machine to come up
I0829 20:16:30.784226 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:30.784600 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | unable to find current IP address of domain old-k8s-version-032002 in network mk-old-k8s-version-032002
I0829 20:16:30.784630 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | I0829 20:16:30.784551 62590 retry.go:31] will retry after 3.497524979s: waiting for machine to come up
I0829 20:16:34.285704 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:34.286193 61858 main.go:141] libmachine: (old-k8s-version-032002) Found IP for machine: 192.168.39.116
I0829 20:16:34.286220 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has current primary IP address 192.168.39.116 and MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:34.286229 61858 main.go:141] libmachine: (old-k8s-version-032002) Reserving static IP address...
I0829 20:16:34.286578 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-032002", mac: "52:54:00:a8:ca:96", ip: "192.168.39.116"} in network mk-old-k8s-version-032002
I0829 20:16:34.363024 61858 main.go:141] libmachine: (old-k8s-version-032002) Reserved static IP address: 192.168.39.116
I0829 20:16:34.363052 61858 main.go:141] libmachine: (old-k8s-version-032002) Waiting for SSH to be available...
I0829 20:16:34.363062 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | Getting to WaitForSSH function...
I0829 20:16:34.365578 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:34.365943 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | unable to find host DHCP lease matching {name: "", mac: "52:54:00:a8:ca:96", ip: ""} in network mk-old-k8s-version-032002
I0829 20:16:34.365985 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | unable to find defined IP address of network mk-old-k8s-version-032002 interface with MAC address 52:54:00:a8:ca:96
I0829 20:16:34.366166 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | Using SSH client type: external
I0829 20:16:34.366192 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | Using SSH private key: /home/jenkins/minikube-integration/19530-11185/.minikube/machines/old-k8s-version-032002/id_rsa (-rw-------)
I0829 20:16:34.366241 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@ -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19530-11185/.minikube/machines/old-k8s-version-032002/id_rsa -p 22] /usr/bin/ssh <nil>}
I0829 20:16:34.366262 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | About to run SSH command:
I0829 20:16:34.366279 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | exit 0
I0829 20:16:34.369995 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | SSH cmd err, output: exit status 255:
I0829 20:16:34.370023 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | Error getting ssh command 'exit 0' : ssh command error:
I0829 20:16:34.370034 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | command : exit 0
I0829 20:16:34.370047 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | err : exit status 255
I0829 20:16:34.370061 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | output :
I0829 20:16:37.370414 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | Getting to WaitForSSH function...
I0829 20:16:37.374169 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:37.374679 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a8:ca:96", ip: ""} in network mk-old-k8s-version-032002: {Iface:virbr1 ExpiryTime:2024-08-29 21:16:25 +0000 UTC Type:0 Mac:52:54:00:a8:ca:96 Iaid: IPaddr:192.168.39.116 Prefix:24 Hostname:old-k8s-version-032002 Clientid:01:52:54:00:a8:ca:96}
I0829 20:16:37.374703 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined IP address 192.168.39.116 and MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:37.374860 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | Using SSH client type: external
I0829 20:16:37.374889 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | Using SSH private key: /home/jenkins/minikube-integration/19530-11185/.minikube/machines/old-k8s-version-032002/id_rsa (-rw-------)
I0829 20:16:37.374914 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.116 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19530-11185/.minikube/machines/old-k8s-version-032002/id_rsa -p 22] /usr/bin/ssh <nil>}
I0829 20:16:37.374929 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | About to run SSH command:
I0829 20:16:37.374946 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | exit 0
I0829 20:16:37.502457 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | SSH cmd err, output: <nil>:
I0829 20:16:37.502780 61858 main.go:141] libmachine: (old-k8s-version-032002) KVM machine creation complete!
I0829 20:16:37.503128 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetConfigRaw
I0829 20:16:37.503650 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .DriverName
I0829 20:16:37.503845 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .DriverName
I0829 20:16:37.504011 61858 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0829 20:16:37.504026 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetState
I0829 20:16:37.505112 61858 main.go:141] libmachine: Detecting operating system of created instance...
I0829 20:16:37.505128 61858 main.go:141] libmachine: Waiting for SSH to be available...
I0829 20:16:37.505133 61858 main.go:141] libmachine: Getting to WaitForSSH function...
I0829 20:16:37.505141 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetSSHHostname
I0829 20:16:37.507215 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:37.507511 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a8:ca:96", ip: ""} in network mk-old-k8s-version-032002: {Iface:virbr1 ExpiryTime:2024-08-29 21:16:25 +0000 UTC Type:0 Mac:52:54:00:a8:ca:96 Iaid: IPaddr:192.168.39.116 Prefix:24 Hostname:old-k8s-version-032002 Clientid:01:52:54:00:a8:ca:96}
I0829 20:16:37.507538 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined IP address 192.168.39.116 and MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:37.507688 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetSSHPort
I0829 20:16:37.507864 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetSSHKeyPath
I0829 20:16:37.508009 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetSSHKeyPath
I0829 20:16:37.508142 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetSSHUsername
I0829 20:16:37.508296 61858 main.go:141] libmachine: Using SSH client type: native
I0829 20:16:37.508500 61858 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.39.116 22 <nil> <nil>}
I0829 20:16:37.508512 61858 main.go:141] libmachine: About to run SSH command:
exit 0
I0829 20:16:37.617799 61858 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0829 20:16:37.617827 61858 main.go:141] libmachine: Detecting the provisioner...
I0829 20:16:37.617837 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetSSHHostname
I0829 20:16:37.620591 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:37.621013 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a8:ca:96", ip: ""} in network mk-old-k8s-version-032002: {Iface:virbr1 ExpiryTime:2024-08-29 21:16:25 +0000 UTC Type:0 Mac:52:54:00:a8:ca:96 Iaid: IPaddr:192.168.39.116 Prefix:24 Hostname:old-k8s-version-032002 Clientid:01:52:54:00:a8:ca:96}
I0829 20:16:37.621053 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined IP address 192.168.39.116 and MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:37.621212 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetSSHPort
I0829 20:16:37.621382 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetSSHKeyPath
I0829 20:16:37.621559 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetSSHKeyPath
I0829 20:16:37.621731 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetSSHUsername
I0829 20:16:37.621927 61858 main.go:141] libmachine: Using SSH client type: native
I0829 20:16:37.622133 61858 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.39.116 22 <nil> <nil>}
I0829 20:16:37.622149 61858 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0829 20:16:37.731073 61858 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0829 20:16:37.731177 61858 main.go:141] libmachine: found compatible host: buildroot
I0829 20:16:37.731191 61858 main.go:141] libmachine: Provisioning with buildroot...
I0829 20:16:37.731204 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetMachineName
I0829 20:16:37.731444 61858 buildroot.go:166] provisioning hostname "old-k8s-version-032002"
I0829 20:16:37.731476 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetMachineName
I0829 20:16:37.731658 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetSSHHostname
I0829 20:16:37.734710 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:37.735133 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a8:ca:96", ip: ""} in network mk-old-k8s-version-032002: {Iface:virbr1 ExpiryTime:2024-08-29 21:16:25 +0000 UTC Type:0 Mac:52:54:00:a8:ca:96 Iaid: IPaddr:192.168.39.116 Prefix:24 Hostname:old-k8s-version-032002 Clientid:01:52:54:00:a8:ca:96}
I0829 20:16:37.735162 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined IP address 192.168.39.116 and MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:37.735281 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetSSHPort
I0829 20:16:37.735472 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetSSHKeyPath
I0829 20:16:37.735657 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetSSHKeyPath
I0829 20:16:37.735802 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetSSHUsername
I0829 20:16:37.735976 61858 main.go:141] libmachine: Using SSH client type: native
I0829 20:16:37.736189 61858 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.39.116 22 <nil> <nil>}
I0829 20:16:37.736208 61858 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-032002 && echo "old-k8s-version-032002" | sudo tee /etc/hostname
I0829 20:16:37.862417 61858 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-032002
I0829 20:16:37.862440 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetSSHHostname
I0829 20:16:37.865152 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:37.865524 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a8:ca:96", ip: ""} in network mk-old-k8s-version-032002: {Iface:virbr1 ExpiryTime:2024-08-29 21:16:25 +0000 UTC Type:0 Mac:52:54:00:a8:ca:96 Iaid: IPaddr:192.168.39.116 Prefix:24 Hostname:old-k8s-version-032002 Clientid:01:52:54:00:a8:ca:96}
I0829 20:16:37.865555 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined IP address 192.168.39.116 and MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:37.865701 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetSSHPort
I0829 20:16:37.865908 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetSSHKeyPath
I0829 20:16:37.866121 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetSSHKeyPath
I0829 20:16:37.866321 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetSSHUsername
I0829 20:16:37.866529 61858 main.go:141] libmachine: Using SSH client type: native
I0829 20:16:37.866794 61858 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.39.116 22 <nil> <nil>}
I0829 20:16:37.866816 61858 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-032002' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-032002/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-032002' | sudo tee -a /etc/hosts;
fi
fi
I0829 20:16:37.987712 61858 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0829 20:16:37.987772 61858 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19530-11185/.minikube CaCertPath:/home/jenkins/minikube-integration/19530-11185/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19530-11185/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19530-11185/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19530-11185/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19530-11185/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19530-11185/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19530-11185/.minikube}
I0829 20:16:37.987804 61858 buildroot.go:174] setting up certificates
I0829 20:16:37.987819 61858 provision.go:84] configureAuth start
I0829 20:16:37.987835 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetMachineName
I0829 20:16:37.988103 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetIP
I0829 20:16:37.990810 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:37.991169 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a8:ca:96", ip: ""} in network mk-old-k8s-version-032002: {Iface:virbr1 ExpiryTime:2024-08-29 21:16:25 +0000 UTC Type:0 Mac:52:54:00:a8:ca:96 Iaid: IPaddr:192.168.39.116 Prefix:24 Hostname:old-k8s-version-032002 Clientid:01:52:54:00:a8:ca:96}
I0829 20:16:37.991203 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined IP address 192.168.39.116 and MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:37.991294 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetSSHHostname
I0829 20:16:37.993281 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:37.993580 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a8:ca:96", ip: ""} in network mk-old-k8s-version-032002: {Iface:virbr1 ExpiryTime:2024-08-29 21:16:25 +0000 UTC Type:0 Mac:52:54:00:a8:ca:96 Iaid: IPaddr:192.168.39.116 Prefix:24 Hostname:old-k8s-version-032002 Clientid:01:52:54:00:a8:ca:96}
I0829 20:16:37.993617 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined IP address 192.168.39.116 and MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:37.993722 61858 provision.go:143] copyHostCerts
I0829 20:16:37.993780 61858 exec_runner.go:144] found /home/jenkins/minikube-integration/19530-11185/.minikube/ca.pem, removing ...
I0829 20:16:37.993799 61858 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19530-11185/.minikube/ca.pem
I0829 20:16:37.993889 61858 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19530-11185/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19530-11185/.minikube/ca.pem (1078 bytes)
I0829 20:16:37.994054 61858 exec_runner.go:144] found /home/jenkins/minikube-integration/19530-11185/.minikube/cert.pem, removing ...
I0829 20:16:37.994067 61858 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19530-11185/.minikube/cert.pem
I0829 20:16:37.994108 61858 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19530-11185/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19530-11185/.minikube/cert.pem (1123 bytes)
I0829 20:16:37.994199 61858 exec_runner.go:144] found /home/jenkins/minikube-integration/19530-11185/.minikube/key.pem, removing ...
I0829 20:16:37.994209 61858 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19530-11185/.minikube/key.pem
I0829 20:16:37.994260 61858 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19530-11185/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19530-11185/.minikube/key.pem (1675 bytes)
I0829 20:16:37.994340 61858 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19530-11185/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19530-11185/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19530-11185/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-032002 san=[127.0.0.1 192.168.39.116 localhost minikube old-k8s-version-032002]
I0829 20:16:38.255026 61858 provision.go:177] copyRemoteCerts
I0829 20:16:38.255094 61858 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0829 20:16:38.255115 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetSSHHostname
I0829 20:16:38.258117 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:38.258477 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a8:ca:96", ip: ""} in network mk-old-k8s-version-032002: {Iface:virbr1 ExpiryTime:2024-08-29 21:16:25 +0000 UTC Type:0 Mac:52:54:00:a8:ca:96 Iaid: IPaddr:192.168.39.116 Prefix:24 Hostname:old-k8s-version-032002 Clientid:01:52:54:00:a8:ca:96}
I0829 20:16:38.258508 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined IP address 192.168.39.116 and MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:38.258668 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetSSHPort
I0829 20:16:38.258866 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetSSHKeyPath
I0829 20:16:38.259009 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetSSHUsername
I0829 20:16:38.259117 61858 sshutil.go:53] new ssh client: &{IP:192.168.39.116 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19530-11185/.minikube/machines/old-k8s-version-032002/id_rsa Username:docker}
I0829 20:16:38.344747 61858 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19530-11185/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0829 20:16:38.369409 61858 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19530-11185/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0829 20:16:38.394132 61858 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19530-11185/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0829 20:16:38.418123 61858 provision.go:87] duration metric: took 430.286361ms to configureAuth
I0829 20:16:38.418156 61858 buildroot.go:189] setting minikube options for container-runtime
I0829 20:16:38.418317 61858 config.go:182] Loaded profile config "old-k8s-version-032002": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0829 20:16:38.418394 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetSSHHostname
I0829 20:16:38.421019 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:38.421337 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a8:ca:96", ip: ""} in network mk-old-k8s-version-032002: {Iface:virbr1 ExpiryTime:2024-08-29 21:16:25 +0000 UTC Type:0 Mac:52:54:00:a8:ca:96 Iaid: IPaddr:192.168.39.116 Prefix:24 Hostname:old-k8s-version-032002 Clientid:01:52:54:00:a8:ca:96}
I0829 20:16:38.421374 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined IP address 192.168.39.116 and MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:38.421600 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetSSHPort
I0829 20:16:38.421827 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetSSHKeyPath
I0829 20:16:38.421976 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetSSHKeyPath
I0829 20:16:38.422093 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetSSHUsername
I0829 20:16:38.422238 61858 main.go:141] libmachine: Using SSH client type: native
I0829 20:16:38.422404 61858 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.39.116 22 <nil> <nil>}
I0829 20:16:38.422418 61858 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0829 20:16:38.648990 61858 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0829 20:16:38.649012 61858 main.go:141] libmachine: Checking connection to Docker...
I0829 20:16:38.649026 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetURL
I0829 20:16:38.650243 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | Using libvirt version 6000000
I0829 20:16:38.652502 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:38.652864 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a8:ca:96", ip: ""} in network mk-old-k8s-version-032002: {Iface:virbr1 ExpiryTime:2024-08-29 21:16:25 +0000 UTC Type:0 Mac:52:54:00:a8:ca:96 Iaid: IPaddr:192.168.39.116 Prefix:24 Hostname:old-k8s-version-032002 Clientid:01:52:54:00:a8:ca:96}
I0829 20:16:38.652884 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined IP address 192.168.39.116 and MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:38.653031 61858 main.go:141] libmachine: Docker is up and running!
I0829 20:16:38.653045 61858 main.go:141] libmachine: Reticulating splines...
I0829 20:16:38.653059 61858 client.go:171] duration metric: took 27.486147084s to LocalClient.Create
I0829 20:16:38.653090 61858 start.go:167] duration metric: took 27.486219082s to libmachine.API.Create "old-k8s-version-032002"
I0829 20:16:38.653105 61858 start.go:293] postStartSetup for "old-k8s-version-032002" (driver="kvm2")
I0829 20:16:38.653119 61858 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0829 20:16:38.653143 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .DriverName
I0829 20:16:38.653401 61858 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0829 20:16:38.653425 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetSSHHostname
I0829 20:16:38.655587 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:38.655934 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a8:ca:96", ip: ""} in network mk-old-k8s-version-032002: {Iface:virbr1 ExpiryTime:2024-08-29 21:16:25 +0000 UTC Type:0 Mac:52:54:00:a8:ca:96 Iaid: IPaddr:192.168.39.116 Prefix:24 Hostname:old-k8s-version-032002 Clientid:01:52:54:00:a8:ca:96}
I0829 20:16:38.655955 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined IP address 192.168.39.116 and MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:38.656102 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetSSHPort
I0829 20:16:38.656264 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetSSHKeyPath
I0829 20:16:38.656380 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetSSHUsername
I0829 20:16:38.656526 61858 sshutil.go:53] new ssh client: &{IP:192.168.39.116 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19530-11185/.minikube/machines/old-k8s-version-032002/id_rsa Username:docker}
I0829 20:16:38.741231 61858 ssh_runner.go:195] Run: cat /etc/os-release
I0829 20:16:38.745199 61858 info.go:137] Remote host: Buildroot 2023.02.9
I0829 20:16:38.745226 61858 filesync.go:126] Scanning /home/jenkins/minikube-integration/19530-11185/.minikube/addons for local assets ...
I0829 20:16:38.745283 61858 filesync.go:126] Scanning /home/jenkins/minikube-integration/19530-11185/.minikube/files for local assets ...
I0829 20:16:38.745352 61858 filesync.go:149] local asset: /home/jenkins/minikube-integration/19530-11185/.minikube/files/etc/ssl/certs/183612.pem -> 183612.pem in /etc/ssl/certs
I0829 20:16:38.745436 61858 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0829 20:16:38.754642 61858 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19530-11185/.minikube/files/etc/ssl/certs/183612.pem --> /etc/ssl/certs/183612.pem (1708 bytes)
I0829 20:16:38.779595 61858 start.go:296] duration metric: took 126.475668ms for postStartSetup
I0829 20:16:38.779665 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetConfigRaw
I0829 20:16:38.780244 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetIP
I0829 20:16:38.782860 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:38.783296 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a8:ca:96", ip: ""} in network mk-old-k8s-version-032002: {Iface:virbr1 ExpiryTime:2024-08-29 21:16:25 +0000 UTC Type:0 Mac:52:54:00:a8:ca:96 Iaid: IPaddr:192.168.39.116 Prefix:24 Hostname:old-k8s-version-032002 Clientid:01:52:54:00:a8:ca:96}
I0829 20:16:38.783330 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined IP address 192.168.39.116 and MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:38.783546 61858 profile.go:143] Saving config to /home/jenkins/minikube-integration/19530-11185/.minikube/profiles/old-k8s-version-032002/config.json ...
I0829 20:16:38.783755 61858 start.go:128] duration metric: took 27.638674971s to createHost
I0829 20:16:38.783784 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetSSHHostname
I0829 20:16:38.786008 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:38.786296 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a8:ca:96", ip: ""} in network mk-old-k8s-version-032002: {Iface:virbr1 ExpiryTime:2024-08-29 21:16:25 +0000 UTC Type:0 Mac:52:54:00:a8:ca:96 Iaid: IPaddr:192.168.39.116 Prefix:24 Hostname:old-k8s-version-032002 Clientid:01:52:54:00:a8:ca:96}
I0829 20:16:38.786323 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined IP address 192.168.39.116 and MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:38.786445 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetSSHPort
I0829 20:16:38.786664 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetSSHKeyPath
I0829 20:16:38.786820 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetSSHKeyPath
I0829 20:16:38.786959 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetSSHUsername
I0829 20:16:38.787142 61858 main.go:141] libmachine: Using SSH client type: native
I0829 20:16:38.787301 61858 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.39.116 22 <nil> <nil>}
I0829 20:16:38.787312 61858 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0829 20:16:38.903094 61858 main.go:141] libmachine: SSH cmd err, output: <nil>: 1724962598.883732954
I0829 20:16:38.903125 61858 fix.go:216] guest clock: 1724962598.883732954
I0829 20:16:38.903138 61858 fix.go:229] Guest: 2024-08-29 20:16:38.883732954 +0000 UTC Remote: 2024-08-29 20:16:38.783771912 +0000 UTC m=+30.250334788 (delta=99.961042ms)
I0829 20:16:38.903190 61858 fix.go:200] guest clock delta is within tolerance: 99.961042ms
I0829 20:16:38.903197 61858 start.go:83] releasing machines lock for "old-k8s-version-032002", held for 27.758227721s
I0829 20:16:38.903229 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .DriverName
I0829 20:16:38.903535 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetIP
I0829 20:16:38.906562 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:38.907029 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a8:ca:96", ip: ""} in network mk-old-k8s-version-032002: {Iface:virbr1 ExpiryTime:2024-08-29 21:16:25 +0000 UTC Type:0 Mac:52:54:00:a8:ca:96 Iaid: IPaddr:192.168.39.116 Prefix:24 Hostname:old-k8s-version-032002 Clientid:01:52:54:00:a8:ca:96}
I0829 20:16:38.907068 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined IP address 192.168.39.116 and MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:38.907214 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .DriverName
I0829 20:16:38.907694 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .DriverName
I0829 20:16:38.907933 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .DriverName
I0829 20:16:38.908040 61858 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0829 20:16:38.908085 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetSSHHostname
I0829 20:16:38.908134 61858 ssh_runner.go:195] Run: cat /version.json
I0829 20:16:38.908161 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetSSHHostname
I0829 20:16:38.910921 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:38.911103 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:38.911309 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a8:ca:96", ip: ""} in network mk-old-k8s-version-032002: {Iface:virbr1 ExpiryTime:2024-08-29 21:16:25 +0000 UTC Type:0 Mac:52:54:00:a8:ca:96 Iaid: IPaddr:192.168.39.116 Prefix:24 Hostname:old-k8s-version-032002 Clientid:01:52:54:00:a8:ca:96}
I0829 20:16:38.911344 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined IP address 192.168.39.116 and MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:38.911497 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetSSHPort
I0829 20:16:38.911609 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a8:ca:96", ip: ""} in network mk-old-k8s-version-032002: {Iface:virbr1 ExpiryTime:2024-08-29 21:16:25 +0000 UTC Type:0 Mac:52:54:00:a8:ca:96 Iaid: IPaddr:192.168.39.116 Prefix:24 Hostname:old-k8s-version-032002 Clientid:01:52:54:00:a8:ca:96}
I0829 20:16:38.911641 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined IP address 192.168.39.116 and MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:38.911672 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetSSHKeyPath
I0829 20:16:38.911828 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetSSHPort
I0829 20:16:38.911828 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetSSHUsername
I0829 20:16:38.912017 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetSSHKeyPath
I0829 20:16:38.912011 61858 sshutil.go:53] new ssh client: &{IP:192.168.39.116 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19530-11185/.minikube/machines/old-k8s-version-032002/id_rsa Username:docker}
I0829 20:16:38.912166 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetSSHUsername
I0829 20:16:38.912298 61858 sshutil.go:53] new ssh client: &{IP:192.168.39.116 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19530-11185/.minikube/machines/old-k8s-version-032002/id_rsa Username:docker}
I0829 20:16:38.991920 61858 ssh_runner.go:195] Run: systemctl --version
I0829 20:16:39.022246 61858 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0829 20:16:39.183832 61858 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0829 20:16:39.189926 61858 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0829 20:16:39.190006 61858 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0829 20:16:39.207304 61858 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0829 20:16:39.207330 61858 start.go:495] detecting cgroup driver to use...
I0829 20:16:39.207403 61858 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0829 20:16:39.224020 61858 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0829 20:16:39.240953 61858 docker.go:217] disabling cri-docker service (if available) ...
I0829 20:16:39.241023 61858 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0829 20:16:39.257422 61858 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0829 20:16:39.273879 61858 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0829 20:16:39.396026 61858 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0829 20:16:39.544025 61858 docker.go:233] disabling docker service ...
I0829 20:16:39.544100 61858 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0829 20:16:39.559169 61858 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0829 20:16:39.572296 61858 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0829 20:16:39.683498 61858 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0829 20:16:39.811528 61858 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0829 20:16:39.826666 61858 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0829 20:16:39.847698 61858 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0829 20:16:39.847763 61858 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0829 20:16:39.858754 61858 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0829 20:16:39.858817 61858 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0829 20:16:39.869416 61858 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0829 20:16:39.879801 61858 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0829 20:16:39.890613 61858 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0829 20:16:39.904143 61858 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0829 20:16:39.916184 61858 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0829 20:16:39.916244 61858 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0829 20:16:39.930131 61858 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0829 20:16:39.939520 61858 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0829 20:16:40.051845 61858 ssh_runner.go:195] Run: sudo systemctl restart crio
I0829 20:16:40.146912 61858 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0829 20:16:40.147014 61858 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0829 20:16:40.152473 61858 start.go:563] Will wait 60s for crictl version
I0829 20:16:40.152548 61858 ssh_runner.go:195] Run: which crictl
I0829 20:16:40.156532 61858 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0829 20:16:40.201494 61858 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0829 20:16:40.201605 61858 ssh_runner.go:195] Run: crio --version
I0829 20:16:40.232274 61858 ssh_runner.go:195] Run: crio --version
I0829 20:16:40.262918 61858 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0829 20:16:40.264141 61858 main.go:141] libmachine: (old-k8s-version-032002) Calling .GetIP
I0829 20:16:40.267388 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:40.267859 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a8:ca:96", ip: ""} in network mk-old-k8s-version-032002: {Iface:virbr1 ExpiryTime:2024-08-29 21:16:25 +0000 UTC Type:0 Mac:52:54:00:a8:ca:96 Iaid: IPaddr:192.168.39.116 Prefix:24 Hostname:old-k8s-version-032002 Clientid:01:52:54:00:a8:ca:96}
I0829 20:16:40.267885 61858 main.go:141] libmachine: (old-k8s-version-032002) DBG | domain old-k8s-version-032002 has defined IP address 192.168.39.116 and MAC address 52:54:00:a8:ca:96 in network mk-old-k8s-version-032002
I0829 20:16:40.268119 61858 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I0829 20:16:40.272415 61858 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0829 20:16:40.286468 61858 kubeadm.go:883] updating cluster {Name:old-k8s-version-032002 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19530/minikube-v1.33.1-1724862017-19530-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-032002 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.116 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] M
ountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0829 20:16:40.286608 61858 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0829 20:16:40.286662 61858 ssh_runner.go:195] Run: sudo crictl images --output json
I0829 20:16:40.318233 61858 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0829 20:16:40.318309 61858 ssh_runner.go:195] Run: which lz4
I0829 20:16:40.322527 61858 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0829 20:16:40.327005 61858 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0829 20:16:40.327033 61858 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19530-11185/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0829 20:16:42.014087 61858 crio.go:462] duration metric: took 1.691594708s to copy over tarball
I0829 20:16:42.014163 61858 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0829 20:16:44.644889 61858 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.630678862s)
I0829 20:16:44.644923 61858 crio.go:469] duration metric: took 2.630808469s to extract the tarball
I0829 20:16:44.644932 61858 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0829 20:16:44.687721 61858 ssh_runner.go:195] Run: sudo crictl images --output json
I0829 20:16:44.733440 61858 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0829 20:16:44.733471 61858 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0829 20:16:44.733524 61858 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0829 20:16:44.733560 61858 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0829 20:16:44.733576 61858 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0829 20:16:44.733611 61858 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0829 20:16:44.733662 61858 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0829 20:16:44.733677 61858 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0829 20:16:44.733683 61858 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0829 20:16:44.733742 61858 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0829 20:16:44.735378 61858 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0829 20:16:44.735453 61858 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0829 20:16:44.735506 61858 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0829 20:16:44.735526 61858 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0829 20:16:44.735642 61858 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0829 20:16:44.735689 61858 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0829 20:16:44.735379 61858 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0829 20:16:44.735745 61858 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0829 20:16:44.906384 61858 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0829 20:16:44.908263 61858 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0829 20:16:44.908941 61858 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0829 20:16:44.909589 61858 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0829 20:16:44.916259 61858 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0829 20:16:44.932762 61858 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0829 20:16:45.001990 61858 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0829 20:16:45.002042 61858 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0829 20:16:45.002095 61858 ssh_runner.go:195] Run: which crictl
I0829 20:16:45.023699 61858 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0829 20:16:45.054600 61858 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0829 20:16:45.061553 61858 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0829 20:16:45.061597 61858 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0829 20:16:45.061654 61858 ssh_runner.go:195] Run: which crictl
I0829 20:16:45.069743 61858 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0829 20:16:45.069790 61858 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0829 20:16:45.069793 61858 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0829 20:16:45.069825 61858 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0829 20:16:45.069875 61858 ssh_runner.go:195] Run: which crictl
I0829 20:16:45.069886 61858 ssh_runner.go:195] Run: which crictl
I0829 20:16:45.069932 61858 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0829 20:16:45.069962 61858 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0829 20:16:45.070006 61858 ssh_runner.go:195] Run: which crictl
I0829 20:16:45.096225 61858 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0829 20:16:45.096268 61858 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0829 20:16:45.096276 61858 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0829 20:16:45.096309 61858 ssh_runner.go:195] Run: which crictl
I0829 20:16:45.162049 61858 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0829 20:16:45.162091 61858 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0829 20:16:45.162141 61858 ssh_runner.go:195] Run: which crictl
I0829 20:16:45.265008 61858 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0829 20:16:45.265084 61858 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0829 20:16:45.265120 61858 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0829 20:16:45.265092 61858 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0829 20:16:45.265176 61858 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0829 20:16:45.265185 61858 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0829 20:16:45.265251 61858 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0829 20:16:45.408158 61858 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0829 20:16:45.425218 61858 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0829 20:16:45.425299 61858 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0829 20:16:45.426780 61858 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0829 20:16:45.426925 61858 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0829 20:16:45.426989 61858 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0829 20:16:45.427082 61858 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0829 20:16:45.557994 61858 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0829 20:16:45.586753 61858 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0829 20:16:45.586802 61858 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0829 20:16:45.586804 61858 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0829 20:16:45.586879 61858 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0829 20:16:45.586890 61858 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0829 20:16:45.586939 61858 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19530-11185/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0829 20:16:45.640236 61858 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19530-11185/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0829 20:16:45.731704 61858 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19530-11185/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0829 20:16:45.731787 61858 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19530-11185/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0829 20:16:45.731810 61858 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19530-11185/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0829 20:16:45.733767 61858 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19530-11185/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0829 20:16:45.733789 61858 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19530-11185/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0829 20:16:45.733838 61858 cache_images.go:92] duration metric: took 1.000353232s to LoadCachedImages
W0829 20:16:45.733908 61858 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19530-11185/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19530-11185/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0: no such file or directory
I0829 20:16:45.733923 61858 kubeadm.go:934] updating node { 192.168.39.116 8443 v1.20.0 crio true true} ...
I0829 20:16:45.734089 61858 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-032002 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.39.116
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-032002 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0829 20:16:45.734179 61858 ssh_runner.go:195] Run: crio config
I0829 20:16:45.785286 61858 cni.go:84] Creating CNI manager for ""
I0829 20:16:45.785310 61858 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0829 20:16:45.785332 61858 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0829 20:16:45.785358 61858 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.116 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-032002 NodeName:old-k8s-version-032002 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.116"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.116 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0829 20:16:45.785527 61858 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.39.116
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-032002"
kubeletExtraArgs:
node-ip: 192.168.39.116
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.39.116"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0829 20:16:45.785599 61858 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0829 20:16:45.796549 61858 binaries.go:44] Found k8s binaries, skipping transfer
I0829 20:16:45.796628 61858 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0829 20:16:45.806867 61858 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0829 20:16:45.826717 61858 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0829 20:16:45.845554 61858 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0829 20:16:45.864838 61858 ssh_runner.go:195] Run: grep 192.168.39.116 control-plane.minikube.internal$ /etc/hosts
I0829 20:16:45.869121 61858 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.116 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0829 20:16:45.882235 61858 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0829 20:16:46.006442 61858 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0829 20:16:46.025218 61858 certs.go:68] Setting up /home/jenkins/minikube-integration/19530-11185/.minikube/profiles/old-k8s-version-032002 for IP: 192.168.39.116
I0829 20:16:46.025245 61858 certs.go:194] generating shared ca certs ...
I0829 20:16:46.025265 61858 certs.go:226] acquiring lock for ca certs: {Name:mkb8471fcf7387f342d41e80fd751f9886e73f05 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0829 20:16:46.025447 61858 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19530-11185/.minikube/ca.key
I0829 20:16:46.025506 61858 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19530-11185/.minikube/proxy-client-ca.key
I0829 20:16:46.025522 61858 certs.go:256] generating profile certs ...
I0829 20:16:46.025594 61858 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19530-11185/.minikube/profiles/old-k8s-version-032002/client.key
I0829 20:16:46.025615 61858 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19530-11185/.minikube/profiles/old-k8s-version-032002/client.crt with IP's: []
I0829 20:16:46.158845 61858 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19530-11185/.minikube/profiles/old-k8s-version-032002/client.crt ...
I0829 20:16:46.158871 61858 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19530-11185/.minikube/profiles/old-k8s-version-032002/client.crt: {Name:mk8636951b4f1b4afe15e8646be77fcee688ce7b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0829 20:16:46.159030 61858 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19530-11185/.minikube/profiles/old-k8s-version-032002/client.key ...
I0829 20:16:46.159045 61858 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19530-11185/.minikube/profiles/old-k8s-version-032002/client.key: {Name:mkc4f8e085f91f786914b5bff0dd2fcf761de666 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0829 20:16:46.159119 61858 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19530-11185/.minikube/profiles/old-k8s-version-032002/apiserver.key.a1a2aebb
I0829 20:16:46.159134 61858 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19530-11185/.minikube/profiles/old-k8s-version-032002/apiserver.crt.a1a2aebb with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.116]
I0829 20:16:46.215427 61858 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19530-11185/.minikube/profiles/old-k8s-version-032002/apiserver.crt.a1a2aebb ...
I0829 20:16:46.215458 61858 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19530-11185/.minikube/profiles/old-k8s-version-032002/apiserver.crt.a1a2aebb: {Name:mk851abde9a4af84a2faaa41ce88a658fb8acf0a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0829 20:16:46.215645 61858 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19530-11185/.minikube/profiles/old-k8s-version-032002/apiserver.key.a1a2aebb ...
I0829 20:16:46.215666 61858 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19530-11185/.minikube/profiles/old-k8s-version-032002/apiserver.key.a1a2aebb: {Name:mk816638087e85751d5fde787565a10184e5aacf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0829 20:16:46.215763 61858 certs.go:381] copying /home/jenkins/minikube-integration/19530-11185/.minikube/profiles/old-k8s-version-032002/apiserver.crt.a1a2aebb -> /home/jenkins/minikube-integration/19530-11185/.minikube/profiles/old-k8s-version-032002/apiserver.crt
I0829 20:16:46.215856 61858 certs.go:385] copying /home/jenkins/minikube-integration/19530-11185/.minikube/profiles/old-k8s-version-032002/apiserver.key.a1a2aebb -> /home/jenkins/minikube-integration/19530-11185/.minikube/profiles/old-k8s-version-032002/apiserver.key
I0829 20:16:46.215936 61858 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19530-11185/.minikube/profiles/old-k8s-version-032002/proxy-client.key
I0829 20:16:46.215958 61858 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19530-11185/.minikube/profiles/old-k8s-version-032002/proxy-client.crt with IP's: []
I0829 20:16:46.314206 61858 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19530-11185/.minikube/profiles/old-k8s-version-032002/proxy-client.crt ...
I0829 20:16:46.314241 61858 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19530-11185/.minikube/profiles/old-k8s-version-032002/proxy-client.crt: {Name:mk6b9870e8610969c6c8d46a4f5367e2215d7a8e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0829 20:16:46.314422 61858 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19530-11185/.minikube/profiles/old-k8s-version-032002/proxy-client.key ...
I0829 20:16:46.314440 61858 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19530-11185/.minikube/profiles/old-k8s-version-032002/proxy-client.key: {Name:mkc0bea992e1ffddfce86115d24dca460d79bfdd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0829 20:16:46.314664 61858 certs.go:484] found cert: /home/jenkins/minikube-integration/19530-11185/.minikube/certs/18361.pem (1338 bytes)
W0829 20:16:46.314706 61858 certs.go:480] ignoring /home/jenkins/minikube-integration/19530-11185/.minikube/certs/18361_empty.pem, impossibly tiny 0 bytes
I0829 20:16:46.314716 61858 certs.go:484] found cert: /home/jenkins/minikube-integration/19530-11185/.minikube/certs/ca-key.pem (1675 bytes)
I0829 20:16:46.314736 61858 certs.go:484] found cert: /home/jenkins/minikube-integration/19530-11185/.minikube/certs/ca.pem (1078 bytes)
I0829 20:16:46.314779 61858 certs.go:484] found cert: /home/jenkins/minikube-integration/19530-11185/.minikube/certs/cert.pem (1123 bytes)
I0829 20:16:46.314812 61858 certs.go:484] found cert: /home/jenkins/minikube-integration/19530-11185/.minikube/certs/key.pem (1675 bytes)
I0829 20:16:46.314848 61858 certs.go:484] found cert: /home/jenkins/minikube-integration/19530-11185/.minikube/files/etc/ssl/certs/183612.pem (1708 bytes)
I0829 20:16:46.315530 61858 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19530-11185/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0829 20:16:46.346930 61858 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19530-11185/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0829 20:16:46.374205 61858 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19530-11185/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0829 20:16:46.402326 61858 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19530-11185/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0829 20:16:46.429740 61858 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19530-11185/.minikube/profiles/old-k8s-version-032002/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0829 20:16:46.454242 61858 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19530-11185/.minikube/profiles/old-k8s-version-032002/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0829 20:16:46.478427 61858 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19530-11185/.minikube/profiles/old-k8s-version-032002/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0829 20:16:46.503275 61858 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19530-11185/.minikube/profiles/old-k8s-version-032002/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0829 20:16:46.527415 61858 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19530-11185/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0829 20:16:46.551175 61858 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19530-11185/.minikube/certs/18361.pem --> /usr/share/ca-certificates/18361.pem (1338 bytes)
I0829 20:16:46.577218 61858 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19530-11185/.minikube/files/etc/ssl/certs/183612.pem --> /usr/share/ca-certificates/183612.pem (1708 bytes)
I0829 20:16:46.603468 61858 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0829 20:16:46.622237 61858 ssh_runner.go:195] Run: openssl version
I0829 20:16:46.628485 61858 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/18361.pem && ln -fs /usr/share/ca-certificates/18361.pem /etc/ssl/certs/18361.pem"
I0829 20:16:46.642039 61858 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/18361.pem
I0829 20:16:46.647053 61858 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug 29 19:13 /usr/share/ca-certificates/18361.pem
I0829 20:16:46.647122 61858 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/18361.pem
I0829 20:16:46.653333 61858 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/18361.pem /etc/ssl/certs/51391683.0"
I0829 20:16:46.665990 61858 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/183612.pem && ln -fs /usr/share/ca-certificates/183612.pem /etc/ssl/certs/183612.pem"
I0829 20:16:46.678390 61858 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/183612.pem
I0829 20:16:46.684197 61858 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug 29 19:13 /usr/share/ca-certificates/183612.pem
I0829 20:16:46.684266 61858 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/183612.pem
I0829 20:16:46.690942 61858 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/183612.pem /etc/ssl/certs/3ec20f2e.0"
I0829 20:16:46.702330 61858 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0829 20:16:46.713626 61858 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0829 20:16:46.718322 61858 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug 29 18:56 /usr/share/ca-certificates/minikubeCA.pem
I0829 20:16:46.718399 61858 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0829 20:16:46.724379 61858 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0829 20:16:46.735494 61858 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0829 20:16:46.740002 61858 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0829 20:16:46.740061 61858 kubeadm.go:392] StartCluster: {Name:old-k8s-version-032002 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19530/minikube-v1.33.1-1724862017-19530-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-032002 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.116 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0829 20:16:46.740138 61858 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0829 20:16:46.740185 61858 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0829 20:16:46.783291 61858 cri.go:89] found id: ""
I0829 20:16:46.783402 61858 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0829 20:16:46.794156 61858 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0829 20:16:46.804706 61858 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0829 20:16:46.815006 61858 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0829 20:16:46.815029 61858 kubeadm.go:157] found existing configuration files:
I0829 20:16:46.815096 61858 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0829 20:16:46.824694 61858 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0829 20:16:46.824785 61858 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0829 20:16:46.835906 61858 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0829 20:16:46.845671 61858 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0829 20:16:46.845748 61858 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0829 20:16:46.855979 61858 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0829 20:16:46.867837 61858 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0829 20:16:46.867923 61858 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0829 20:16:46.881261 61858 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0829 20:16:46.891124 61858 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0829 20:16:46.891205 61858 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0829 20:16:46.902044 61858 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0829 20:16:47.035811 61858 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0829 20:16:47.035911 61858 kubeadm.go:310] [preflight] Running pre-flight checks
I0829 20:16:47.185175 61858 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0829 20:16:47.185328 61858 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0829 20:16:47.185484 61858 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0829 20:16:47.387946 61858 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0829 20:16:47.432241 61858 out.go:235] - Generating certificates and keys ...
I0829 20:16:47.432366 61858 kubeadm.go:310] [certs] Using existing ca certificate authority
I0829 20:16:47.432480 61858 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0829 20:16:47.610782 61858 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0829 20:16:47.930124 61858 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0829 20:16:48.188217 61858 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0829 20:16:48.305126 61858 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0829 20:16:48.409595 61858 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0829 20:16:48.409870 61858 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-032002] and IPs [192.168.39.116 127.0.0.1 ::1]
I0829 20:16:48.480999 61858 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0829 20:16:48.481210 61858 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-032002] and IPs [192.168.39.116 127.0.0.1 ::1]
I0829 20:16:48.586294 61858 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0829 20:16:48.683901 61858 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0829 20:16:49.034324 61858 kubeadm.go:310] [certs] Generating "sa" key and public key
I0829 20:16:49.034717 61858 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0829 20:16:49.395020 61858 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0829 20:16:49.630662 61858 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0829 20:16:49.968435 61858 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0829 20:16:50.209620 61858 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0829 20:16:50.233391 61858 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0829 20:16:50.235129 61858 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0829 20:16:50.235218 61858 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0829 20:16:50.376623 61858 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0829 20:16:50.378573 61858 out.go:235] - Booting up control plane ...
I0829 20:16:50.378709 61858 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0829 20:16:50.392262 61858 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0829 20:16:50.393710 61858 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0829 20:16:50.394997 61858 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0829 20:16:50.400017 61858 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0829 20:17:30.395221 61858 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0829 20:17:30.395336 61858 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0829 20:17:30.395683 61858 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0829 20:17:35.395756 61858 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0829 20:17:35.396021 61858 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0829 20:17:45.395789 61858 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0829 20:17:45.396074 61858 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0829 20:18:05.395793 61858 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0829 20:18:05.396081 61858 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0829 20:18:45.397798 61858 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0829 20:18:45.398073 61858 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0829 20:18:45.398105 61858 kubeadm.go:310]
I0829 20:18:45.398163 61858 kubeadm.go:310] Unfortunately, an error has occurred:
I0829 20:18:45.398214 61858 kubeadm.go:310] timed out waiting for the condition
I0829 20:18:45.398223 61858 kubeadm.go:310]
I0829 20:18:45.398276 61858 kubeadm.go:310] This error is likely caused by:
I0829 20:18:45.398330 61858 kubeadm.go:310] - The kubelet is not running
I0829 20:18:45.398464 61858 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0829 20:18:45.398475 61858 kubeadm.go:310]
I0829 20:18:45.398639 61858 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0829 20:18:45.398699 61858 kubeadm.go:310] - 'systemctl status kubelet'
I0829 20:18:45.398748 61858 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0829 20:18:45.398755 61858 kubeadm.go:310]
I0829 20:18:45.398901 61858 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0829 20:18:45.399032 61858 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0829 20:18:45.399043 61858 kubeadm.go:310]
I0829 20:18:45.399193 61858 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0829 20:18:45.399321 61858 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0829 20:18:45.399431 61858 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0829 20:18:45.399531 61858 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0829 20:18:45.399543 61858 kubeadm.go:310]
I0829 20:18:45.399738 61858 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0829 20:18:45.399852 61858 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0829 20:18:45.399954 61858 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
W0829 20:18:45.400132 61858 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-032002] and IPs [192.168.39.116 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-032002] and IPs [192.168.39.116 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-032002] and IPs [192.168.39.116 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-032002] and IPs [192.168.39.116 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0829 20:18:45.400188 61858 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0829 20:18:45.881994 61858 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0829 20:18:45.896695 61858 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0829 20:18:45.906551 61858 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0829 20:18:45.906578 61858 kubeadm.go:157] found existing configuration files:
I0829 20:18:45.906634 61858 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0829 20:18:45.916222 61858 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0829 20:18:45.916280 61858 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0829 20:18:45.925644 61858 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0829 20:18:45.934454 61858 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0829 20:18:45.934509 61858 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0829 20:18:45.943755 61858 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0829 20:18:45.952674 61858 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0829 20:18:45.952739 61858 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0829 20:18:45.961932 61858 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0829 20:18:45.971069 61858 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0829 20:18:45.971126 61858 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0829 20:18:45.980943 61858 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0829 20:18:46.194600 61858 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0829 20:20:42.221138 61858 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0829 20:20:42.221231 61858 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0829 20:20:42.221328 61858 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0829 20:20:42.221404 61858 kubeadm.go:310] [preflight] Running pre-flight checks
I0829 20:20:42.221496 61858 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0829 20:20:42.221617 61858 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0829 20:20:42.221734 61858 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0829 20:20:42.221808 61858 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0829 20:20:42.223727 61858 out.go:235] - Generating certificates and keys ...
I0829 20:20:42.223829 61858 kubeadm.go:310] [certs] Using existing ca certificate authority
I0829 20:20:42.223926 61858 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0829 20:20:42.224065 61858 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0829 20:20:42.224167 61858 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0829 20:20:42.224272 61858 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0829 20:20:42.224357 61858 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0829 20:20:42.224443 61858 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0829 20:20:42.224528 61858 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0829 20:20:42.224615 61858 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0829 20:20:42.224718 61858 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0829 20:20:42.224783 61858 kubeadm.go:310] [certs] Using the existing "sa" key
I0829 20:20:42.224867 61858 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0829 20:20:42.224925 61858 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0829 20:20:42.224989 61858 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0829 20:20:42.225077 61858 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0829 20:20:42.225152 61858 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0829 20:20:42.225292 61858 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0829 20:20:42.225407 61858 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0829 20:20:42.225465 61858 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0829 20:20:42.225550 61858 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0829 20:20:42.227188 61858 out.go:235] - Booting up control plane ...
I0829 20:20:42.227293 61858 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0829 20:20:42.227384 61858 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0829 20:20:42.227486 61858 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0829 20:20:42.227628 61858 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0829 20:20:42.227857 61858 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0829 20:20:42.227935 61858 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0829 20:20:42.228022 61858 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0829 20:20:42.228264 61858 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0829 20:20:42.228359 61858 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0829 20:20:42.228599 61858 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0829 20:20:42.228692 61858 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0829 20:20:42.228940 61858 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0829 20:20:42.229027 61858 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0829 20:20:42.229275 61858 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0829 20:20:42.229369 61858 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0829 20:20:42.229609 61858 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0829 20:20:42.229620 61858 kubeadm.go:310]
I0829 20:20:42.229678 61858 kubeadm.go:310] Unfortunately, an error has occurred:
I0829 20:20:42.229733 61858 kubeadm.go:310] timed out waiting for the condition
I0829 20:20:42.229744 61858 kubeadm.go:310]
I0829 20:20:42.229789 61858 kubeadm.go:310] This error is likely caused by:
I0829 20:20:42.229837 61858 kubeadm.go:310] - The kubelet is not running
I0829 20:20:42.229981 61858 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0829 20:20:42.229991 61858 kubeadm.go:310]
I0829 20:20:42.230116 61858 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0829 20:20:42.230165 61858 kubeadm.go:310] - 'systemctl status kubelet'
I0829 20:20:42.230211 61858 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0829 20:20:42.230220 61858 kubeadm.go:310]
I0829 20:20:42.230356 61858 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0829 20:20:42.230470 61858 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0829 20:20:42.230480 61858 kubeadm.go:310]
I0829 20:20:42.230634 61858 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0829 20:20:42.230757 61858 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0829 20:20:42.230865 61858 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0829 20:20:42.230965 61858 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0829 20:20:42.231035 61858 kubeadm.go:394] duration metric: took 3m55.490976607s to StartCluster
I0829 20:20:42.231088 61858 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0829 20:20:42.231155 61858 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0829 20:20:42.231222 61858 kubeadm.go:310]
I0829 20:20:42.282749 61858 cri.go:89] found id: ""
I0829 20:20:42.282776 61858 logs.go:276] 0 containers: []
W0829 20:20:42.282784 61858 logs.go:278] No container was found matching "kube-apiserver"
I0829 20:20:42.282792 61858 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0829 20:20:42.282857 61858 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0829 20:20:42.318421 61858 cri.go:89] found id: ""
I0829 20:20:42.318449 61858 logs.go:276] 0 containers: []
W0829 20:20:42.318459 61858 logs.go:278] No container was found matching "etcd"
I0829 20:20:42.318466 61858 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0829 20:20:42.318526 61858 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0829 20:20:42.360336 61858 cri.go:89] found id: ""
I0829 20:20:42.360360 61858 logs.go:276] 0 containers: []
W0829 20:20:42.360370 61858 logs.go:278] No container was found matching "coredns"
I0829 20:20:42.360377 61858 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0829 20:20:42.360436 61858 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0829 20:20:42.397515 61858 cri.go:89] found id: ""
I0829 20:20:42.397539 61858 logs.go:276] 0 containers: []
W0829 20:20:42.397549 61858 logs.go:278] No container was found matching "kube-scheduler"
I0829 20:20:42.397556 61858 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0829 20:20:42.397625 61858 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0829 20:20:42.436073 61858 cri.go:89] found id: ""
I0829 20:20:42.436102 61858 logs.go:276] 0 containers: []
W0829 20:20:42.436109 61858 logs.go:278] No container was found matching "kube-proxy"
I0829 20:20:42.436117 61858 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0829 20:20:42.436177 61858 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0829 20:20:42.470730 61858 cri.go:89] found id: ""
I0829 20:20:42.470758 61858 logs.go:276] 0 containers: []
W0829 20:20:42.470767 61858 logs.go:278] No container was found matching "kube-controller-manager"
I0829 20:20:42.470774 61858 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0829 20:20:42.470824 61858 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0829 20:20:42.504850 61858 cri.go:89] found id: ""
I0829 20:20:42.504872 61858 logs.go:276] 0 containers: []
W0829 20:20:42.504880 61858 logs.go:278] No container was found matching "kindnet"
I0829 20:20:42.504889 61858 logs.go:123] Gathering logs for kubelet ...
I0829 20:20:42.504900 61858 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0829 20:20:42.559407 61858 logs.go:123] Gathering logs for dmesg ...
I0829 20:20:42.559442 61858 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0829 20:20:42.573555 61858 logs.go:123] Gathering logs for describe nodes ...
I0829 20:20:42.573581 61858 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0829 20:20:42.699037 61858 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0829 20:20:42.699061 61858 logs.go:123] Gathering logs for CRI-O ...
I0829 20:20:42.699072 61858 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0829 20:20:42.817420 61858 logs.go:123] Gathering logs for container status ...
I0829 20:20:42.817452 61858 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0829 20:20:42.865006 61858 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0829 20:20:42.865078 61858 out.go:270] *
*
W0829 20:20:42.865135 61858 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0829 20:20:42.865160 61858 out.go:270] *
*
W0829 20:20:42.866199 61858 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0829 20:20:42.869847 61858 out.go:201]
W0829 20:20:42.871109 61858 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0829 20:20:42.871143 61858 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0829 20:20:42.871160 61858 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0829 20:20:42.872689 61858 out.go:201]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-032002 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-032002 -n old-k8s-version-032002
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-032002 -n old-k8s-version-032002: exit status 6 (313.047352ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0829 20:20:43.233626 66263 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-032002" does not appear in /home/jenkins/minikube-integration/19530-11185/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-032002" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (274.72s)