=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-783465 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-783465 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m46.935977573s)
-- stdout --
* [old-k8s-version-783465] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=19461
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19461-9545/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19461-9545/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-783465" primary control-plane node in "old-k8s-version-783465" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0816 18:04:10.377168 67727 out.go:345] Setting OutFile to fd 1 ...
I0816 18:04:10.377408 67727 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0816 18:04:10.377417 67727 out.go:358] Setting ErrFile to fd 2...
I0816 18:04:10.377421 67727 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0816 18:04:10.377622 67727 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19461-9545/.minikube/bin
I0816 18:04:10.378311 67727 out.go:352] Setting JSON to false
I0816 18:04:10.379414 67727 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":6348,"bootTime":1723825102,"procs":307,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1066-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0816 18:04:10.379476 67727 start.go:139] virtualization: kvm guest
I0816 18:04:10.381385 67727 out.go:177] * [old-k8s-version-783465] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
I0816 18:04:10.382740 67727 notify.go:220] Checking for updates...
I0816 18:04:10.383368 67727 out.go:177] - MINIKUBE_LOCATION=19461
I0816 18:04:10.384618 67727 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0816 18:04:10.386100 67727 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19461-9545/kubeconfig
I0816 18:04:10.387470 67727 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19461-9545/.minikube
I0816 18:04:10.388751 67727 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0816 18:04:10.389916 67727 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0816 18:04:10.391555 67727 config.go:182] Loaded profile config "calico-791304": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.0
I0816 18:04:10.391666 67727 config.go:182] Loaded profile config "custom-flannel-791304": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.0
I0816 18:04:10.391741 67727 config.go:182] Loaded profile config "kindnet-791304": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.0
I0816 18:04:10.391824 67727 driver.go:392] Setting default libvirt URI to qemu:///system
I0816 18:04:10.430966 67727 out.go:177] * Using the kvm2 driver based on user configuration
I0816 18:04:10.432266 67727 start.go:297] selected driver: kvm2
I0816 18:04:10.432282 67727 start.go:901] validating driver "kvm2" against <nil>
I0816 18:04:10.432293 67727 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0816 18:04:10.433087 67727 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0816 18:04:10.433157 67727 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19461-9545/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0816 18:04:10.450273 67727 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.1
I0816 18:04:10.450351 67727 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0816 18:04:10.450597 67727 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0816 18:04:10.450668 67727 cni.go:84] Creating CNI manager for ""
I0816 18:04:10.450689 67727 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0816 18:04:10.450703 67727 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0816 18:04:10.450769 67727 start.go:340] cluster config:
{Name:old-k8s-version-783465 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-783465 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0816 18:04:10.450915 67727 iso.go:125] acquiring lock: {Name:mke35866c1d0f078e1f027c2d727692722810e04 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0816 18:04:10.452593 67727 out.go:177] * Starting "old-k8s-version-783465" primary control-plane node in "old-k8s-version-783465" cluster
I0816 18:04:10.454132 67727 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0816 18:04:10.454178 67727 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19461-9545/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0816 18:04:10.454189 67727 cache.go:56] Caching tarball of preloaded images
I0816 18:04:10.454281 67727 preload.go:172] Found /home/jenkins/minikube-integration/19461-9545/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0816 18:04:10.454295 67727 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0816 18:04:10.454425 67727 profile.go:143] Saving config to /home/jenkins/minikube-integration/19461-9545/.minikube/profiles/old-k8s-version-783465/config.json ...
I0816 18:04:10.454455 67727 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19461-9545/.minikube/profiles/old-k8s-version-783465/config.json: {Name:mkade4cf5d56ea0f5bb661a6ae704f7309fcb271 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0816 18:04:10.454651 67727 start.go:360] acquireMachinesLock for old-k8s-version-783465: {Name:mke1ffa1f2d6d714bdd85e184816ba8f4dfd08f1 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0816 18:04:26.001246 67727 start.go:364] duration metric: took 15.546519365s to acquireMachinesLock for "old-k8s-version-783465"
I0816 18:04:26.001340 67727 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-783465 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19452/minikube-v1.33.1-1723740674-19452-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-783465 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0816 18:04:26.001476 67727 start.go:125] createHost starting for "" (driver="kvm2")
I0816 18:04:26.003389 67727 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0816 18:04:26.003612 67727 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0816 18:04:26.003651 67727 main.go:141] libmachine: Launching plugin server for driver kvm2
I0816 18:04:26.020119 67727 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40265
I0816 18:04:26.020606 67727 main.go:141] libmachine: () Calling .GetVersion
I0816 18:04:26.021180 67727 main.go:141] libmachine: Using API Version 1
I0816 18:04:26.021203 67727 main.go:141] libmachine: () Calling .SetConfigRaw
I0816 18:04:26.021508 67727 main.go:141] libmachine: () Calling .GetMachineName
I0816 18:04:26.021677 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetMachineName
I0816 18:04:26.021803 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .DriverName
I0816 18:04:26.021921 67727 start.go:159] libmachine.API.Create for "old-k8s-version-783465" (driver="kvm2")
I0816 18:04:26.021944 67727 client.go:168] LocalClient.Create starting
I0816 18:04:26.021973 67727 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19461-9545/.minikube/certs/ca.pem
I0816 18:04:26.022008 67727 main.go:141] libmachine: Decoding PEM data...
I0816 18:04:26.022028 67727 main.go:141] libmachine: Parsing certificate...
I0816 18:04:26.022081 67727 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19461-9545/.minikube/certs/cert.pem
I0816 18:04:26.022101 67727 main.go:141] libmachine: Decoding PEM data...
I0816 18:04:26.022114 67727 main.go:141] libmachine: Parsing certificate...
I0816 18:04:26.022141 67727 main.go:141] libmachine: Running pre-create checks...
I0816 18:04:26.022154 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .PreCreateCheck
I0816 18:04:26.022521 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetConfigRaw
I0816 18:04:26.022868 67727 main.go:141] libmachine: Creating machine...
I0816 18:04:26.022881 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .Create
I0816 18:04:26.023015 67727 main.go:141] libmachine: (old-k8s-version-783465) Creating KVM machine...
I0816 18:04:26.024091 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | found existing default KVM network
I0816 18:04:26.025933 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | I0816 18:04:26.025798 67950 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00010f7f0}
I0816 18:04:26.025989 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | created network xml:
I0816 18:04:26.026011 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | <network>
I0816 18:04:26.026026 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | <name>mk-old-k8s-version-783465</name>
I0816 18:04:26.026038 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | <dns enable='no'/>
I0816 18:04:26.026051 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG |
I0816 18:04:26.026063 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | <ip address='192.168.39.1' netmask='255.255.255.0'>
I0816 18:04:26.026086 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | <dhcp>
I0816 18:04:26.026097 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | <range start='192.168.39.2' end='192.168.39.253'/>
I0816 18:04:26.026108 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | </dhcp>
I0816 18:04:26.026120 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | </ip>
I0816 18:04:26.026130 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG |
I0816 18:04:26.026142 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | </network>
I0816 18:04:26.026150 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG |
I0816 18:04:26.031074 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | trying to create private KVM network mk-old-k8s-version-783465 192.168.39.0/24...
I0816 18:04:26.107732 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | private KVM network mk-old-k8s-version-783465 192.168.39.0/24 created
I0816 18:04:26.107767 67727 main.go:141] libmachine: (old-k8s-version-783465) Setting up store path in /home/jenkins/minikube-integration/19461-9545/.minikube/machines/old-k8s-version-783465 ...
I0816 18:04:26.107793 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | I0816 18:04:26.107714 67950 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19461-9545/.minikube
I0816 18:04:26.107807 67727 main.go:141] libmachine: (old-k8s-version-783465) Building disk image from file:///home/jenkins/minikube-integration/19461-9545/.minikube/cache/iso/amd64/minikube-v1.33.1-1723740674-19452-amd64.iso
I0816 18:04:26.107829 67727 main.go:141] libmachine: (old-k8s-version-783465) Downloading /home/jenkins/minikube-integration/19461-9545/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19461-9545/.minikube/cache/iso/amd64/minikube-v1.33.1-1723740674-19452-amd64.iso...
I0816 18:04:26.362118 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | I0816 18:04:26.362003 67950 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19461-9545/.minikube/machines/old-k8s-version-783465/id_rsa...
I0816 18:04:26.447875 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | I0816 18:04:26.447767 67950 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19461-9545/.minikube/machines/old-k8s-version-783465/old-k8s-version-783465.rawdisk...
I0816 18:04:26.447906 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | Writing magic tar header
I0816 18:04:26.447923 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | Writing SSH key tar header
I0816 18:04:26.447935 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | I0816 18:04:26.447880 67950 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19461-9545/.minikube/machines/old-k8s-version-783465 ...
I0816 18:04:26.447955 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19461-9545/.minikube/machines/old-k8s-version-783465
I0816 18:04:26.448003 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19461-9545/.minikube/machines
I0816 18:04:26.448046 67727 main.go:141] libmachine: (old-k8s-version-783465) Setting executable bit set on /home/jenkins/minikube-integration/19461-9545/.minikube/machines/old-k8s-version-783465 (perms=drwx------)
I0816 18:04:26.448060 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19461-9545/.minikube
I0816 18:04:26.448078 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19461-9545
I0816 18:04:26.448092 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0816 18:04:26.448108 67727 main.go:141] libmachine: (old-k8s-version-783465) Setting executable bit set on /home/jenkins/minikube-integration/19461-9545/.minikube/machines (perms=drwxr-xr-x)
I0816 18:04:26.448128 67727 main.go:141] libmachine: (old-k8s-version-783465) Setting executable bit set on /home/jenkins/minikube-integration/19461-9545/.minikube (perms=drwxr-xr-x)
I0816 18:04:26.448142 67727 main.go:141] libmachine: (old-k8s-version-783465) Setting executable bit set on /home/jenkins/minikube-integration/19461-9545 (perms=drwxrwxr-x)
I0816 18:04:26.448157 67727 main.go:141] libmachine: (old-k8s-version-783465) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0816 18:04:26.448169 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | Checking permissions on dir: /home/jenkins
I0816 18:04:26.448180 67727 main.go:141] libmachine: (old-k8s-version-783465) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0816 18:04:26.448195 67727 main.go:141] libmachine: (old-k8s-version-783465) Creating domain...
I0816 18:04:26.448207 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | Checking permissions on dir: /home
I0816 18:04:26.448223 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | Skipping /home - not owner
I0816 18:04:26.449276 67727 main.go:141] libmachine: (old-k8s-version-783465) define libvirt domain using xml:
I0816 18:04:26.449308 67727 main.go:141] libmachine: (old-k8s-version-783465) <domain type='kvm'>
I0816 18:04:26.449319 67727 main.go:141] libmachine: (old-k8s-version-783465) <name>old-k8s-version-783465</name>
I0816 18:04:26.449328 67727 main.go:141] libmachine: (old-k8s-version-783465) <memory unit='MiB'>2200</memory>
I0816 18:04:26.449336 67727 main.go:141] libmachine: (old-k8s-version-783465) <vcpu>2</vcpu>
I0816 18:04:26.449358 67727 main.go:141] libmachine: (old-k8s-version-783465) <features>
I0816 18:04:26.449372 67727 main.go:141] libmachine: (old-k8s-version-783465) <acpi/>
I0816 18:04:26.449379 67727 main.go:141] libmachine: (old-k8s-version-783465) <apic/>
I0816 18:04:26.449390 67727 main.go:141] libmachine: (old-k8s-version-783465) <pae/>
I0816 18:04:26.449405 67727 main.go:141] libmachine: (old-k8s-version-783465)
I0816 18:04:26.449416 67727 main.go:141] libmachine: (old-k8s-version-783465) </features>
I0816 18:04:26.449422 67727 main.go:141] libmachine: (old-k8s-version-783465) <cpu mode='host-passthrough'>
I0816 18:04:26.449430 67727 main.go:141] libmachine: (old-k8s-version-783465)
I0816 18:04:26.449435 67727 main.go:141] libmachine: (old-k8s-version-783465) </cpu>
I0816 18:04:26.449443 67727 main.go:141] libmachine: (old-k8s-version-783465) <os>
I0816 18:04:26.449449 67727 main.go:141] libmachine: (old-k8s-version-783465) <type>hvm</type>
I0816 18:04:26.449455 67727 main.go:141] libmachine: (old-k8s-version-783465) <boot dev='cdrom'/>
I0816 18:04:26.449460 67727 main.go:141] libmachine: (old-k8s-version-783465) <boot dev='hd'/>
I0816 18:04:26.449466 67727 main.go:141] libmachine: (old-k8s-version-783465) <bootmenu enable='no'/>
I0816 18:04:26.449476 67727 main.go:141] libmachine: (old-k8s-version-783465) </os>
I0816 18:04:26.449504 67727 main.go:141] libmachine: (old-k8s-version-783465) <devices>
I0816 18:04:26.449530 67727 main.go:141] libmachine: (old-k8s-version-783465) <disk type='file' device='cdrom'>
I0816 18:04:26.449555 67727 main.go:141] libmachine: (old-k8s-version-783465) <source file='/home/jenkins/minikube-integration/19461-9545/.minikube/machines/old-k8s-version-783465/boot2docker.iso'/>
I0816 18:04:26.449567 67727 main.go:141] libmachine: (old-k8s-version-783465) <target dev='hdc' bus='scsi'/>
I0816 18:04:26.449578 67727 main.go:141] libmachine: (old-k8s-version-783465) <readonly/>
I0816 18:04:26.449589 67727 main.go:141] libmachine: (old-k8s-version-783465) </disk>
I0816 18:04:26.449599 67727 main.go:141] libmachine: (old-k8s-version-783465) <disk type='file' device='disk'>
I0816 18:04:26.449612 67727 main.go:141] libmachine: (old-k8s-version-783465) <driver name='qemu' type='raw' cache='default' io='threads' />
I0816 18:04:26.449626 67727 main.go:141] libmachine: (old-k8s-version-783465) <source file='/home/jenkins/minikube-integration/19461-9545/.minikube/machines/old-k8s-version-783465/old-k8s-version-783465.rawdisk'/>
I0816 18:04:26.449638 67727 main.go:141] libmachine: (old-k8s-version-783465) <target dev='hda' bus='virtio'/>
I0816 18:04:26.449648 67727 main.go:141] libmachine: (old-k8s-version-783465) </disk>
I0816 18:04:26.449660 67727 main.go:141] libmachine: (old-k8s-version-783465) <interface type='network'>
I0816 18:04:26.449671 67727 main.go:141] libmachine: (old-k8s-version-783465) <source network='mk-old-k8s-version-783465'/>
I0816 18:04:26.449682 67727 main.go:141] libmachine: (old-k8s-version-783465) <model type='virtio'/>
I0816 18:04:26.449690 67727 main.go:141] libmachine: (old-k8s-version-783465) </interface>
I0816 18:04:26.449711 67727 main.go:141] libmachine: (old-k8s-version-783465) <interface type='network'>
I0816 18:04:26.449721 67727 main.go:141] libmachine: (old-k8s-version-783465) <source network='default'/>
I0816 18:04:26.449734 67727 main.go:141] libmachine: (old-k8s-version-783465) <model type='virtio'/>
I0816 18:04:26.449748 67727 main.go:141] libmachine: (old-k8s-version-783465) </interface>
I0816 18:04:26.449760 67727 main.go:141] libmachine: (old-k8s-version-783465) <serial type='pty'>
I0816 18:04:26.449771 67727 main.go:141] libmachine: (old-k8s-version-783465) <target port='0'/>
I0816 18:04:26.449780 67727 main.go:141] libmachine: (old-k8s-version-783465) </serial>
I0816 18:04:26.449790 67727 main.go:141] libmachine: (old-k8s-version-783465) <console type='pty'>
I0816 18:04:26.449802 67727 main.go:141] libmachine: (old-k8s-version-783465) <target type='serial' port='0'/>
I0816 18:04:26.449812 67727 main.go:141] libmachine: (old-k8s-version-783465) </console>
I0816 18:04:26.449821 67727 main.go:141] libmachine: (old-k8s-version-783465) <rng model='virtio'>
I0816 18:04:26.449831 67727 main.go:141] libmachine: (old-k8s-version-783465) <backend model='random'>/dev/random</backend>
I0816 18:04:26.449837 67727 main.go:141] libmachine: (old-k8s-version-783465) </rng>
I0816 18:04:26.449842 67727 main.go:141] libmachine: (old-k8s-version-783465)
I0816 18:04:26.449848 67727 main.go:141] libmachine: (old-k8s-version-783465)
I0816 18:04:26.449856 67727 main.go:141] libmachine: (old-k8s-version-783465) </devices>
I0816 18:04:26.449861 67727 main.go:141] libmachine: (old-k8s-version-783465) </domain>
I0816 18:04:26.449868 67727 main.go:141] libmachine: (old-k8s-version-783465)
I0816 18:04:26.453926 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has defined MAC address 52:54:00:db:c2:d9 in network default
I0816 18:04:26.454500 67727 main.go:141] libmachine: (old-k8s-version-783465) Ensuring networks are active...
I0816 18:04:26.454525 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has defined MAC address 52:54:00:d1:97:35 in network mk-old-k8s-version-783465
I0816 18:04:26.455222 67727 main.go:141] libmachine: (old-k8s-version-783465) Ensuring network default is active
I0816 18:04:26.455565 67727 main.go:141] libmachine: (old-k8s-version-783465) Ensuring network mk-old-k8s-version-783465 is active
I0816 18:04:26.456069 67727 main.go:141] libmachine: (old-k8s-version-783465) Getting domain xml...
I0816 18:04:26.456932 67727 main.go:141] libmachine: (old-k8s-version-783465) Creating domain...
I0816 18:04:27.815273 67727 main.go:141] libmachine: (old-k8s-version-783465) Waiting to get IP...
I0816 18:04:27.816028 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has defined MAC address 52:54:00:d1:97:35 in network mk-old-k8s-version-783465
I0816 18:04:27.816566 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | unable to find current IP address of domain old-k8s-version-783465 in network mk-old-k8s-version-783465
I0816 18:04:27.816585 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | I0816 18:04:27.816554 67950 retry.go:31] will retry after 303.320971ms: waiting for machine to come up
I0816 18:04:28.121144 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has defined MAC address 52:54:00:d1:97:35 in network mk-old-k8s-version-783465
I0816 18:04:28.121689 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | unable to find current IP address of domain old-k8s-version-783465 in network mk-old-k8s-version-783465
I0816 18:04:28.121712 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | I0816 18:04:28.121645 67950 retry.go:31] will retry after 317.884539ms: waiting for machine to come up
I0816 18:04:28.444242 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has defined MAC address 52:54:00:d1:97:35 in network mk-old-k8s-version-783465
I0816 18:04:28.445078 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | unable to find current IP address of domain old-k8s-version-783465 in network mk-old-k8s-version-783465
I0816 18:04:28.445102 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | I0816 18:04:28.444986 67950 retry.go:31] will retry after 477.094134ms: waiting for machine to come up
I0816 18:04:28.923768 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has defined MAC address 52:54:00:d1:97:35 in network mk-old-k8s-version-783465
I0816 18:04:28.924334 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | unable to find current IP address of domain old-k8s-version-783465 in network mk-old-k8s-version-783465
I0816 18:04:28.924358 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | I0816 18:04:28.924257 67950 retry.go:31] will retry after 556.20592ms: waiting for machine to come up
I0816 18:04:29.481818 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has defined MAC address 52:54:00:d1:97:35 in network mk-old-k8s-version-783465
I0816 18:04:29.482372 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | unable to find current IP address of domain old-k8s-version-783465 in network mk-old-k8s-version-783465
I0816 18:04:29.482426 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | I0816 18:04:29.482358 67950 retry.go:31] will retry after 758.448212ms: waiting for machine to come up
I0816 18:04:30.242812 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has defined MAC address 52:54:00:d1:97:35 in network mk-old-k8s-version-783465
I0816 18:04:30.243520 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | unable to find current IP address of domain old-k8s-version-783465 in network mk-old-k8s-version-783465
I0816 18:04:30.243546 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | I0816 18:04:30.243468 67950 retry.go:31] will retry after 680.477807ms: waiting for machine to come up
I0816 18:04:30.925362 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has defined MAC address 52:54:00:d1:97:35 in network mk-old-k8s-version-783465
I0816 18:04:30.925969 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | unable to find current IP address of domain old-k8s-version-783465 in network mk-old-k8s-version-783465
I0816 18:04:30.925998 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | I0816 18:04:30.925886 67950 retry.go:31] will retry after 970.693624ms: waiting for machine to come up
I0816 18:04:31.898276 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has defined MAC address 52:54:00:d1:97:35 in network mk-old-k8s-version-783465
I0816 18:04:31.898747 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | unable to find current IP address of domain old-k8s-version-783465 in network mk-old-k8s-version-783465
I0816 18:04:31.898776 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | I0816 18:04:31.898703 67950 retry.go:31] will retry after 1.122432816s: waiting for machine to come up
I0816 18:04:33.022738 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has defined MAC address 52:54:00:d1:97:35 in network mk-old-k8s-version-783465
I0816 18:04:33.023244 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | unable to find current IP address of domain old-k8s-version-783465 in network mk-old-k8s-version-783465
I0816 18:04:33.023293 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | I0816 18:04:33.023203 67950 retry.go:31] will retry after 1.500265931s: waiting for machine to come up
I0816 18:04:34.525627 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has defined MAC address 52:54:00:d1:97:35 in network mk-old-k8s-version-783465
I0816 18:04:34.526242 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | unable to find current IP address of domain old-k8s-version-783465 in network mk-old-k8s-version-783465
I0816 18:04:34.526273 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | I0816 18:04:34.526182 67950 retry.go:31] will retry after 1.425680484s: waiting for machine to come up
I0816 18:04:35.953979 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has defined MAC address 52:54:00:d1:97:35 in network mk-old-k8s-version-783465
I0816 18:04:35.954665 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | unable to find current IP address of domain old-k8s-version-783465 in network mk-old-k8s-version-783465
I0816 18:04:35.954710 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | I0816 18:04:35.954587 67950 retry.go:31] will retry after 2.432510938s: waiting for machine to come up
I0816 18:04:38.391052 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has defined MAC address 52:54:00:d1:97:35 in network mk-old-k8s-version-783465
I0816 18:04:38.391616 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | unable to find current IP address of domain old-k8s-version-783465 in network mk-old-k8s-version-783465
I0816 18:04:38.391703 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | I0816 18:04:38.391658 67950 retry.go:31] will retry after 2.2296108s: waiting for machine to come up
I0816 18:04:40.623114 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has defined MAC address 52:54:00:d1:97:35 in network mk-old-k8s-version-783465
I0816 18:04:40.623998 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | unable to find current IP address of domain old-k8s-version-783465 in network mk-old-k8s-version-783465
I0816 18:04:40.624023 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | I0816 18:04:40.623916 67950 retry.go:31] will retry after 4.077958106s: waiting for machine to come up
I0816 18:04:44.705791 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has defined MAC address 52:54:00:d1:97:35 in network mk-old-k8s-version-783465
I0816 18:04:44.765485 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | unable to find current IP address of domain old-k8s-version-783465 in network mk-old-k8s-version-783465
I0816 18:04:44.765515 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | I0816 18:04:44.765416 67950 retry.go:31] will retry after 4.926584617s: waiting for machine to come up
I0816 18:04:49.693644 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has defined MAC address 52:54:00:d1:97:35 in network mk-old-k8s-version-783465
I0816 18:04:49.694227 67727 main.go:141] libmachine: (old-k8s-version-783465) Found IP for machine: 192.168.39.211
I0816 18:04:49.694259 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has current primary IP address 192.168.39.211 and MAC address 52:54:00:d1:97:35 in network mk-old-k8s-version-783465
I0816 18:04:49.694269 67727 main.go:141] libmachine: (old-k8s-version-783465) Reserving static IP address...
I0816 18:04:49.694604 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-783465", mac: "52:54:00:d1:97:35", ip: "192.168.39.211"} in network mk-old-k8s-version-783465
I0816 18:04:49.768046 67727 main.go:141] libmachine: (old-k8s-version-783465) Reserved static IP address: 192.168.39.211
I0816 18:04:49.768072 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | Getting to WaitForSSH function...
I0816 18:04:49.768081 67727 main.go:141] libmachine: (old-k8s-version-783465) Waiting for SSH to be available...
I0816 18:04:49.770801 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has defined MAC address 52:54:00:d1:97:35 in network mk-old-k8s-version-783465
I0816 18:04:49.771230 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d1:97:35", ip: ""} in network mk-old-k8s-version-783465: {Iface:virbr1 ExpiryTime:2024-08-16 19:04:41 +0000 UTC Type:0 Mac:52:54:00:d1:97:35 Iaid: IPaddr:192.168.39.211 Prefix:24 Hostname:minikube Clientid:01:52:54:00:d1:97:35}
I0816 18:04:49.771260 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has defined IP address 192.168.39.211 and MAC address 52:54:00:d1:97:35 in network mk-old-k8s-version-783465
I0816 18:04:49.771417 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | Using SSH client type: external
I0816 18:04:49.771443 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | Using SSH private key: /home/jenkins/minikube-integration/19461-9545/.minikube/machines/old-k8s-version-783465/id_rsa (-rw-------)
I0816 18:04:49.771470 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.211 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19461-9545/.minikube/machines/old-k8s-version-783465/id_rsa -p 22] /usr/bin/ssh <nil>}
I0816 18:04:49.771485 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | About to run SSH command:
I0816 18:04:49.771501 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | exit 0
I0816 18:04:49.896854 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | SSH cmd err, output: <nil>:
I0816 18:04:49.897097 67727 main.go:141] libmachine: (old-k8s-version-783465) KVM machine creation complete!
I0816 18:04:49.897434 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetConfigRaw
I0816 18:04:49.897906 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .DriverName
I0816 18:04:49.898103 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .DriverName
I0816 18:04:49.898259 67727 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0816 18:04:49.898275 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetState
I0816 18:04:49.899551 67727 main.go:141] libmachine: Detecting operating system of created instance...
I0816 18:04:49.899576 67727 main.go:141] libmachine: Waiting for SSH to be available...
I0816 18:04:49.899590 67727 main.go:141] libmachine: Getting to WaitForSSH function...
I0816 18:04:49.899604 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetSSHHostname
I0816 18:04:49.901549 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has defined MAC address 52:54:00:d1:97:35 in network mk-old-k8s-version-783465
I0816 18:04:49.901960 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d1:97:35", ip: ""} in network mk-old-k8s-version-783465: {Iface:virbr1 ExpiryTime:2024-08-16 19:04:41 +0000 UTC Type:0 Mac:52:54:00:d1:97:35 Iaid: IPaddr:192.168.39.211 Prefix:24 Hostname:old-k8s-version-783465 Clientid:01:52:54:00:d1:97:35}
I0816 18:04:49.901991 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has defined IP address 192.168.39.211 and MAC address 52:54:00:d1:97:35 in network mk-old-k8s-version-783465
I0816 18:04:49.902093 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetSSHPort
I0816 18:04:49.902264 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetSSHKeyPath
I0816 18:04:49.902418 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetSSHKeyPath
I0816 18:04:49.902528 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetSSHUsername
I0816 18:04:49.902714 67727 main.go:141] libmachine: Using SSH client type: native
I0816 18:04:49.902914 67727 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.39.211 22 <nil> <nil>}
I0816 18:04:49.902926 67727 main.go:141] libmachine: About to run SSH command:
exit 0
I0816 18:04:50.007823 67727 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0816 18:04:50.007852 67727 main.go:141] libmachine: Detecting the provisioner...
I0816 18:04:50.007860 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetSSHHostname
I0816 18:04:50.010880 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has defined MAC address 52:54:00:d1:97:35 in network mk-old-k8s-version-783465
I0816 18:04:50.011254 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d1:97:35", ip: ""} in network mk-old-k8s-version-783465: {Iface:virbr1 ExpiryTime:2024-08-16 19:04:41 +0000 UTC Type:0 Mac:52:54:00:d1:97:35 Iaid: IPaddr:192.168.39.211 Prefix:24 Hostname:old-k8s-version-783465 Clientid:01:52:54:00:d1:97:35}
I0816 18:04:50.011292 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has defined IP address 192.168.39.211 and MAC address 52:54:00:d1:97:35 in network mk-old-k8s-version-783465
I0816 18:04:50.011480 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetSSHPort
I0816 18:04:50.011670 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetSSHKeyPath
I0816 18:04:50.011851 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetSSHKeyPath
I0816 18:04:50.011979 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetSSHUsername
I0816 18:04:50.012153 67727 main.go:141] libmachine: Using SSH client type: native
I0816 18:04:50.012360 67727 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.39.211 22 <nil> <nil>}
I0816 18:04:50.012373 67727 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0816 18:04:50.116832 67727 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0816 18:04:50.116942 67727 main.go:141] libmachine: found compatible host: buildroot
I0816 18:04:50.116953 67727 main.go:141] libmachine: Provisioning with buildroot...
I0816 18:04:50.116959 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetMachineName
I0816 18:04:50.117209 67727 buildroot.go:166] provisioning hostname "old-k8s-version-783465"
I0816 18:04:50.117238 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetMachineName
I0816 18:04:50.117420 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetSSHHostname
I0816 18:04:50.119828 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has defined MAC address 52:54:00:d1:97:35 in network mk-old-k8s-version-783465
I0816 18:04:50.120229 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d1:97:35", ip: ""} in network mk-old-k8s-version-783465: {Iface:virbr1 ExpiryTime:2024-08-16 19:04:41 +0000 UTC Type:0 Mac:52:54:00:d1:97:35 Iaid: IPaddr:192.168.39.211 Prefix:24 Hostname:old-k8s-version-783465 Clientid:01:52:54:00:d1:97:35}
I0816 18:04:50.120253 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has defined IP address 192.168.39.211 and MAC address 52:54:00:d1:97:35 in network mk-old-k8s-version-783465
I0816 18:04:50.120413 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetSSHPort
I0816 18:04:50.120601 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetSSHKeyPath
I0816 18:04:50.120754 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetSSHKeyPath
I0816 18:04:50.120889 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetSSHUsername
I0816 18:04:50.121014 67727 main.go:141] libmachine: Using SSH client type: native
I0816 18:04:50.121236 67727 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.39.211 22 <nil> <nil>}
I0816 18:04:50.121254 67727 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-783465 && echo "old-k8s-version-783465" | sudo tee /etc/hostname
I0816 18:04:50.237998 67727 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-783465
I0816 18:04:50.238027 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetSSHHostname
I0816 18:04:50.240850 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has defined MAC address 52:54:00:d1:97:35 in network mk-old-k8s-version-783465
I0816 18:04:50.241192 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d1:97:35", ip: ""} in network mk-old-k8s-version-783465: {Iface:virbr1 ExpiryTime:2024-08-16 19:04:41 +0000 UTC Type:0 Mac:52:54:00:d1:97:35 Iaid: IPaddr:192.168.39.211 Prefix:24 Hostname:old-k8s-version-783465 Clientid:01:52:54:00:d1:97:35}
I0816 18:04:50.241214 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has defined IP address 192.168.39.211 and MAC address 52:54:00:d1:97:35 in network mk-old-k8s-version-783465
I0816 18:04:50.241425 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetSSHPort
I0816 18:04:50.241598 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetSSHKeyPath
I0816 18:04:50.241770 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetSSHKeyPath
I0816 18:04:50.241871 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetSSHUsername
I0816 18:04:50.242013 67727 main.go:141] libmachine: Using SSH client type: native
I0816 18:04:50.242193 67727 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.39.211 22 <nil> <nil>}
I0816 18:04:50.242209 67727 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-783465' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-783465/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-783465' | sudo tee -a /etc/hosts;
fi
fi
I0816 18:04:50.356202 67727 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0816 18:04:50.356239 67727 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19461-9545/.minikube CaCertPath:/home/jenkins/minikube-integration/19461-9545/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19461-9545/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19461-9545/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19461-9545/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19461-9545/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19461-9545/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19461-9545/.minikube}
I0816 18:04:50.356291 67727 buildroot.go:174] setting up certificates
I0816 18:04:50.356308 67727 provision.go:84] configureAuth start
I0816 18:04:50.356324 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetMachineName
I0816 18:04:50.356663 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetIP
I0816 18:04:50.359528 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has defined MAC address 52:54:00:d1:97:35 in network mk-old-k8s-version-783465
I0816 18:04:50.359875 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d1:97:35", ip: ""} in network mk-old-k8s-version-783465: {Iface:virbr1 ExpiryTime:2024-08-16 19:04:41 +0000 UTC Type:0 Mac:52:54:00:d1:97:35 Iaid: IPaddr:192.168.39.211 Prefix:24 Hostname:old-k8s-version-783465 Clientid:01:52:54:00:d1:97:35}
I0816 18:04:50.359896 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has defined IP address 192.168.39.211 and MAC address 52:54:00:d1:97:35 in network mk-old-k8s-version-783465
I0816 18:04:50.360096 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetSSHHostname
I0816 18:04:50.362506 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has defined MAC address 52:54:00:d1:97:35 in network mk-old-k8s-version-783465
I0816 18:04:50.362829 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d1:97:35", ip: ""} in network mk-old-k8s-version-783465: {Iface:virbr1 ExpiryTime:2024-08-16 19:04:41 +0000 UTC Type:0 Mac:52:54:00:d1:97:35 Iaid: IPaddr:192.168.39.211 Prefix:24 Hostname:old-k8s-version-783465 Clientid:01:52:54:00:d1:97:35}
I0816 18:04:50.362858 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has defined IP address 192.168.39.211 and MAC address 52:54:00:d1:97:35 in network mk-old-k8s-version-783465
I0816 18:04:50.362972 67727 provision.go:143] copyHostCerts
I0816 18:04:50.363032 67727 exec_runner.go:144] found /home/jenkins/minikube-integration/19461-9545/.minikube/ca.pem, removing ...
I0816 18:04:50.363049 67727 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19461-9545/.minikube/ca.pem
I0816 18:04:50.363105 67727 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19461-9545/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19461-9545/.minikube/ca.pem (1082 bytes)
I0816 18:04:50.363219 67727 exec_runner.go:144] found /home/jenkins/minikube-integration/19461-9545/.minikube/cert.pem, removing ...
I0816 18:04:50.363233 67727 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19461-9545/.minikube/cert.pem
I0816 18:04:50.363256 67727 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19461-9545/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19461-9545/.minikube/cert.pem (1123 bytes)
I0816 18:04:50.363318 67727 exec_runner.go:144] found /home/jenkins/minikube-integration/19461-9545/.minikube/key.pem, removing ...
I0816 18:04:50.363332 67727 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19461-9545/.minikube/key.pem
I0816 18:04:50.363351 67727 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19461-9545/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19461-9545/.minikube/key.pem (1679 bytes)
I0816 18:04:50.363410 67727 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19461-9545/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19461-9545/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19461-9545/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-783465 san=[127.0.0.1 192.168.39.211 localhost minikube old-k8s-version-783465]
I0816 18:04:50.623009 67727 provision.go:177] copyRemoteCerts
I0816 18:04:50.623083 67727 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0816 18:04:50.623111 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetSSHHostname
I0816 18:04:50.626300 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has defined MAC address 52:54:00:d1:97:35 in network mk-old-k8s-version-783465
I0816 18:04:50.626757 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d1:97:35", ip: ""} in network mk-old-k8s-version-783465: {Iface:virbr1 ExpiryTime:2024-08-16 19:04:41 +0000 UTC Type:0 Mac:52:54:00:d1:97:35 Iaid: IPaddr:192.168.39.211 Prefix:24 Hostname:old-k8s-version-783465 Clientid:01:52:54:00:d1:97:35}
I0816 18:04:50.626789 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has defined IP address 192.168.39.211 and MAC address 52:54:00:d1:97:35 in network mk-old-k8s-version-783465
I0816 18:04:50.626993 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetSSHPort
I0816 18:04:50.627217 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetSSHKeyPath
I0816 18:04:50.627401 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetSSHUsername
I0816 18:04:50.627572 67727 sshutil.go:53] new ssh client: &{IP:192.168.39.211 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19461-9545/.minikube/machines/old-k8s-version-783465/id_rsa Username:docker}
I0816 18:04:50.721477 67727 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19461-9545/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0816 18:04:50.749809 67727 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19461-9545/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0816 18:04:50.778213 67727 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19461-9545/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0816 18:04:50.808443 67727 provision.go:87] duration metric: took 452.116204ms to configureAuth
I0816 18:04:50.808481 67727 buildroot.go:189] setting minikube options for container-runtime
I0816 18:04:50.808704 67727 config.go:182] Loaded profile config "old-k8s-version-783465": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0816 18:04:50.808835 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetSSHHostname
I0816 18:04:50.811953 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has defined MAC address 52:54:00:d1:97:35 in network mk-old-k8s-version-783465
I0816 18:04:50.812374 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d1:97:35", ip: ""} in network mk-old-k8s-version-783465: {Iface:virbr1 ExpiryTime:2024-08-16 19:04:41 +0000 UTC Type:0 Mac:52:54:00:d1:97:35 Iaid: IPaddr:192.168.39.211 Prefix:24 Hostname:old-k8s-version-783465 Clientid:01:52:54:00:d1:97:35}
I0816 18:04:50.812406 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has defined IP address 192.168.39.211 and MAC address 52:54:00:d1:97:35 in network mk-old-k8s-version-783465
I0816 18:04:50.812678 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetSSHPort
I0816 18:04:50.812858 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetSSHKeyPath
I0816 18:04:50.812989 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetSSHKeyPath
I0816 18:04:50.813248 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetSSHUsername
I0816 18:04:50.813439 67727 main.go:141] libmachine: Using SSH client type: native
I0816 18:04:50.813651 67727 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.39.211 22 <nil> <nil>}
I0816 18:04:50.813674 67727 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0816 18:04:51.126819 67727 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0816 18:04:51.126853 67727 main.go:141] libmachine: Checking connection to Docker...
I0816 18:04:51.126873 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetURL
I0816 18:04:51.128426 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | Using libvirt version 6000000
I0816 18:04:51.131281 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has defined MAC address 52:54:00:d1:97:35 in network mk-old-k8s-version-783465
I0816 18:04:51.131723 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d1:97:35", ip: ""} in network mk-old-k8s-version-783465: {Iface:virbr1 ExpiryTime:2024-08-16 19:04:41 +0000 UTC Type:0 Mac:52:54:00:d1:97:35 Iaid: IPaddr:192.168.39.211 Prefix:24 Hostname:old-k8s-version-783465 Clientid:01:52:54:00:d1:97:35}
I0816 18:04:51.131751 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has defined IP address 192.168.39.211 and MAC address 52:54:00:d1:97:35 in network mk-old-k8s-version-783465
I0816 18:04:51.132017 67727 main.go:141] libmachine: Docker is up and running!
I0816 18:04:51.132034 67727 main.go:141] libmachine: Reticulating splines...
I0816 18:04:51.132042 67727 client.go:171] duration metric: took 25.110087628s to LocalClient.Create
I0816 18:04:51.132075 67727 start.go:167] duration metric: took 25.110153449s to libmachine.API.Create "old-k8s-version-783465"
I0816 18:04:51.132091 67727 start.go:293] postStartSetup for "old-k8s-version-783465" (driver="kvm2")
I0816 18:04:51.132107 67727 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0816 18:04:51.132131 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .DriverName
I0816 18:04:51.132398 67727 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0816 18:04:51.132428 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetSSHHostname
I0816 18:04:51.134859 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has defined MAC address 52:54:00:d1:97:35 in network mk-old-k8s-version-783465
I0816 18:04:51.135209 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d1:97:35", ip: ""} in network mk-old-k8s-version-783465: {Iface:virbr1 ExpiryTime:2024-08-16 19:04:41 +0000 UTC Type:0 Mac:52:54:00:d1:97:35 Iaid: IPaddr:192.168.39.211 Prefix:24 Hostname:old-k8s-version-783465 Clientid:01:52:54:00:d1:97:35}
I0816 18:04:51.135256 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has defined IP address 192.168.39.211 and MAC address 52:54:00:d1:97:35 in network mk-old-k8s-version-783465
I0816 18:04:51.135423 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetSSHPort
I0816 18:04:51.135628 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetSSHKeyPath
I0816 18:04:51.135813 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetSSHUsername
I0816 18:04:51.135961 67727 sshutil.go:53] new ssh client: &{IP:192.168.39.211 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19461-9545/.minikube/machines/old-k8s-version-783465/id_rsa Username:docker}
I0816 18:04:51.222652 67727 ssh_runner.go:195] Run: cat /etc/os-release
I0816 18:04:51.226879 67727 info.go:137] Remote host: Buildroot 2023.02.9
I0816 18:04:51.226905 67727 filesync.go:126] Scanning /home/jenkins/minikube-integration/19461-9545/.minikube/addons for local assets ...
I0816 18:04:51.226965 67727 filesync.go:126] Scanning /home/jenkins/minikube-integration/19461-9545/.minikube/files for local assets ...
I0816 18:04:51.227092 67727 filesync.go:149] local asset: /home/jenkins/minikube-integration/19461-9545/.minikube/files/etc/ssl/certs/167532.pem -> 167532.pem in /etc/ssl/certs
I0816 18:04:51.227217 67727 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0816 18:04:51.235975 67727 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19461-9545/.minikube/files/etc/ssl/certs/167532.pem --> /etc/ssl/certs/167532.pem (1708 bytes)
I0816 18:04:51.258385 67727 start.go:296] duration metric: took 126.275787ms for postStartSetup
I0816 18:04:51.258456 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetConfigRaw
I0816 18:04:51.259041 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetIP
I0816 18:04:51.261618 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has defined MAC address 52:54:00:d1:97:35 in network mk-old-k8s-version-783465
I0816 18:04:51.261983 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d1:97:35", ip: ""} in network mk-old-k8s-version-783465: {Iface:virbr1 ExpiryTime:2024-08-16 19:04:41 +0000 UTC Type:0 Mac:52:54:00:d1:97:35 Iaid: IPaddr:192.168.39.211 Prefix:24 Hostname:old-k8s-version-783465 Clientid:01:52:54:00:d1:97:35}
I0816 18:04:51.262005 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has defined IP address 192.168.39.211 and MAC address 52:54:00:d1:97:35 in network mk-old-k8s-version-783465
I0816 18:04:51.262230 67727 profile.go:143] Saving config to /home/jenkins/minikube-integration/19461-9545/.minikube/profiles/old-k8s-version-783465/config.json ...
I0816 18:04:51.262419 67727 start.go:128] duration metric: took 25.26093016s to createHost
I0816 18:04:51.262446 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetSSHHostname
I0816 18:04:51.264767 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has defined MAC address 52:54:00:d1:97:35 in network mk-old-k8s-version-783465
I0816 18:04:51.265119 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d1:97:35", ip: ""} in network mk-old-k8s-version-783465: {Iface:virbr1 ExpiryTime:2024-08-16 19:04:41 +0000 UTC Type:0 Mac:52:54:00:d1:97:35 Iaid: IPaddr:192.168.39.211 Prefix:24 Hostname:old-k8s-version-783465 Clientid:01:52:54:00:d1:97:35}
I0816 18:04:51.265147 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has defined IP address 192.168.39.211 and MAC address 52:54:00:d1:97:35 in network mk-old-k8s-version-783465
I0816 18:04:51.265261 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetSSHPort
I0816 18:04:51.265430 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetSSHKeyPath
I0816 18:04:51.265582 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetSSHKeyPath
I0816 18:04:51.265721 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetSSHUsername
I0816 18:04:51.265869 67727 main.go:141] libmachine: Using SSH client type: native
I0816 18:04:51.266038 67727 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.39.211 22 <nil> <nil>}
I0816 18:04:51.266052 67727 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0816 18:04:51.373012 67727 main.go:141] libmachine: SSH cmd err, output: <nil>: 1723831491.329706508
I0816 18:04:51.373045 67727 fix.go:216] guest clock: 1723831491.329706508
I0816 18:04:51.373057 67727 fix.go:229] Guest: 2024-08-16 18:04:51.329706508 +0000 UTC Remote: 2024-08-16 18:04:51.262434378 +0000 UTC m=+40.928270001 (delta=67.27213ms)
I0816 18:04:51.373099 67727 fix.go:200] guest clock delta is within tolerance: 67.27213ms
I0816 18:04:51.373122 67727 start.go:83] releasing machines lock for "old-k8s-version-783465", held for 25.371826821s
I0816 18:04:51.373162 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .DriverName
I0816 18:04:51.373453 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetIP
I0816 18:04:51.376265 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has defined MAC address 52:54:00:d1:97:35 in network mk-old-k8s-version-783465
I0816 18:04:51.376699 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d1:97:35", ip: ""} in network mk-old-k8s-version-783465: {Iface:virbr1 ExpiryTime:2024-08-16 19:04:41 +0000 UTC Type:0 Mac:52:54:00:d1:97:35 Iaid: IPaddr:192.168.39.211 Prefix:24 Hostname:old-k8s-version-783465 Clientid:01:52:54:00:d1:97:35}
I0816 18:04:51.376726 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has defined IP address 192.168.39.211 and MAC address 52:54:00:d1:97:35 in network mk-old-k8s-version-783465
I0816 18:04:51.376835 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .DriverName
I0816 18:04:51.377395 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .DriverName
I0816 18:04:51.377599 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .DriverName
I0816 18:04:51.377685 67727 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0816 18:04:51.377739 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetSSHHostname
I0816 18:04:51.377795 67727 ssh_runner.go:195] Run: cat /version.json
I0816 18:04:51.377817 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetSSHHostname
I0816 18:04:51.380524 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has defined MAC address 52:54:00:d1:97:35 in network mk-old-k8s-version-783465
I0816 18:04:51.380825 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d1:97:35", ip: ""} in network mk-old-k8s-version-783465: {Iface:virbr1 ExpiryTime:2024-08-16 19:04:41 +0000 UTC Type:0 Mac:52:54:00:d1:97:35 Iaid: IPaddr:192.168.39.211 Prefix:24 Hostname:old-k8s-version-783465 Clientid:01:52:54:00:d1:97:35}
I0816 18:04:51.380859 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has defined IP address 192.168.39.211 and MAC address 52:54:00:d1:97:35 in network mk-old-k8s-version-783465
I0816 18:04:51.380881 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has defined MAC address 52:54:00:d1:97:35 in network mk-old-k8s-version-783465
I0816 18:04:51.381062 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetSSHPort
I0816 18:04:51.381224 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetSSHKeyPath
I0816 18:04:51.381327 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d1:97:35", ip: ""} in network mk-old-k8s-version-783465: {Iface:virbr1 ExpiryTime:2024-08-16 19:04:41 +0000 UTC Type:0 Mac:52:54:00:d1:97:35 Iaid: IPaddr:192.168.39.211 Prefix:24 Hostname:old-k8s-version-783465 Clientid:01:52:54:00:d1:97:35}
I0816 18:04:51.381355 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetSSHUsername
I0816 18:04:51.381392 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has defined IP address 192.168.39.211 and MAC address 52:54:00:d1:97:35 in network mk-old-k8s-version-783465
I0816 18:04:51.381525 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetSSHPort
I0816 18:04:51.381696 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetSSHKeyPath
I0816 18:04:51.381714 67727 sshutil.go:53] new ssh client: &{IP:192.168.39.211 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19461-9545/.minikube/machines/old-k8s-version-783465/id_rsa Username:docker}
I0816 18:04:51.381845 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetSSHUsername
I0816 18:04:51.381975 67727 sshutil.go:53] new ssh client: &{IP:192.168.39.211 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19461-9545/.minikube/machines/old-k8s-version-783465/id_rsa Username:docker}
I0816 18:04:51.465403 67727 ssh_runner.go:195] Run: systemctl --version
I0816 18:04:51.504348 67727 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0816 18:04:51.666270 67727 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0816 18:04:51.672101 67727 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0816 18:04:51.672188 67727 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0816 18:04:51.688077 67727 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0816 18:04:51.688105 67727 start.go:495] detecting cgroup driver to use...
I0816 18:04:51.688190 67727 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0816 18:04:51.704503 67727 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0816 18:04:51.718396 67727 docker.go:217] disabling cri-docker service (if available) ...
I0816 18:04:51.718474 67727 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0816 18:04:51.733326 67727 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0816 18:04:51.748640 67727 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0816 18:04:51.872208 67727 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0816 18:04:52.014235 67727 docker.go:233] disabling docker service ...
I0816 18:04:52.014307 67727 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0816 18:04:52.028357 67727 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0816 18:04:52.041095 67727 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0816 18:04:52.181175 67727 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0816 18:04:52.300912 67727 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0816 18:04:52.315015 67727 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0816 18:04:52.333927 67727 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0816 18:04:52.333995 67727 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0816 18:04:52.343792 67727 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0816 18:04:52.343859 67727 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0816 18:04:52.353707 67727 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0816 18:04:52.363928 67727 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0816 18:04:52.375905 67727 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0816 18:04:52.387339 67727 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0816 18:04:52.396921 67727 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0816 18:04:52.396998 67727 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0816 18:04:52.409615 67727 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0816 18:04:52.419374 67727 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0816 18:04:52.533836 67727 ssh_runner.go:195] Run: sudo systemctl restart crio
I0816 18:04:52.687074 67727 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0816 18:04:52.687157 67727 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0816 18:04:52.692251 67727 start.go:563] Will wait 60s for crictl version
I0816 18:04:52.692330 67727 ssh_runner.go:195] Run: which crictl
I0816 18:04:52.696292 67727 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0816 18:04:52.738782 67727 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0816 18:04:52.738874 67727 ssh_runner.go:195] Run: crio --version
I0816 18:04:52.765960 67727 ssh_runner.go:195] Run: crio --version
I0816 18:04:52.796834 67727 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0816 18:04:52.798279 67727 main.go:141] libmachine: (old-k8s-version-783465) Calling .GetIP
I0816 18:04:52.801658 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has defined MAC address 52:54:00:d1:97:35 in network mk-old-k8s-version-783465
I0816 18:04:52.802017 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d1:97:35", ip: ""} in network mk-old-k8s-version-783465: {Iface:virbr1 ExpiryTime:2024-08-16 19:04:41 +0000 UTC Type:0 Mac:52:54:00:d1:97:35 Iaid: IPaddr:192.168.39.211 Prefix:24 Hostname:old-k8s-version-783465 Clientid:01:52:54:00:d1:97:35}
I0816 18:04:52.802045 67727 main.go:141] libmachine: (old-k8s-version-783465) DBG | domain old-k8s-version-783465 has defined IP address 192.168.39.211 and MAC address 52:54:00:d1:97:35 in network mk-old-k8s-version-783465
I0816 18:04:52.802254 67727 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I0816 18:04:52.806215 67727 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0816 18:04:52.817882 67727 kubeadm.go:883] updating cluster {Name:old-k8s-version-783465 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19452/minikube-v1.33.1-1723740674-19452-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-783465 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.211 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] M
ountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0816 18:04:52.817998 67727 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0816 18:04:52.818048 67727 ssh_runner.go:195] Run: sudo crictl images --output json
I0816 18:04:52.849218 67727 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0816 18:04:52.849296 67727 ssh_runner.go:195] Run: which lz4
I0816 18:04:52.853204 67727 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0816 18:04:52.858084 67727 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0816 18:04:52.858117 67727 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19461-9545/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0816 18:04:54.372113 67727 crio.go:462] duration metric: took 1.518936744s to copy over tarball
I0816 18:04:54.372208 67727 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0816 18:04:57.314585 67727 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.942346412s)
I0816 18:04:57.314619 67727 crio.go:469] duration metric: took 2.942466318s to extract the tarball
I0816 18:04:57.314630 67727 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0816 18:04:57.360096 67727 ssh_runner.go:195] Run: sudo crictl images --output json
I0816 18:04:57.413097 67727 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0816 18:04:57.413127 67727 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0816 18:04:57.413212 67727 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0816 18:04:57.413215 67727 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0816 18:04:57.413282 67727 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0816 18:04:57.413268 67727 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0816 18:04:57.413324 67727 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0816 18:04:57.413334 67727 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0816 18:04:57.413365 67727 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0816 18:04:57.413217 67727 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0816 18:04:57.414704 67727 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0816 18:04:57.414799 67727 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0816 18:04:57.414981 67727 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0816 18:04:57.414704 67727 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0816 18:04:57.415095 67727 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0816 18:04:57.415096 67727 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0816 18:04:57.415351 67727 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0816 18:04:57.415635 67727 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0816 18:04:57.662032 67727 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0816 18:04:57.718044 67727 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0816 18:04:57.718094 67727 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0816 18:04:57.718134 67727 ssh_runner.go:195] Run: which crictl
I0816 18:04:57.721668 67727 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0816 18:04:57.753825 67727 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0816 18:04:57.755524 67727 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0816 18:04:57.758412 67727 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0816 18:04:57.770277 67727 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0816 18:04:57.788156 67727 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0816 18:04:57.788163 67727 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0816 18:04:57.817873 67727 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0816 18:04:57.882425 67727 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0816 18:04:57.882480 67727 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0816 18:04:57.882534 67727 ssh_runner.go:195] Run: which crictl
I0816 18:04:57.898657 67727 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0816 18:04:57.898723 67727 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0816 18:04:57.898738 67727 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0816 18:04:57.898763 67727 ssh_runner.go:195] Run: which crictl
I0816 18:04:57.945471 67727 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0816 18:04:57.945521 67727 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0816 18:04:57.945562 67727 ssh_runner.go:195] Run: which crictl
I0816 18:04:57.966423 67727 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0816 18:04:57.966462 67727 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0816 18:04:57.966510 67727 ssh_runner.go:195] Run: which crictl
I0816 18:04:57.974964 67727 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0816 18:04:57.974998 67727 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0816 18:04:57.975033 67727 ssh_runner.go:195] Run: which crictl
I0816 18:04:57.994283 67727 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0816 18:04:57.994438 67727 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0816 18:04:57.994465 67727 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0816 18:04:57.994507 67727 ssh_runner.go:195] Run: which crictl
I0816 18:04:58.011895 67727 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0816 18:04:58.012005 67727 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19461-9545/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0816 18:04:58.012063 67727 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0816 18:04:58.012126 67727 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0816 18:04:58.012189 67727 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0816 18:04:58.120235 67727 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0816 18:04:58.120415 67727 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0816 18:04:58.149436 67727 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0816 18:04:58.149472 67727 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0816 18:04:58.149522 67727 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0816 18:04:58.149539 67727 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0816 18:04:58.252809 67727 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0816 18:04:58.252885 67727 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0816 18:04:58.263283 67727 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0816 18:04:58.263322 67727 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0816 18:04:58.266699 67727 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0816 18:04:58.266882 67727 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0816 18:04:58.294013 67727 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0816 18:04:58.387034 67727 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19461-9545/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0816 18:04:58.387125 67727 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0816 18:04:58.415126 67727 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19461-9545/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0816 18:04:58.415181 67727 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19461-9545/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0816 18:04:58.415215 67727 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19461-9545/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0816 18:04:58.418165 67727 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19461-9545/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0816 18:04:58.557930 67727 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19461-9545/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0816 18:04:58.557982 67727 cache_images.go:92] duration metric: took 1.144841631s to LoadCachedImages
W0816 18:04:58.558053 67727 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19461-9545/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19461-9545/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2: no such file or directory
I0816 18:04:58.558066 67727 kubeadm.go:934] updating node { 192.168.39.211 8443 v1.20.0 crio true true} ...
I0816 18:04:58.558158 67727 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-783465 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.39.211
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-783465 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0816 18:04:58.558220 67727 ssh_runner.go:195] Run: crio config
I0816 18:04:58.611979 67727 cni.go:84] Creating CNI manager for ""
I0816 18:04:58.612002 67727 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0816 18:04:58.612017 67727 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0816 18:04:58.612037 67727 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.211 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-783465 NodeName:old-k8s-version-783465 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.211"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.211 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0816 18:04:58.612178 67727 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.39.211
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-783465"
kubeletExtraArgs:
node-ip: 192.168.39.211
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.39.211"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0816 18:04:58.612243 67727 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0816 18:04:58.625551 67727 binaries.go:44] Found k8s binaries, skipping transfer
I0816 18:04:58.625635 67727 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0816 18:04:58.639572 67727 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0816 18:04:58.662843 67727 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0816 18:04:58.682405 67727 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0816 18:04:58.698782 67727 ssh_runner.go:195] Run: grep 192.168.39.211 control-plane.minikube.internal$ /etc/hosts
I0816 18:04:58.702666 67727 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.211 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0816 18:04:58.716049 67727 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0816 18:04:58.907584 67727 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0816 18:04:58.929704 67727 certs.go:68] Setting up /home/jenkins/minikube-integration/19461-9545/.minikube/profiles/old-k8s-version-783465 for IP: 192.168.39.211
I0816 18:04:58.929745 67727 certs.go:194] generating shared ca certs ...
I0816 18:04:58.929767 67727 certs.go:226] acquiring lock for ca certs: {Name:mk1e000575c94c138513704c2900b8a68810eb65 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0816 18:04:58.929929 67727 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19461-9545/.minikube/ca.key
I0816 18:04:58.929985 67727 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19461-9545/.minikube/proxy-client-ca.key
I0816 18:04:58.930001 67727 certs.go:256] generating profile certs ...
I0816 18:04:58.930092 67727 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19461-9545/.minikube/profiles/old-k8s-version-783465/client.key
I0816 18:04:58.930117 67727 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19461-9545/.minikube/profiles/old-k8s-version-783465/client.crt with IP's: []
I0816 18:04:59.298455 67727 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19461-9545/.minikube/profiles/old-k8s-version-783465/client.crt ...
I0816 18:04:59.298499 67727 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19461-9545/.minikube/profiles/old-k8s-version-783465/client.crt: {Name:mkdfa0b60f174905704f834a17584e6688dce53a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0816 18:04:59.298744 67727 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19461-9545/.minikube/profiles/old-k8s-version-783465/client.key ...
I0816 18:04:59.298776 67727 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19461-9545/.minikube/profiles/old-k8s-version-783465/client.key: {Name:mkc2b68d34c746875c956299ecee5c69e1b213dd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0816 18:04:59.298909 67727 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19461-9545/.minikube/profiles/old-k8s-version-783465/apiserver.key.94c45fb6
I0816 18:04:59.298932 67727 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19461-9545/.minikube/profiles/old-k8s-version-783465/apiserver.crt.94c45fb6 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.211]
I0816 18:04:59.505794 67727 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19461-9545/.minikube/profiles/old-k8s-version-783465/apiserver.crt.94c45fb6 ...
I0816 18:04:59.505821 67727 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19461-9545/.minikube/profiles/old-k8s-version-783465/apiserver.crt.94c45fb6: {Name:mk7a4d4d245692e84982a5e745e580184bf0c088 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0816 18:04:59.505975 67727 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19461-9545/.minikube/profiles/old-k8s-version-783465/apiserver.key.94c45fb6 ...
I0816 18:04:59.505991 67727 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19461-9545/.minikube/profiles/old-k8s-version-783465/apiserver.key.94c45fb6: {Name:mkbaf666d35cf81d9f36cc4dfaf9a5e4d6ec1d0b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0816 18:04:59.506086 67727 certs.go:381] copying /home/jenkins/minikube-integration/19461-9545/.minikube/profiles/old-k8s-version-783465/apiserver.crt.94c45fb6 -> /home/jenkins/minikube-integration/19461-9545/.minikube/profiles/old-k8s-version-783465/apiserver.crt
I0816 18:04:59.506184 67727 certs.go:385] copying /home/jenkins/minikube-integration/19461-9545/.minikube/profiles/old-k8s-version-783465/apiserver.key.94c45fb6 -> /home/jenkins/minikube-integration/19461-9545/.minikube/profiles/old-k8s-version-783465/apiserver.key
I0816 18:04:59.506261 67727 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19461-9545/.minikube/profiles/old-k8s-version-783465/proxy-client.key
I0816 18:04:59.506282 67727 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19461-9545/.minikube/profiles/old-k8s-version-783465/proxy-client.crt with IP's: []
I0816 18:04:59.656238 67727 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19461-9545/.minikube/profiles/old-k8s-version-783465/proxy-client.crt ...
I0816 18:04:59.656265 67727 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19461-9545/.minikube/profiles/old-k8s-version-783465/proxy-client.crt: {Name:mkab3b33af340baede9fca51f959f58f40ed9a35 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0816 18:04:59.656446 67727 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19461-9545/.minikube/profiles/old-k8s-version-783465/proxy-client.key ...
I0816 18:04:59.656469 67727 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19461-9545/.minikube/profiles/old-k8s-version-783465/proxy-client.key: {Name:mk92170505d6653e646675f1adf2fafa79061ef9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0816 18:04:59.656726 67727 certs.go:484] found cert: /home/jenkins/minikube-integration/19461-9545/.minikube/certs/16753.pem (1338 bytes)
W0816 18:04:59.656768 67727 certs.go:480] ignoring /home/jenkins/minikube-integration/19461-9545/.minikube/certs/16753_empty.pem, impossibly tiny 0 bytes
I0816 18:04:59.656778 67727 certs.go:484] found cert: /home/jenkins/minikube-integration/19461-9545/.minikube/certs/ca-key.pem (1675 bytes)
I0816 18:04:59.656838 67727 certs.go:484] found cert: /home/jenkins/minikube-integration/19461-9545/.minikube/certs/ca.pem (1082 bytes)
I0816 18:04:59.656866 67727 certs.go:484] found cert: /home/jenkins/minikube-integration/19461-9545/.minikube/certs/cert.pem (1123 bytes)
I0816 18:04:59.656887 67727 certs.go:484] found cert: /home/jenkins/minikube-integration/19461-9545/.minikube/certs/key.pem (1679 bytes)
I0816 18:04:59.656931 67727 certs.go:484] found cert: /home/jenkins/minikube-integration/19461-9545/.minikube/files/etc/ssl/certs/167532.pem (1708 bytes)
I0816 18:04:59.657465 67727 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19461-9545/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0816 18:04:59.691363 67727 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19461-9545/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0816 18:04:59.717803 67727 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19461-9545/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0816 18:04:59.744369 67727 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19461-9545/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0816 18:04:59.769143 67727 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19461-9545/.minikube/profiles/old-k8s-version-783465/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0816 18:04:59.793488 67727 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19461-9545/.minikube/profiles/old-k8s-version-783465/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0816 18:04:59.820631 67727 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19461-9545/.minikube/profiles/old-k8s-version-783465/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0816 18:04:59.855672 67727 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19461-9545/.minikube/profiles/old-k8s-version-783465/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0816 18:04:59.896808 67727 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19461-9545/.minikube/files/etc/ssl/certs/167532.pem --> /usr/share/ca-certificates/167532.pem (1708 bytes)
I0816 18:04:59.939802 67727 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19461-9545/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0816 18:04:59.967542 67727 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19461-9545/.minikube/certs/16753.pem --> /usr/share/ca-certificates/16753.pem (1338 bytes)
I0816 18:04:59.998783 67727 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0816 18:05:00.018311 67727 ssh_runner.go:195] Run: openssl version
I0816 18:05:00.024180 67727 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0816 18:05:00.035139 67727 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0816 18:05:00.040787 67727 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug 16 16:49 /usr/share/ca-certificates/minikubeCA.pem
I0816 18:05:00.040838 67727 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0816 18:05:00.048840 67727 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0816 18:05:00.061516 67727 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/16753.pem && ln -fs /usr/share/ca-certificates/16753.pem /etc/ssl/certs/16753.pem"
I0816 18:05:00.072672 67727 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/16753.pem
I0816 18:05:00.078190 67727 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug 16 17:00 /usr/share/ca-certificates/16753.pem
I0816 18:05:00.078253 67727 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/16753.pem
I0816 18:05:00.085005 67727 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/16753.pem /etc/ssl/certs/51391683.0"
I0816 18:05:00.098717 67727 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/167532.pem && ln -fs /usr/share/ca-certificates/167532.pem /etc/ssl/certs/167532.pem"
I0816 18:05:00.111112 67727 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/167532.pem
I0816 18:05:00.116560 67727 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug 16 17:00 /usr/share/ca-certificates/167532.pem
I0816 18:05:00.116612 67727 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/167532.pem
I0816 18:05:00.122612 67727 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/167532.pem /etc/ssl/certs/3ec20f2e.0"
I0816 18:05:00.133816 67727 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0816 18:05:00.137744 67727 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0816 18:05:00.137803 67727 kubeadm.go:392] StartCluster: {Name:old-k8s-version-783465 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19452/minikube-v1.33.1-1723740674-19452-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-783465 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.211 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0816 18:05:00.137880 67727 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0816 18:05:00.137938 67727 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0816 18:05:00.184010 67727 cri.go:89] found id: ""
I0816 18:05:00.184091 67727 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0816 18:05:00.194347 67727 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0816 18:05:00.204968 67727 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0816 18:05:00.218073 67727 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0816 18:05:00.218095 67727 kubeadm.go:157] found existing configuration files:
I0816 18:05:00.218154 67727 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0816 18:05:00.230102 67727 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0816 18:05:00.230166 67727 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0816 18:05:00.240966 67727 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0816 18:05:00.251464 67727 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0816 18:05:00.251538 67727 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0816 18:05:00.261531 67727 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0816 18:05:00.272001 67727 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0816 18:05:00.272059 67727 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0816 18:05:00.283906 67727 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0816 18:05:00.296484 67727 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0816 18:05:00.296530 67727 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0816 18:05:00.309537 67727 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0816 18:05:00.450076 67727 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0816 18:05:00.450347 67727 kubeadm.go:310] [preflight] Running pre-flight checks
I0816 18:05:00.620272 67727 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0816 18:05:00.620446 67727 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0816 18:05:00.620560 67727 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0816 18:05:00.865565 67727 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0816 18:05:00.938750 67727 out.go:235] - Generating certificates and keys ...
I0816 18:05:00.938866 67727 kubeadm.go:310] [certs] Using existing ca certificate authority
I0816 18:05:00.938956 67727 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0816 18:05:01.059333 67727 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0816 18:05:01.300543 67727 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0816 18:05:01.608129 67727 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0816 18:05:01.765654 67727 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0816 18:05:01.965330 67727 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0816 18:05:01.965641 67727 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-783465] and IPs [192.168.39.211 127.0.0.1 ::1]
I0816 18:05:02.796965 67727 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0816 18:05:02.797152 67727 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-783465] and IPs [192.168.39.211 127.0.0.1 ::1]
I0816 18:05:03.366069 67727 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0816 18:05:03.566293 67727 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0816 18:05:03.690272 67727 kubeadm.go:310] [certs] Generating "sa" key and public key
I0816 18:05:03.690547 67727 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0816 18:05:03.818268 67727 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0816 18:05:04.226782 67727 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0816 18:05:04.455323 67727 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0816 18:05:04.761119 67727 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0816 18:05:04.778869 67727 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0816 18:05:04.779876 67727 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0816 18:05:04.779943 67727 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0816 18:05:04.908766 67727 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0816 18:05:04.910626 67727 out.go:235] - Booting up control plane ...
I0816 18:05:04.910752 67727 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0816 18:05:04.918444 67727 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0816 18:05:04.920344 67727 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0816 18:05:04.920453 67727 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0816 18:05:04.933455 67727 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0816 18:05:44.899429 67727 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0816 18:05:44.900295 67727 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0816 18:05:44.900550 67727 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0816 18:05:49.899977 67727 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0816 18:05:49.900247 67727 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0816 18:05:59.899317 67727 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0816 18:05:59.899614 67727 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0816 18:06:19.899799 67727 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0816 18:06:19.900082 67727 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0816 18:06:59.899015 67727 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0816 18:06:59.899532 67727 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0816 18:06:59.899575 67727 kubeadm.go:310]
I0816 18:06:59.899679 67727 kubeadm.go:310] Unfortunately, an error has occurred:
I0816 18:06:59.899793 67727 kubeadm.go:310] timed out waiting for the condition
I0816 18:06:59.899828 67727 kubeadm.go:310]
I0816 18:06:59.899965 67727 kubeadm.go:310] This error is likely caused by:
I0816 18:06:59.900064 67727 kubeadm.go:310] - The kubelet is not running
I0816 18:06:59.900310 67727 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0816 18:06:59.900323 67727 kubeadm.go:310]
I0816 18:06:59.900514 67727 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0816 18:06:59.900597 67727 kubeadm.go:310] - 'systemctl status kubelet'
I0816 18:06:59.900692 67727 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0816 18:06:59.900703 67727 kubeadm.go:310]
I0816 18:06:59.900933 67727 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0816 18:06:59.901111 67727 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0816 18:06:59.901124 67727 kubeadm.go:310]
I0816 18:06:59.901309 67727 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0816 18:06:59.901515 67727 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0816 18:06:59.901781 67727 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0816 18:06:59.901918 67727 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0816 18:06:59.901971 67727 kubeadm.go:310]
I0816 18:06:59.902281 67727 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0816 18:06:59.902581 67727 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0816 18:06:59.902688 67727 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
W0816 18:06:59.902793 67727 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-783465] and IPs [192.168.39.211 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-783465] and IPs [192.168.39.211 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-783465] and IPs [192.168.39.211 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-783465] and IPs [192.168.39.211 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0816 18:06:59.902838 67727 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0816 18:07:00.370612 67727 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0816 18:07:00.385579 67727 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0816 18:07:00.394962 67727 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0816 18:07:00.394980 67727 kubeadm.go:157] found existing configuration files:
I0816 18:07:00.395029 67727 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0816 18:07:00.403714 67727 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0816 18:07:00.403783 67727 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0816 18:07:00.412424 67727 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0816 18:07:00.420798 67727 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0816 18:07:00.420847 67727 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0816 18:07:00.429422 67727 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0816 18:07:00.438168 67727 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0816 18:07:00.438217 67727 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0816 18:07:00.446797 67727 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0816 18:07:00.455483 67727 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0816 18:07:00.455537 67727 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0816 18:07:00.465656 67727 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0816 18:07:00.676292 67727 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0816 18:08:56.671584 67727 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0816 18:08:56.671663 67727 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0816 18:08:56.673478 67727 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0816 18:08:56.673530 67727 kubeadm.go:310] [preflight] Running pre-flight checks
I0816 18:08:56.673613 67727 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0816 18:08:56.673715 67727 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0816 18:08:56.673812 67727 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0816 18:08:56.673896 67727 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0816 18:08:56.675589 67727 out.go:235] - Generating certificates and keys ...
I0816 18:08:56.675676 67727 kubeadm.go:310] [certs] Using existing ca certificate authority
I0816 18:08:56.675753 67727 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0816 18:08:56.675853 67727 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0816 18:08:56.675939 67727 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0816 18:08:56.676042 67727 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0816 18:08:56.676117 67727 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0816 18:08:56.676251 67727 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0816 18:08:56.676338 67727 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0816 18:08:56.676439 67727 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0816 18:08:56.676538 67727 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0816 18:08:56.676642 67727 kubeadm.go:310] [certs] Using the existing "sa" key
I0816 18:08:56.676736 67727 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0816 18:08:56.676819 67727 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0816 18:08:56.676902 67727 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0816 18:08:56.676987 67727 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0816 18:08:56.677059 67727 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0816 18:08:56.677151 67727 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0816 18:08:56.677238 67727 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0816 18:08:56.677312 67727 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0816 18:08:56.677401 67727 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0816 18:08:56.678682 67727 out.go:235] - Booting up control plane ...
I0816 18:08:56.678778 67727 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0816 18:08:56.678882 67727 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0816 18:08:56.678939 67727 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0816 18:08:56.679009 67727 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0816 18:08:56.679138 67727 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0816 18:08:56.679215 67727 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0816 18:08:56.679301 67727 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0816 18:08:56.679497 67727 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0816 18:08:56.679577 67727 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0816 18:08:56.679788 67727 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0816 18:08:56.679876 67727 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0816 18:08:56.680027 67727 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0816 18:08:56.680085 67727 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0816 18:08:56.680236 67727 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0816 18:08:56.680288 67727 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0816 18:08:56.680492 67727 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0816 18:08:56.680499 67727 kubeadm.go:310]
I0816 18:08:56.680530 67727 kubeadm.go:310] Unfortunately, an error has occurred:
I0816 18:08:56.680579 67727 kubeadm.go:310] timed out waiting for the condition
I0816 18:08:56.680590 67727 kubeadm.go:310]
I0816 18:08:56.680660 67727 kubeadm.go:310] This error is likely caused by:
I0816 18:08:56.680708 67727 kubeadm.go:310] - The kubelet is not running
I0816 18:08:56.680819 67727 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0816 18:08:56.680828 67727 kubeadm.go:310]
I0816 18:08:56.680947 67727 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0816 18:08:56.680996 67727 kubeadm.go:310] - 'systemctl status kubelet'
I0816 18:08:56.681050 67727 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0816 18:08:56.681060 67727 kubeadm.go:310]
I0816 18:08:56.681178 67727 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0816 18:08:56.681250 67727 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0816 18:08:56.681256 67727 kubeadm.go:310]
I0816 18:08:56.681343 67727 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0816 18:08:56.681412 67727 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0816 18:08:56.681476 67727 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0816 18:08:56.681581 67727 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0816 18:08:56.681616 67727 kubeadm.go:310]
I0816 18:08:56.681659 67727 kubeadm.go:394] duration metric: took 3m56.543860949s to StartCluster
I0816 18:08:56.681709 67727 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0816 18:08:56.681771 67727 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0816 18:08:56.724315 67727 cri.go:89] found id: ""
I0816 18:08:56.724358 67727 logs.go:276] 0 containers: []
W0816 18:08:56.724369 67727 logs.go:278] No container was found matching "kube-apiserver"
I0816 18:08:56.724376 67727 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0816 18:08:56.724445 67727 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0816 18:08:56.760020 67727 cri.go:89] found id: ""
I0816 18:08:56.760053 67727 logs.go:276] 0 containers: []
W0816 18:08:56.760063 67727 logs.go:278] No container was found matching "etcd"
I0816 18:08:56.760071 67727 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0816 18:08:56.760123 67727 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0816 18:08:56.792369 67727 cri.go:89] found id: ""
I0816 18:08:56.792397 67727 logs.go:276] 0 containers: []
W0816 18:08:56.792408 67727 logs.go:278] No container was found matching "coredns"
I0816 18:08:56.792415 67727 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0816 18:08:56.792480 67727 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0816 18:08:56.826417 67727 cri.go:89] found id: ""
I0816 18:08:56.826449 67727 logs.go:276] 0 containers: []
W0816 18:08:56.826458 67727 logs.go:278] No container was found matching "kube-scheduler"
I0816 18:08:56.826466 67727 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0816 18:08:56.826528 67727 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0816 18:08:56.859130 67727 cri.go:89] found id: ""
I0816 18:08:56.859163 67727 logs.go:276] 0 containers: []
W0816 18:08:56.859176 67727 logs.go:278] No container was found matching "kube-proxy"
I0816 18:08:56.859182 67727 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0816 18:08:56.859239 67727 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0816 18:08:56.891458 67727 cri.go:89] found id: ""
I0816 18:08:56.891488 67727 logs.go:276] 0 containers: []
W0816 18:08:56.891499 67727 logs.go:278] No container was found matching "kube-controller-manager"
I0816 18:08:56.891507 67727 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0816 18:08:56.891569 67727 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0816 18:08:56.922554 67727 cri.go:89] found id: ""
I0816 18:08:56.922583 67727 logs.go:276] 0 containers: []
W0816 18:08:56.922592 67727 logs.go:278] No container was found matching "kindnet"
I0816 18:08:56.922600 67727 logs.go:123] Gathering logs for dmesg ...
I0816 18:08:56.922612 67727 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0816 18:08:56.935232 67727 logs.go:123] Gathering logs for describe nodes ...
I0816 18:08:56.935266 67727 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0816 18:08:57.042654 67727 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0816 18:08:57.042681 67727 logs.go:123] Gathering logs for CRI-O ...
I0816 18:08:57.042696 67727 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0816 18:08:57.146531 67727 logs.go:123] Gathering logs for container status ...
I0816 18:08:57.146571 67727 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0816 18:08:57.194086 67727 logs.go:123] Gathering logs for kubelet ...
I0816 18:08:57.194116 67727 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0816 18:08:57.255140 67727 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0816 18:08:57.255233 67727 out.go:270] *
*
W0816 18:08:57.255303 67727 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0816 18:08:57.255323 67727 out.go:270] *
*
W0816 18:08:57.256110 67727 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0816 18:08:57.258876 67727 out.go:201]
W0816 18:08:57.260073 67727 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0816 18:08:57.260122 67727 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0816 18:08:57.260149 67727 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0816 18:08:57.261516 67727 out.go:201]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-783465 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-783465 -n old-k8s-version-783465
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-783465 -n old-k8s-version-783465: exit status 6 (215.413714ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0816 18:08:57.518032 74378 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-783465" does not appear in /home/jenkins/minikube-integration/19461-9545/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-783465" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (287.20s)