=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-919612 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-919612 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m54.016111721s)
-- stdout --
* [old-k8s-version-919612] minikube v1.33.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=18774
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/18774-7754/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/18774-7754/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-919612" primary control-plane node in "old-k8s-version-919612" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0429 19:55:41.380580 62888 out.go:291] Setting OutFile to fd 1 ...
I0429 19:55:41.380706 62888 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0429 19:55:41.380717 62888 out.go:304] Setting ErrFile to fd 2...
I0429 19:55:41.380724 62888 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0429 19:55:41.381040 62888 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18774-7754/.minikube/bin
I0429 19:55:41.381708 62888 out.go:298] Setting JSON to false
I0429 19:55:41.382690 62888 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-10","uptime":5839,"bootTime":1714414702,"procs":215,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1058-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0429 19:55:41.382749 62888 start.go:139] virtualization: kvm guest
I0429 19:55:41.385085 62888 out.go:177] * [old-k8s-version-919612] minikube v1.33.0 on Ubuntu 20.04 (kvm/amd64)
I0429 19:55:41.386943 62888 out.go:177] - MINIKUBE_LOCATION=18774
I0429 19:55:41.387020 62888 notify.go:220] Checking for updates...
I0429 19:55:41.388480 62888 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0429 19:55:41.390079 62888 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18774-7754/kubeconfig
I0429 19:55:41.391675 62888 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18774-7754/.minikube
I0429 19:55:41.393326 62888 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0429 19:55:41.396080 62888 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0429 19:55:41.398229 62888 config.go:182] Loaded profile config "cert-expiration-509508": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0
I0429 19:55:41.398411 62888 config.go:182] Loaded profile config "cert-options-437743": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0
I0429 19:55:41.398542 62888 config.go:182] Loaded profile config "kubernetes-upgrade-935578": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0
I0429 19:55:41.398712 62888 driver.go:392] Setting default libvirt URI to qemu:///system
I0429 19:55:41.435875 62888 out.go:177] * Using the kvm2 driver based on user configuration
I0429 19:55:41.437142 62888 start.go:297] selected driver: kvm2
I0429 19:55:41.437157 62888 start.go:901] validating driver "kvm2" against <nil>
I0429 19:55:41.437168 62888 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0429 19:55:41.437836 62888 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0429 19:55:41.437908 62888 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/18774-7754/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0429 19:55:41.454338 62888 install.go:137] /home/jenkins/minikube-integration/18774-7754/.minikube/bin/docker-machine-driver-kvm2 version is 1.33.0
I0429 19:55:41.454392 62888 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0429 19:55:41.454635 62888 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0429 19:55:41.454708 62888 cni.go:84] Creating CNI manager for ""
I0429 19:55:41.454725 62888 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0429 19:55:41.454736 62888 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0429 19:55:41.454811 62888 start.go:340] cluster config:
{Name:old-k8s-version-919612 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-919612 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0429 19:55:41.454944 62888 iso.go:125] acquiring lock: {Name:mk7ac5bbcadd939eb992cb25f14a8ea1a46dc7aa Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0429 19:55:41.457073 62888 out.go:177] * Starting "old-k8s-version-919612" primary control-plane node in "old-k8s-version-919612" cluster
I0429 19:55:41.458508 62888 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0429 19:55:41.458564 62888 preload.go:147] Found local preload: /home/jenkins/minikube-integration/18774-7754/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0429 19:55:41.458579 62888 cache.go:56] Caching tarball of preloaded images
I0429 19:55:41.458673 62888 preload.go:173] Found /home/jenkins/minikube-integration/18774-7754/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0429 19:55:41.458686 62888 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0429 19:55:41.458804 62888 profile.go:143] Saving config to /home/jenkins/minikube-integration/18774-7754/.minikube/profiles/old-k8s-version-919612/config.json ...
I0429 19:55:41.458828 62888 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18774-7754/.minikube/profiles/old-k8s-version-919612/config.json: {Name:mkdb2cecd76ba01739d27fb17a68ae70ffb28975 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0429 19:55:41.458981 62888 start.go:360] acquireMachinesLock for old-k8s-version-919612: {Name:mkc5138674898e266e3a150644dea789e7bb6641 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0429 19:55:55.503707 62888 start.go:364] duration metric: took 14.044686977s to acquireMachinesLock for "old-k8s-version-919612"
I0429 19:55:55.503783 62888 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-919612 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18706/minikube-v1.33.0-1713736271-18706-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-919612 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0429 19:55:55.503938 62888 start.go:125] createHost starting for "" (driver="kvm2")
I0429 19:55:55.506347 62888 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0429 19:55:55.506568 62888 main.go:141] libmachine: Found binary path at /home/jenkins/minikube-integration/18774-7754/.minikube/bin/docker-machine-driver-kvm2
I0429 19:55:55.506623 62888 main.go:141] libmachine: Launching plugin server for driver kvm2
I0429 19:55:55.523507 62888 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38679
I0429 19:55:55.524006 62888 main.go:141] libmachine: () Calling .GetVersion
I0429 19:55:55.524616 62888 main.go:141] libmachine: Using API Version 1
I0429 19:55:55.524641 62888 main.go:141] libmachine: () Calling .SetConfigRaw
I0429 19:55:55.525792 62888 main.go:141] libmachine: () Calling .GetMachineName
I0429 19:55:55.525979 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetMachineName
I0429 19:55:55.526178 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .DriverName
I0429 19:55:55.526367 62888 start.go:159] libmachine.API.Create for "old-k8s-version-919612" (driver="kvm2")
I0429 19:55:55.526429 62888 client.go:168] LocalClient.Create starting
I0429 19:55:55.526462 62888 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18774-7754/.minikube/certs/ca.pem
I0429 19:55:55.526497 62888 main.go:141] libmachine: Decoding PEM data...
I0429 19:55:55.526523 62888 main.go:141] libmachine: Parsing certificate...
I0429 19:55:55.526591 62888 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18774-7754/.minikube/certs/cert.pem
I0429 19:55:55.526618 62888 main.go:141] libmachine: Decoding PEM data...
I0429 19:55:55.526634 62888 main.go:141] libmachine: Parsing certificate...
I0429 19:55:55.526663 62888 main.go:141] libmachine: Running pre-create checks...
I0429 19:55:55.526675 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .PreCreateCheck
I0429 19:55:55.527999 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetConfigRaw
I0429 19:55:55.528359 62888 main.go:141] libmachine: Creating machine...
I0429 19:55:55.528372 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .Create
I0429 19:55:55.528497 62888 main.go:141] libmachine: (old-k8s-version-919612) Creating KVM machine...
I0429 19:55:55.529689 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | found existing default KVM network
I0429 19:55:55.530810 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | I0429 19:55:55.530647 63060 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:31:bc:7c} reservation:<nil>}
I0429 19:55:55.531809 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | I0429 19:55:55.531731 63060 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:e8:e8:e4} reservation:<nil>}
I0429 19:55:55.532675 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | I0429 19:55:55.532607 63060 network.go:211] skipping subnet 192.168.61.0/24 that is taken: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName:virbr3 IfaceIPv4:192.168.61.1 IfaceMTU:1500 IfaceMAC:52:54:00:99:a1:58} reservation:<nil>}
I0429 19:55:55.533708 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | I0429 19:55:55.533614 63060 network.go:206] using free private subnet 192.168.72.0/24: &{IP:192.168.72.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.72.0/24 Gateway:192.168.72.1 ClientMin:192.168.72.2 ClientMax:192.168.72.254 Broadcast:192.168.72.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0003091b0}
I0429 19:55:55.533752 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | created network xml:
I0429 19:55:55.533786 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | <network>
I0429 19:55:55.533798 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | <name>mk-old-k8s-version-919612</name>
I0429 19:55:55.533807 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | <dns enable='no'/>
I0429 19:55:55.533817 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG |
I0429 19:55:55.533828 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | <ip address='192.168.72.1' netmask='255.255.255.0'>
I0429 19:55:55.533853 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | <dhcp>
I0429 19:55:55.533864 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | <range start='192.168.72.2' end='192.168.72.253'/>
I0429 19:55:55.533875 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | </dhcp>
I0429 19:55:55.533883 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | </ip>
I0429 19:55:55.533893 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG |
I0429 19:55:55.533901 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | </network>
I0429 19:55:55.533914 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG |
I0429 19:55:55.539648 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | trying to create private KVM network mk-old-k8s-version-919612 192.168.72.0/24...
I0429 19:55:55.619257 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | private KVM network mk-old-k8s-version-919612 192.168.72.0/24 created
I0429 19:55:55.619304 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | I0429 19:55:55.619246 63060 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/18774-7754/.minikube
I0429 19:55:55.619329 62888 main.go:141] libmachine: (old-k8s-version-919612) Setting up store path in /home/jenkins/minikube-integration/18774-7754/.minikube/machines/old-k8s-version-919612 ...
I0429 19:55:55.619340 62888 main.go:141] libmachine: (old-k8s-version-919612) Building disk image from file:///home/jenkins/minikube-integration/18774-7754/.minikube/cache/iso/amd64/minikube-v1.33.0-1713736271-18706-amd64.iso
I0429 19:55:55.619454 62888 main.go:141] libmachine: (old-k8s-version-919612) Downloading /home/jenkins/minikube-integration/18774-7754/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/18774-7754/.minikube/cache/iso/amd64/minikube-v1.33.0-1713736271-18706-amd64.iso...
I0429 19:55:55.889336 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | I0429 19:55:55.889203 63060 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/18774-7754/.minikube/machines/old-k8s-version-919612/id_rsa...
I0429 19:55:55.941195 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | I0429 19:55:55.941065 63060 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/18774-7754/.minikube/machines/old-k8s-version-919612/old-k8s-version-919612.rawdisk...
I0429 19:55:55.941231 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | Writing magic tar header
I0429 19:55:55.941270 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | Writing SSH key tar header
I0429 19:55:55.941318 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | I0429 19:55:55.941198 63060 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/18774-7754/.minikube/machines/old-k8s-version-919612 ...
I0429 19:55:55.941356 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18774-7754/.minikube/machines/old-k8s-version-919612
I0429 19:55:55.941422 62888 main.go:141] libmachine: (old-k8s-version-919612) Setting executable bit set on /home/jenkins/minikube-integration/18774-7754/.minikube/machines/old-k8s-version-919612 (perms=drwx------)
I0429 19:55:55.941450 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18774-7754/.minikube/machines
I0429 19:55:55.941466 62888 main.go:141] libmachine: (old-k8s-version-919612) Setting executable bit set on /home/jenkins/minikube-integration/18774-7754/.minikube/machines (perms=drwxr-xr-x)
I0429 19:55:55.941490 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18774-7754/.minikube
I0429 19:55:55.941506 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18774-7754
I0429 19:55:55.941522 62888 main.go:141] libmachine: (old-k8s-version-919612) Setting executable bit set on /home/jenkins/minikube-integration/18774-7754/.minikube (perms=drwxr-xr-x)
I0429 19:55:55.941539 62888 main.go:141] libmachine: (old-k8s-version-919612) Setting executable bit set on /home/jenkins/minikube-integration/18774-7754 (perms=drwxrwxr-x)
I0429 19:55:55.941551 62888 main.go:141] libmachine: (old-k8s-version-919612) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0429 19:55:55.941564 62888 main.go:141] libmachine: (old-k8s-version-919612) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0429 19:55:55.941575 62888 main.go:141] libmachine: (old-k8s-version-919612) Creating domain...
I0429 19:55:55.941590 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0429 19:55:55.941602 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | Checking permissions on dir: /home/jenkins
I0429 19:55:55.941616 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | Checking permissions on dir: /home
I0429 19:55:55.941628 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | Skipping /home - not owner
I0429 19:55:55.942693 62888 main.go:141] libmachine: (old-k8s-version-919612) define libvirt domain using xml:
I0429 19:55:55.942715 62888 main.go:141] libmachine: (old-k8s-version-919612) <domain type='kvm'>
I0429 19:55:55.942726 62888 main.go:141] libmachine: (old-k8s-version-919612) <name>old-k8s-version-919612</name>
I0429 19:55:55.942734 62888 main.go:141] libmachine: (old-k8s-version-919612) <memory unit='MiB'>2200</memory>
I0429 19:55:55.942744 62888 main.go:141] libmachine: (old-k8s-version-919612) <vcpu>2</vcpu>
I0429 19:55:55.942752 62888 main.go:141] libmachine: (old-k8s-version-919612) <features>
I0429 19:55:55.942764 62888 main.go:141] libmachine: (old-k8s-version-919612) <acpi/>
I0429 19:55:55.942780 62888 main.go:141] libmachine: (old-k8s-version-919612) <apic/>
I0429 19:55:55.942793 62888 main.go:141] libmachine: (old-k8s-version-919612) <pae/>
I0429 19:55:55.942804 62888 main.go:141] libmachine: (old-k8s-version-919612)
I0429 19:55:55.942817 62888 main.go:141] libmachine: (old-k8s-version-919612) </features>
I0429 19:55:55.942842 62888 main.go:141] libmachine: (old-k8s-version-919612) <cpu mode='host-passthrough'>
I0429 19:55:55.942871 62888 main.go:141] libmachine: (old-k8s-version-919612)
I0429 19:55:55.942890 62888 main.go:141] libmachine: (old-k8s-version-919612) </cpu>
I0429 19:55:55.942903 62888 main.go:141] libmachine: (old-k8s-version-919612) <os>
I0429 19:55:55.942912 62888 main.go:141] libmachine: (old-k8s-version-919612) <type>hvm</type>
I0429 19:55:55.942922 62888 main.go:141] libmachine: (old-k8s-version-919612) <boot dev='cdrom'/>
I0429 19:55:55.942932 62888 main.go:141] libmachine: (old-k8s-version-919612) <boot dev='hd'/>
I0429 19:55:55.942946 62888 main.go:141] libmachine: (old-k8s-version-919612) <bootmenu enable='no'/>
I0429 19:55:55.942955 62888 main.go:141] libmachine: (old-k8s-version-919612) </os>
I0429 19:55:55.942974 62888 main.go:141] libmachine: (old-k8s-version-919612) <devices>
I0429 19:55:55.942989 62888 main.go:141] libmachine: (old-k8s-version-919612) <disk type='file' device='cdrom'>
I0429 19:55:55.943033 62888 main.go:141] libmachine: (old-k8s-version-919612) <source file='/home/jenkins/minikube-integration/18774-7754/.minikube/machines/old-k8s-version-919612/boot2docker.iso'/>
I0429 19:55:55.943070 62888 main.go:141] libmachine: (old-k8s-version-919612) <target dev='hdc' bus='scsi'/>
I0429 19:55:55.943085 62888 main.go:141] libmachine: (old-k8s-version-919612) <readonly/>
I0429 19:55:55.943095 62888 main.go:141] libmachine: (old-k8s-version-919612) </disk>
I0429 19:55:55.943113 62888 main.go:141] libmachine: (old-k8s-version-919612) <disk type='file' device='disk'>
I0429 19:55:55.943144 62888 main.go:141] libmachine: (old-k8s-version-919612) <driver name='qemu' type='raw' cache='default' io='threads' />
I0429 19:55:55.943165 62888 main.go:141] libmachine: (old-k8s-version-919612) <source file='/home/jenkins/minikube-integration/18774-7754/.minikube/machines/old-k8s-version-919612/old-k8s-version-919612.rawdisk'/>
I0429 19:55:55.943177 62888 main.go:141] libmachine: (old-k8s-version-919612) <target dev='hda' bus='virtio'/>
I0429 19:55:55.943189 62888 main.go:141] libmachine: (old-k8s-version-919612) </disk>
I0429 19:55:55.943202 62888 main.go:141] libmachine: (old-k8s-version-919612) <interface type='network'>
I0429 19:55:55.943215 62888 main.go:141] libmachine: (old-k8s-version-919612) <source network='mk-old-k8s-version-919612'/>
I0429 19:55:55.943224 62888 main.go:141] libmachine: (old-k8s-version-919612) <model type='virtio'/>
I0429 19:55:55.943248 62888 main.go:141] libmachine: (old-k8s-version-919612) </interface>
I0429 19:55:55.943261 62888 main.go:141] libmachine: (old-k8s-version-919612) <interface type='network'>
I0429 19:55:55.943274 62888 main.go:141] libmachine: (old-k8s-version-919612) <source network='default'/>
I0429 19:55:55.943288 62888 main.go:141] libmachine: (old-k8s-version-919612) <model type='virtio'/>
I0429 19:55:55.943302 62888 main.go:141] libmachine: (old-k8s-version-919612) </interface>
I0429 19:55:55.943312 62888 main.go:141] libmachine: (old-k8s-version-919612) <serial type='pty'>
I0429 19:55:55.943325 62888 main.go:141] libmachine: (old-k8s-version-919612) <target port='0'/>
I0429 19:55:55.943336 62888 main.go:141] libmachine: (old-k8s-version-919612) </serial>
I0429 19:55:55.943349 62888 main.go:141] libmachine: (old-k8s-version-919612) <console type='pty'>
I0429 19:55:55.943383 62888 main.go:141] libmachine: (old-k8s-version-919612) <target type='serial' port='0'/>
I0429 19:55:55.943395 62888 main.go:141] libmachine: (old-k8s-version-919612) </console>
I0429 19:55:55.943407 62888 main.go:141] libmachine: (old-k8s-version-919612) <rng model='virtio'>
I0429 19:55:55.943421 62888 main.go:141] libmachine: (old-k8s-version-919612) <backend model='random'>/dev/random</backend>
I0429 19:55:55.943432 62888 main.go:141] libmachine: (old-k8s-version-919612) </rng>
I0429 19:55:55.943444 62888 main.go:141] libmachine: (old-k8s-version-919612)
I0429 19:55:55.943459 62888 main.go:141] libmachine: (old-k8s-version-919612)
I0429 19:55:55.943471 62888 main.go:141] libmachine: (old-k8s-version-919612) </devices>
I0429 19:55:55.943479 62888 main.go:141] libmachine: (old-k8s-version-919612) </domain>
I0429 19:55:55.943494 62888 main.go:141] libmachine: (old-k8s-version-919612)
I0429 19:55:55.948270 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined MAC address 52:54:00:fa:ca:94 in network default
I0429 19:55:55.948904 62888 main.go:141] libmachine: (old-k8s-version-919612) Ensuring networks are active...
I0429 19:55:55.948934 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:55:55.949846 62888 main.go:141] libmachine: (old-k8s-version-919612) Ensuring network default is active
I0429 19:55:55.950299 62888 main.go:141] libmachine: (old-k8s-version-919612) Ensuring network mk-old-k8s-version-919612 is active
I0429 19:55:55.951107 62888 main.go:141] libmachine: (old-k8s-version-919612) Getting domain xml...
I0429 19:55:55.951978 62888 main.go:141] libmachine: (old-k8s-version-919612) Creating domain...
I0429 19:55:57.387899 62888 main.go:141] libmachine: (old-k8s-version-919612) Waiting to get IP...
I0429 19:55:57.390403 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:55:57.390938 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | unable to find current IP address of domain old-k8s-version-919612 in network mk-old-k8s-version-919612
I0429 19:55:57.390966 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | I0429 19:55:57.390908 63060 retry.go:31] will retry after 280.300742ms: waiting for machine to come up
I0429 19:55:57.672762 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:55:57.673391 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | unable to find current IP address of domain old-k8s-version-919612 in network mk-old-k8s-version-919612
I0429 19:55:57.673418 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | I0429 19:55:57.673358 63060 retry.go:31] will retry after 291.215164ms: waiting for machine to come up
I0429 19:55:57.966096 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:55:57.966641 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | unable to find current IP address of domain old-k8s-version-919612 in network mk-old-k8s-version-919612
I0429 19:55:57.966665 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | I0429 19:55:57.966595 63060 retry.go:31] will retry after 402.673306ms: waiting for machine to come up
I0429 19:55:58.375265 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:55:58.375848 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | unable to find current IP address of domain old-k8s-version-919612 in network mk-old-k8s-version-919612
I0429 19:55:58.375883 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | I0429 19:55:58.375766 63060 retry.go:31] will retry after 490.470188ms: waiting for machine to come up
I0429 19:55:59.306828 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:55:59.310629 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | unable to find current IP address of domain old-k8s-version-919612 in network mk-old-k8s-version-919612
I0429 19:55:59.310654 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | I0429 19:55:59.310577 63060 retry.go:31] will retry after 507.284008ms: waiting for machine to come up
I0429 19:55:59.819194 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:55:59.820459 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | unable to find current IP address of domain old-k8s-version-919612 in network mk-old-k8s-version-919612
I0429 19:55:59.820543 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | I0429 19:55:59.820382 63060 retry.go:31] will retry after 697.044073ms: waiting for machine to come up
I0429 19:56:00.519516 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:56:00.520079 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | unable to find current IP address of domain old-k8s-version-919612 in network mk-old-k8s-version-919612
I0429 19:56:00.520112 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | I0429 19:56:00.520024 63060 retry.go:31] will retry after 1.102679954s: waiting for machine to come up
I0429 19:56:01.624838 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:56:01.625440 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | unable to find current IP address of domain old-k8s-version-919612 in network mk-old-k8s-version-919612
I0429 19:56:01.625476 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | I0429 19:56:01.625383 63060 retry.go:31] will retry after 1.417552686s: waiting for machine to come up
I0429 19:56:03.045209 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:56:03.045663 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | unable to find current IP address of domain old-k8s-version-919612 in network mk-old-k8s-version-919612
I0429 19:56:03.045694 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | I0429 19:56:03.045617 63060 retry.go:31] will retry after 1.791344377s: waiting for machine to come up
I0429 19:56:04.839108 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:56:04.839574 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | unable to find current IP address of domain old-k8s-version-919612 in network mk-old-k8s-version-919612
I0429 19:56:04.839597 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | I0429 19:56:04.839531 63060 retry.go:31] will retry after 2.243676251s: waiting for machine to come up
I0429 19:56:07.085481 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:56:07.086146 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | unable to find current IP address of domain old-k8s-version-919612 in network mk-old-k8s-version-919612
I0429 19:56:07.086181 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | I0429 19:56:07.086092 63060 retry.go:31] will retry after 2.237183655s: waiting for machine to come up
I0429 19:56:09.325646 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:56:09.326165 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | unable to find current IP address of domain old-k8s-version-919612 in network mk-old-k8s-version-919612
I0429 19:56:09.326195 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | I0429 19:56:09.326146 63060 retry.go:31] will retry after 3.104706047s: waiting for machine to come up
I0429 19:56:12.432166 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:56:12.432639 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | unable to find current IP address of domain old-k8s-version-919612 in network mk-old-k8s-version-919612
I0429 19:56:12.432661 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | I0429 19:56:12.432601 63060 retry.go:31] will retry after 4.512994972s: waiting for machine to come up
I0429 19:56:16.947076 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:56:16.947563 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | unable to find current IP address of domain old-k8s-version-919612 in network mk-old-k8s-version-919612
I0429 19:56:16.947583 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | I0429 19:56:16.947528 63060 retry.go:31] will retry after 5.09713301s: waiting for machine to come up
I0429 19:56:22.046159 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:56:22.046823 62888 main.go:141] libmachine: (old-k8s-version-919612) Found IP for machine: 192.168.72.240
I0429 19:56:22.046872 62888 main.go:141] libmachine: (old-k8s-version-919612) Reserving static IP address...
I0429 19:56:22.046888 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has current primary IP address 192.168.72.240 and MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:56:22.047269 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-919612", mac: "52:54:00:62:23:ed", ip: "192.168.72.240"} in network mk-old-k8s-version-919612
I0429 19:56:22.125804 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | Getting to WaitForSSH function...
I0429 19:56:22.125827 62888 main.go:141] libmachine: (old-k8s-version-919612) Reserved static IP address: 192.168.72.240
I0429 19:56:22.125869 62888 main.go:141] libmachine: (old-k8s-version-919612) Waiting for SSH to be available...
I0429 19:56:22.128650 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:56:22.128992 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | unable to find host DHCP lease matching {name: "", mac: "52:54:00:62:23:ed", ip: ""} in network mk-old-k8s-version-919612
I0429 19:56:22.129023 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | unable to find defined IP address of network mk-old-k8s-version-919612 interface with MAC address 52:54:00:62:23:ed
I0429 19:56:22.129131 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | Using SSH client type: external
I0429 19:56:22.129158 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | Using SSH private key: /home/jenkins/minikube-integration/18774-7754/.minikube/machines/old-k8s-version-919612/id_rsa (-rw-------)
I0429 19:56:22.129206 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@ -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/18774-7754/.minikube/machines/old-k8s-version-919612/id_rsa -p 22] /usr/bin/ssh <nil>}
I0429 19:56:22.129234 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | About to run SSH command:
I0429 19:56:22.129275 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | exit 0
I0429 19:56:22.132839 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | SSH cmd err, output: exit status 255:
I0429 19:56:22.132861 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | Error getting ssh command 'exit 0' : ssh command error:
I0429 19:56:22.132869 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | command : exit 0
I0429 19:56:22.132877 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | err : exit status 255
I0429 19:56:22.132884 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | output :
I0429 19:56:25.133065 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | Getting to WaitForSSH function...
I0429 19:56:25.135653 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:56:25.136026 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:62:23:ed", ip: ""} in network mk-old-k8s-version-919612: {Iface:virbr4 ExpiryTime:2024-04-29 20:56:12 +0000 UTC Type:0 Mac:52:54:00:62:23:ed Iaid: IPaddr:192.168.72.240 Prefix:24 Hostname:old-k8s-version-919612 Clientid:01:52:54:00:62:23:ed}
I0429 19:56:25.136059 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined IP address 192.168.72.240 and MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:56:25.136229 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | Using SSH client type: external
I0429 19:56:25.136264 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | Using SSH private key: /home/jenkins/minikube-integration/18774-7754/.minikube/machines/old-k8s-version-919612/id_rsa (-rw-------)
I0429 19:56:25.136289 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.72.240 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/18774-7754/.minikube/machines/old-k8s-version-919612/id_rsa -p 22] /usr/bin/ssh <nil>}
I0429 19:56:25.136299 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | About to run SSH command:
I0429 19:56:25.136309 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | exit 0
I0429 19:56:25.262624 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | SSH cmd err, output: <nil>:
I0429 19:56:25.262917 62888 main.go:141] libmachine: (old-k8s-version-919612) KVM machine creation complete!
I0429 19:56:25.263181 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetConfigRaw
I0429 19:56:25.263720 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .DriverName
I0429 19:56:25.263914 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .DriverName
I0429 19:56:25.264131 62888 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0429 19:56:25.264147 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetState
I0429 19:56:25.265396 62888 main.go:141] libmachine: Detecting operating system of created instance...
I0429 19:56:25.265409 62888 main.go:141] libmachine: Waiting for SSH to be available...
I0429 19:56:25.265414 62888 main.go:141] libmachine: Getting to WaitForSSH function...
I0429 19:56:25.265421 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetSSHHostname
I0429 19:56:25.267599 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:56:25.267868 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:62:23:ed", ip: ""} in network mk-old-k8s-version-919612: {Iface:virbr4 ExpiryTime:2024-04-29 20:56:12 +0000 UTC Type:0 Mac:52:54:00:62:23:ed Iaid: IPaddr:192.168.72.240 Prefix:24 Hostname:old-k8s-version-919612 Clientid:01:52:54:00:62:23:ed}
I0429 19:56:25.267894 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined IP address 192.168.72.240 and MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:56:25.267999 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetSSHPort
I0429 19:56:25.268163 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetSSHKeyPath
I0429 19:56:25.268312 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetSSHKeyPath
I0429 19:56:25.268437 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetSSHUsername
I0429 19:56:25.268642 62888 main.go:141] libmachine: Using SSH client type: native
I0429 19:56:25.268832 62888 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.72.240 22 <nil> <nil>}
I0429 19:56:25.268843 62888 main.go:141] libmachine: About to run SSH command:
exit 0
I0429 19:56:25.377802 62888 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0429 19:56:25.377829 62888 main.go:141] libmachine: Detecting the provisioner...
I0429 19:56:25.377839 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetSSHHostname
I0429 19:56:25.380587 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:56:25.380879 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:62:23:ed", ip: ""} in network mk-old-k8s-version-919612: {Iface:virbr4 ExpiryTime:2024-04-29 20:56:12 +0000 UTC Type:0 Mac:52:54:00:62:23:ed Iaid: IPaddr:192.168.72.240 Prefix:24 Hostname:old-k8s-version-919612 Clientid:01:52:54:00:62:23:ed}
I0429 19:56:25.380907 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined IP address 192.168.72.240 and MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:56:25.381184 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetSSHPort
I0429 19:56:25.381422 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetSSHKeyPath
I0429 19:56:25.381607 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetSSHKeyPath
I0429 19:56:25.381803 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetSSHUsername
I0429 19:56:25.381968 62888 main.go:141] libmachine: Using SSH client type: native
I0429 19:56:25.382165 62888 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.72.240 22 <nil> <nil>}
I0429 19:56:25.382183 62888 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0429 19:56:25.491521 62888 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0429 19:56:25.491604 62888 main.go:141] libmachine: found compatible host: buildroot
I0429 19:56:25.491619 62888 main.go:141] libmachine: Provisioning with buildroot...
I0429 19:56:25.491634 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetMachineName
I0429 19:56:25.491888 62888 buildroot.go:166] provisioning hostname "old-k8s-version-919612"
I0429 19:56:25.491920 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetMachineName
I0429 19:56:25.492127 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetSSHHostname
I0429 19:56:25.494890 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:56:25.495264 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:62:23:ed", ip: ""} in network mk-old-k8s-version-919612: {Iface:virbr4 ExpiryTime:2024-04-29 20:56:12 +0000 UTC Type:0 Mac:52:54:00:62:23:ed Iaid: IPaddr:192.168.72.240 Prefix:24 Hostname:old-k8s-version-919612 Clientid:01:52:54:00:62:23:ed}
I0429 19:56:25.495292 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined IP address 192.168.72.240 and MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:56:25.495462 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetSSHPort
I0429 19:56:25.495667 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetSSHKeyPath
I0429 19:56:25.495837 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetSSHKeyPath
I0429 19:56:25.495957 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetSSHUsername
I0429 19:56:25.496114 62888 main.go:141] libmachine: Using SSH client type: native
I0429 19:56:25.496309 62888 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.72.240 22 <nil> <nil>}
I0429 19:56:25.496325 62888 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-919612 && echo "old-k8s-version-919612" | sudo tee /etc/hostname
I0429 19:56:25.623635 62888 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-919612
I0429 19:56:25.623660 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetSSHHostname
I0429 19:56:25.626547 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:56:25.626947 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:62:23:ed", ip: ""} in network mk-old-k8s-version-919612: {Iface:virbr4 ExpiryTime:2024-04-29 20:56:12 +0000 UTC Type:0 Mac:52:54:00:62:23:ed Iaid: IPaddr:192.168.72.240 Prefix:24 Hostname:old-k8s-version-919612 Clientid:01:52:54:00:62:23:ed}
I0429 19:56:25.626981 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined IP address 192.168.72.240 and MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:56:25.627167 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetSSHPort
I0429 19:56:25.627351 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetSSHKeyPath
I0429 19:56:25.627536 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetSSHKeyPath
I0429 19:56:25.627670 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetSSHUsername
I0429 19:56:25.627824 62888 main.go:141] libmachine: Using SSH client type: native
I0429 19:56:25.627985 62888 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.72.240 22 <nil> <nil>}
I0429 19:56:25.628002 62888 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-919612' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-919612/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-919612' | sudo tee -a /etc/hosts;
fi
fi
I0429 19:56:25.750618 62888 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0429 19:56:25.750658 62888 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/18774-7754/.minikube CaCertPath:/home/jenkins/minikube-integration/18774-7754/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18774-7754/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18774-7754/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18774-7754/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18774-7754/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18774-7754/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18774-7754/.minikube}
I0429 19:56:25.750692 62888 buildroot.go:174] setting up certificates
I0429 19:56:25.750701 62888 provision.go:84] configureAuth start
I0429 19:56:25.750710 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetMachineName
I0429 19:56:25.751003 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetIP
I0429 19:56:25.753798 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:56:25.754309 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:62:23:ed", ip: ""} in network mk-old-k8s-version-919612: {Iface:virbr4 ExpiryTime:2024-04-29 20:56:12 +0000 UTC Type:0 Mac:52:54:00:62:23:ed Iaid: IPaddr:192.168.72.240 Prefix:24 Hostname:old-k8s-version-919612 Clientid:01:52:54:00:62:23:ed}
I0429 19:56:25.754334 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined IP address 192.168.72.240 and MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:56:25.754539 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetSSHHostname
I0429 19:56:25.757195 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:56:25.757537 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:62:23:ed", ip: ""} in network mk-old-k8s-version-919612: {Iface:virbr4 ExpiryTime:2024-04-29 20:56:12 +0000 UTC Type:0 Mac:52:54:00:62:23:ed Iaid: IPaddr:192.168.72.240 Prefix:24 Hostname:old-k8s-version-919612 Clientid:01:52:54:00:62:23:ed}
I0429 19:56:25.757562 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined IP address 192.168.72.240 and MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:56:25.757727 62888 provision.go:143] copyHostCerts
I0429 19:56:25.757780 62888 exec_runner.go:144] found /home/jenkins/minikube-integration/18774-7754/.minikube/ca.pem, removing ...
I0429 19:56:25.757790 62888 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18774-7754/.minikube/ca.pem
I0429 19:56:25.757843 62888 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18774-7754/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18774-7754/.minikube/ca.pem (1082 bytes)
I0429 19:56:25.757941 62888 exec_runner.go:144] found /home/jenkins/minikube-integration/18774-7754/.minikube/cert.pem, removing ...
I0429 19:56:25.757951 62888 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18774-7754/.minikube/cert.pem
I0429 19:56:25.757984 62888 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18774-7754/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18774-7754/.minikube/cert.pem (1123 bytes)
I0429 19:56:25.758126 62888 exec_runner.go:144] found /home/jenkins/minikube-integration/18774-7754/.minikube/key.pem, removing ...
I0429 19:56:25.758138 62888 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18774-7754/.minikube/key.pem
I0429 19:56:25.758176 62888 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18774-7754/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18774-7754/.minikube/key.pem (1675 bytes)
I0429 19:56:25.758263 62888 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18774-7754/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18774-7754/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18774-7754/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-919612 san=[127.0.0.1 192.168.72.240 localhost minikube old-k8s-version-919612]
I0429 19:56:25.962146 62888 provision.go:177] copyRemoteCerts
I0429 19:56:25.962251 62888 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0429 19:56:25.962290 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetSSHHostname
I0429 19:56:25.965319 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:56:25.965711 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:62:23:ed", ip: ""} in network mk-old-k8s-version-919612: {Iface:virbr4 ExpiryTime:2024-04-29 20:56:12 +0000 UTC Type:0 Mac:52:54:00:62:23:ed Iaid: IPaddr:192.168.72.240 Prefix:24 Hostname:old-k8s-version-919612 Clientid:01:52:54:00:62:23:ed}
I0429 19:56:25.965739 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined IP address 192.168.72.240 and MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:56:25.966009 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetSSHPort
I0429 19:56:25.966212 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetSSHKeyPath
I0429 19:56:25.966402 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetSSHUsername
I0429 19:56:25.966536 62888 sshutil.go:53] new ssh client: &{IP:192.168.72.240 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18774-7754/.minikube/machines/old-k8s-version-919612/id_rsa Username:docker}
I0429 19:56:26.053624 62888 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18774-7754/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0429 19:56:26.082358 62888 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18774-7754/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0429 19:56:26.109913 62888 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18774-7754/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0429 19:56:26.138690 62888 provision.go:87] duration metric: took 387.978089ms to configureAuth
I0429 19:56:26.138719 62888 buildroot.go:189] setting minikube options for container-runtime
I0429 19:56:26.138906 62888 config.go:182] Loaded profile config "old-k8s-version-919612": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0429 19:56:26.138976 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetSSHHostname
I0429 19:56:26.141472 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:56:26.141830 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:62:23:ed", ip: ""} in network mk-old-k8s-version-919612: {Iface:virbr4 ExpiryTime:2024-04-29 20:56:12 +0000 UTC Type:0 Mac:52:54:00:62:23:ed Iaid: IPaddr:192.168.72.240 Prefix:24 Hostname:old-k8s-version-919612 Clientid:01:52:54:00:62:23:ed}
I0429 19:56:26.141862 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined IP address 192.168.72.240 and MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:56:26.142008 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetSSHPort
I0429 19:56:26.142256 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetSSHKeyPath
I0429 19:56:26.142432 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetSSHKeyPath
I0429 19:56:26.142604 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetSSHUsername
I0429 19:56:26.142789 62888 main.go:141] libmachine: Using SSH client type: native
I0429 19:56:26.142967 62888 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.72.240 22 <nil> <nil>}
I0429 19:56:26.142989 62888 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0429 19:56:26.627617 62888 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0429 19:56:26.627652 62888 main.go:141] libmachine: Checking connection to Docker...
I0429 19:56:26.627660 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetURL
I0429 19:56:26.628908 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | Using libvirt version 6000000
I0429 19:56:26.630904 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:56:26.631210 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:62:23:ed", ip: ""} in network mk-old-k8s-version-919612: {Iface:virbr4 ExpiryTime:2024-04-29 20:56:12 +0000 UTC Type:0 Mac:52:54:00:62:23:ed Iaid: IPaddr:192.168.72.240 Prefix:24 Hostname:old-k8s-version-919612 Clientid:01:52:54:00:62:23:ed}
I0429 19:56:26.631232 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined IP address 192.168.72.240 and MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:56:26.631444 62888 main.go:141] libmachine: Docker is up and running!
I0429 19:56:26.631461 62888 main.go:141] libmachine: Reticulating splines...
I0429 19:56:26.631485 62888 client.go:171] duration metric: took 31.105029903s to LocalClient.Create
I0429 19:56:26.631515 62888 start.go:167] duration metric: took 31.105148949s to libmachine.API.Create "old-k8s-version-919612"
I0429 19:56:26.631527 62888 start.go:293] postStartSetup for "old-k8s-version-919612" (driver="kvm2")
I0429 19:56:26.631540 62888 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0429 19:56:26.631556 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .DriverName
I0429 19:56:26.631815 62888 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0429 19:56:26.631847 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetSSHHostname
I0429 19:56:26.634016 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:56:26.634543 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:62:23:ed", ip: ""} in network mk-old-k8s-version-919612: {Iface:virbr4 ExpiryTime:2024-04-29 20:56:12 +0000 UTC Type:0 Mac:52:54:00:62:23:ed Iaid: IPaddr:192.168.72.240 Prefix:24 Hostname:old-k8s-version-919612 Clientid:01:52:54:00:62:23:ed}
I0429 19:56:26.634579 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined IP address 192.168.72.240 and MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:56:26.634716 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetSSHPort
I0429 19:56:26.634935 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetSSHKeyPath
I0429 19:56:26.635107 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetSSHUsername
I0429 19:56:26.635242 62888 sshutil.go:53] new ssh client: &{IP:192.168.72.240 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18774-7754/.minikube/machines/old-k8s-version-919612/id_rsa Username:docker}
I0429 19:56:26.721699 62888 ssh_runner.go:195] Run: cat /etc/os-release
I0429 19:56:26.726944 62888 info.go:137] Remote host: Buildroot 2023.02.9
I0429 19:56:26.726977 62888 filesync.go:126] Scanning /home/jenkins/minikube-integration/18774-7754/.minikube/addons for local assets ...
I0429 19:56:26.727063 62888 filesync.go:126] Scanning /home/jenkins/minikube-integration/18774-7754/.minikube/files for local assets ...
I0429 19:56:26.727134 62888 filesync.go:149] local asset: /home/jenkins/minikube-integration/18774-7754/.minikube/files/etc/ssl/certs/151242.pem -> 151242.pem in /etc/ssl/certs
I0429 19:56:26.727218 62888 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0429 19:56:26.738223 62888 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18774-7754/.minikube/files/etc/ssl/certs/151242.pem --> /etc/ssl/certs/151242.pem (1708 bytes)
I0429 19:56:26.766896 62888 start.go:296] duration metric: took 135.354022ms for postStartSetup
I0429 19:56:26.766944 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetConfigRaw
I0429 19:56:26.767604 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetIP
I0429 19:56:26.770213 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:56:26.770560 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:62:23:ed", ip: ""} in network mk-old-k8s-version-919612: {Iface:virbr4 ExpiryTime:2024-04-29 20:56:12 +0000 UTC Type:0 Mac:52:54:00:62:23:ed Iaid: IPaddr:192.168.72.240 Prefix:24 Hostname:old-k8s-version-919612 Clientid:01:52:54:00:62:23:ed}
I0429 19:56:26.770591 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined IP address 192.168.72.240 and MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:56:26.770788 62888 profile.go:143] Saving config to /home/jenkins/minikube-integration/18774-7754/.minikube/profiles/old-k8s-version-919612/config.json ...
I0429 19:56:26.770970 62888 start.go:128] duration metric: took 31.267018682s to createHost
I0429 19:56:26.770989 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetSSHHostname
I0429 19:56:26.773125 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:56:26.773422 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:62:23:ed", ip: ""} in network mk-old-k8s-version-919612: {Iface:virbr4 ExpiryTime:2024-04-29 20:56:12 +0000 UTC Type:0 Mac:52:54:00:62:23:ed Iaid: IPaddr:192.168.72.240 Prefix:24 Hostname:old-k8s-version-919612 Clientid:01:52:54:00:62:23:ed}
I0429 19:56:26.773450 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined IP address 192.168.72.240 and MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:56:26.773561 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetSSHPort
I0429 19:56:26.773746 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetSSHKeyPath
I0429 19:56:26.773898 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetSSHKeyPath
I0429 19:56:26.774094 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetSSHUsername
I0429 19:56:26.774329 62888 main.go:141] libmachine: Using SSH client type: native
I0429 19:56:26.774517 62888 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.72.240 22 <nil> <nil>}
I0429 19:56:26.774531 62888 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0429 19:56:26.883196 62888 main.go:141] libmachine: SSH cmd err, output: <nil>: 1714420586.872512332
I0429 19:56:26.883224 62888 fix.go:216] guest clock: 1714420586.872512332
I0429 19:56:26.883233 62888 fix.go:229] Guest: 2024-04-29 19:56:26.872512332 +0000 UTC Remote: 2024-04-29 19:56:26.770981511 +0000 UTC m=+45.442605977 (delta=101.530821ms)
I0429 19:56:26.883280 62888 fix.go:200] guest clock delta is within tolerance: 101.530821ms
I0429 19:56:26.883290 62888 start.go:83] releasing machines lock for "old-k8s-version-919612", held for 31.379544753s
I0429 19:56:26.883319 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .DriverName
I0429 19:56:26.883568 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetIP
I0429 19:56:26.886403 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:56:26.886825 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:62:23:ed", ip: ""} in network mk-old-k8s-version-919612: {Iface:virbr4 ExpiryTime:2024-04-29 20:56:12 +0000 UTC Type:0 Mac:52:54:00:62:23:ed Iaid: IPaddr:192.168.72.240 Prefix:24 Hostname:old-k8s-version-919612 Clientid:01:52:54:00:62:23:ed}
I0429 19:56:26.886847 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined IP address 192.168.72.240 and MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:56:26.886933 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .DriverName
I0429 19:56:26.887392 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .DriverName
I0429 19:56:26.887589 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .DriverName
I0429 19:56:26.887709 62888 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0429 19:56:26.887747 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetSSHHostname
I0429 19:56:26.887847 62888 ssh_runner.go:195] Run: cat /version.json
I0429 19:56:26.887875 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetSSHHostname
I0429 19:56:26.890373 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:56:26.890724 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:56:26.890770 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:62:23:ed", ip: ""} in network mk-old-k8s-version-919612: {Iface:virbr4 ExpiryTime:2024-04-29 20:56:12 +0000 UTC Type:0 Mac:52:54:00:62:23:ed Iaid: IPaddr:192.168.72.240 Prefix:24 Hostname:old-k8s-version-919612 Clientid:01:52:54:00:62:23:ed}
I0429 19:56:26.890801 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined IP address 192.168.72.240 and MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:56:26.890889 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetSSHPort
I0429 19:56:26.891056 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetSSHKeyPath
I0429 19:56:26.891108 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:62:23:ed", ip: ""} in network mk-old-k8s-version-919612: {Iface:virbr4 ExpiryTime:2024-04-29 20:56:12 +0000 UTC Type:0 Mac:52:54:00:62:23:ed Iaid: IPaddr:192.168.72.240 Prefix:24 Hostname:old-k8s-version-919612 Clientid:01:52:54:00:62:23:ed}
I0429 19:56:26.891185 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined IP address 192.168.72.240 and MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:56:26.891210 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetSSHUsername
I0429 19:56:26.891293 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetSSHPort
I0429 19:56:26.891399 62888 sshutil.go:53] new ssh client: &{IP:192.168.72.240 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18774-7754/.minikube/machines/old-k8s-version-919612/id_rsa Username:docker}
I0429 19:56:26.891465 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetSSHKeyPath
I0429 19:56:26.891775 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetSSHUsername
I0429 19:56:26.891964 62888 sshutil.go:53] new ssh client: &{IP:192.168.72.240 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18774-7754/.minikube/machines/old-k8s-version-919612/id_rsa Username:docker}
I0429 19:56:26.983911 62888 ssh_runner.go:195] Run: systemctl --version
I0429 19:56:27.008945 62888 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0429 19:56:27.180421 62888 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0429 19:56:27.189045 62888 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0429 19:56:27.189109 62888 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0429 19:56:27.209126 62888 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0429 19:56:27.209150 62888 start.go:494] detecting cgroup driver to use...
I0429 19:56:27.209222 62888 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0429 19:56:27.234243 62888 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0429 19:56:27.251269 62888 docker.go:217] disabling cri-docker service (if available) ...
I0429 19:56:27.251331 62888 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0429 19:56:27.269261 62888 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0429 19:56:27.286977 62888 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0429 19:56:27.433333 62888 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0429 19:56:27.606087 62888 docker.go:233] disabling docker service ...
I0429 19:56:27.606161 62888 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0429 19:56:27.622921 62888 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0429 19:56:27.637895 62888 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0429 19:56:27.773576 62888 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0429 19:56:27.907877 62888 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0429 19:56:27.923816 62888 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0429 19:56:27.945384 62888 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0429 19:56:27.945444 62888 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0429 19:56:27.962481 62888 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0429 19:56:27.962556 62888 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0429 19:56:27.975116 62888 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0429 19:56:27.989641 62888 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0429 19:56:28.003330 62888 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0429 19:56:28.016470 62888 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0429 19:56:28.028465 62888 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0429 19:56:28.028529 62888 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0429 19:56:28.045760 62888 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0429 19:56:28.058116 62888 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0429 19:56:28.183872 62888 ssh_runner.go:195] Run: sudo systemctl restart crio
I0429 19:56:28.342816 62888 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0429 19:56:28.342894 62888 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0429 19:56:28.348719 62888 start.go:562] Will wait 60s for crictl version
I0429 19:56:28.348779 62888 ssh_runner.go:195] Run: which crictl
I0429 19:56:28.353302 62888 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0429 19:56:28.400093 62888 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0429 19:56:28.400242 62888 ssh_runner.go:195] Run: crio --version
I0429 19:56:28.433168 62888 ssh_runner.go:195] Run: crio --version
I0429 19:56:28.469665 62888 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0429 19:56:28.471177 62888 main.go:141] libmachine: (old-k8s-version-919612) Calling .GetIP
I0429 19:56:28.473933 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:56:28.474407 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:62:23:ed", ip: ""} in network mk-old-k8s-version-919612: {Iface:virbr4 ExpiryTime:2024-04-29 20:56:12 +0000 UTC Type:0 Mac:52:54:00:62:23:ed Iaid: IPaddr:192.168.72.240 Prefix:24 Hostname:old-k8s-version-919612 Clientid:01:52:54:00:62:23:ed}
I0429 19:56:28.474449 62888 main.go:141] libmachine: (old-k8s-version-919612) DBG | domain old-k8s-version-919612 has defined IP address 192.168.72.240 and MAC address 52:54:00:62:23:ed in network mk-old-k8s-version-919612
I0429 19:56:28.474552 62888 ssh_runner.go:195] Run: grep 192.168.72.1 host.minikube.internal$ /etc/hosts
I0429 19:56:28.479800 62888 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.72.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0429 19:56:28.494616 62888 kubeadm.go:877] updating cluster {Name:old-k8s-version-919612 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18706/minikube-v1.33.0-1713736271-18706-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-919612 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.240 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] M
ountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0429 19:56:28.494749 62888 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0429 19:56:28.494816 62888 ssh_runner.go:195] Run: sudo crictl images --output json
I0429 19:56:28.531977 62888 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0429 19:56:28.532078 62888 ssh_runner.go:195] Run: which lz4
I0429 19:56:28.537024 62888 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0429 19:56:28.544977 62888 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0429 19:56:28.545031 62888 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18774-7754/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0429 19:56:30.693374 62888 crio.go:462] duration metric: took 2.156405851s to copy over tarball
I0429 19:56:30.693469 62888 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0429 19:56:33.667061 62888 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.97356499s)
I0429 19:56:33.667088 62888 crio.go:469] duration metric: took 2.973687952s to extract the tarball
I0429 19:56:33.667099 62888 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0429 19:56:33.724388 62888 ssh_runner.go:195] Run: sudo crictl images --output json
I0429 19:56:33.777190 62888 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0429 19:56:33.777227 62888 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0429 19:56:33.777307 62888 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0429 19:56:33.777330 62888 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0429 19:56:33.777342 62888 image.go:134] retrieving image: registry.k8s.io/pause:3.2
I0429 19:56:33.777347 62888 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0429 19:56:33.777319 62888 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0429 19:56:33.777389 62888 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0429 19:56:33.777607 62888 image.go:134] retrieving image: registry.k8s.io/coredns:1.7.0
I0429 19:56:33.777688 62888 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0429 19:56:33.779132 62888 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0429 19:56:33.779165 62888 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0429 19:56:33.779178 62888 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0429 19:56:33.779134 62888 image.go:177] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0429 19:56:33.779223 62888 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0429 19:56:33.779238 62888 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0429 19:56:33.779282 62888 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0429 19:56:33.779469 62888 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0429 19:56:33.925148 62888 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0429 19:56:33.951644 62888 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0429 19:56:33.972754 62888 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0429 19:56:33.972821 62888 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0429 19:56:33.972877 62888 ssh_runner.go:195] Run: which crictl
I0429 19:56:34.007093 62888 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0429 19:56:34.010555 62888 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0429 19:56:34.017884 62888 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0429 19:56:34.017931 62888 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0429 19:56:34.017974 62888 ssh_runner.go:195] Run: which crictl
I0429 19:56:34.017979 62888 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0429 19:56:34.085903 62888 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0429 19:56:34.085954 62888 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0429 19:56:34.086009 62888 ssh_runner.go:195] Run: which crictl
I0429 19:56:34.093425 62888 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0429 19:56:34.093511 62888 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0429 19:56:34.093555 62888 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0429 19:56:34.093598 62888 ssh_runner.go:195] Run: which crictl
I0429 19:56:34.118110 62888 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0429 19:56:34.118241 62888 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18774-7754/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0429 19:56:34.154353 62888 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0429 19:56:34.156613 62888 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0429 19:56:34.164264 62888 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0429 19:56:34.166785 62888 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18774-7754/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0429 19:56:34.166881 62888 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0429 19:56:34.218451 62888 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18774-7754/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0429 19:56:34.271019 62888 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0429 19:56:34.271066 62888 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0429 19:56:34.271119 62888 ssh_runner.go:195] Run: which crictl
I0429 19:56:34.305237 62888 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0429 19:56:34.305284 62888 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0429 19:56:34.305334 62888 ssh_runner.go:195] Run: which crictl
I0429 19:56:34.319523 62888 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18774-7754/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0429 19:56:34.319526 62888 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0429 19:56:34.319586 62888 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0429 19:56:34.319617 62888 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0429 19:56:34.319621 62888 ssh_runner.go:195] Run: which crictl
I0429 19:56:34.319622 62888 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0429 19:56:34.379647 62888 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0429 19:56:34.379673 62888 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18774-7754/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0429 19:56:34.379725 62888 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18774-7754/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0429 19:56:34.427665 62888 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18774-7754/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0429 19:56:34.687909 62888 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0429 19:56:34.838461 62888 cache_images.go:92] duration metric: took 1.061213114s to LoadCachedImages
W0429 19:56:34.838579 62888 out.go:239] X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/18774-7754/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0: no such file or directory
X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/18774-7754/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0: no such file or directory
I0429 19:56:34.838598 62888 kubeadm.go:928] updating node { 192.168.72.240 8443 v1.20.0 crio true true} ...
I0429 19:56:34.838753 62888 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-919612 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.72.240
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-919612 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0429 19:56:34.838859 62888 ssh_runner.go:195] Run: crio config
I0429 19:56:34.897809 62888 cni.go:84] Creating CNI manager for ""
I0429 19:56:34.897838 62888 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0429 19:56:34.897852 62888 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0429 19:56:34.897882 62888 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.72.240 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-919612 NodeName:old-k8s-version-919612 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.72.240"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.72.240 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0429 19:56:34.898132 62888 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.72.240
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-919612"
kubeletExtraArgs:
node-ip: 192.168.72.240
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.72.240"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0429 19:56:34.898218 62888 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0429 19:56:34.909400 62888 binaries.go:44] Found k8s binaries, skipping transfer
I0429 19:56:34.909483 62888 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0429 19:56:34.920184 62888 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0429 19:56:34.940422 62888 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0429 19:56:34.963221 62888 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0429 19:56:34.986235 62888 ssh_runner.go:195] Run: grep 192.168.72.240 control-plane.minikube.internal$ /etc/hosts
I0429 19:56:34.991751 62888 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.72.240 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0429 19:56:35.007615 62888 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0429 19:56:35.145495 62888 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0429 19:56:35.165180 62888 certs.go:68] Setting up /home/jenkins/minikube-integration/18774-7754/.minikube/profiles/old-k8s-version-919612 for IP: 192.168.72.240
I0429 19:56:35.165208 62888 certs.go:194] generating shared ca certs ...
I0429 19:56:35.165228 62888 certs.go:226] acquiring lock for ca certs: {Name:mke4f887d1b12d48598531109a1f9d4e6514ee8a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0429 19:56:35.165404 62888 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18774-7754/.minikube/ca.key
I0429 19:56:35.165458 62888 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18774-7754/.minikube/proxy-client-ca.key
I0429 19:56:35.165475 62888 certs.go:256] generating profile certs ...
I0429 19:56:35.165542 62888 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/18774-7754/.minikube/profiles/old-k8s-version-919612/client.key
I0429 19:56:35.165556 62888 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18774-7754/.minikube/profiles/old-k8s-version-919612/client.crt with IP's: []
I0429 19:56:35.347880 62888 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18774-7754/.minikube/profiles/old-k8s-version-919612/client.crt ...
I0429 19:56:35.347912 62888 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18774-7754/.minikube/profiles/old-k8s-version-919612/client.crt: {Name:mk6442ec8b17aa42dbe10dd46dbdcc34fee9c27a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0429 19:56:35.348121 62888 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18774-7754/.minikube/profiles/old-k8s-version-919612/client.key ...
I0429 19:56:35.348140 62888 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18774-7754/.minikube/profiles/old-k8s-version-919612/client.key: {Name:mka0aa621ced8f0904786c7ee296415068ba02b5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0429 19:56:35.348264 62888 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/18774-7754/.minikube/profiles/old-k8s-version-919612/apiserver.key.5df5e618
I0429 19:56:35.348288 62888 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18774-7754/.minikube/profiles/old-k8s-version-919612/apiserver.crt.5df5e618 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.72.240]
I0429 19:56:35.573297 62888 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18774-7754/.minikube/profiles/old-k8s-version-919612/apiserver.crt.5df5e618 ...
I0429 19:56:35.573329 62888 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18774-7754/.minikube/profiles/old-k8s-version-919612/apiserver.crt.5df5e618: {Name:mk924ebe195f9c74d04386f1ee0ee36cc84e70db Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0429 19:56:35.573513 62888 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18774-7754/.minikube/profiles/old-k8s-version-919612/apiserver.key.5df5e618 ...
I0429 19:56:35.573530 62888 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18774-7754/.minikube/profiles/old-k8s-version-919612/apiserver.key.5df5e618: {Name:mk1d27f77af878d3f902e23fa9ec1445d6a0161c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0429 19:56:35.573630 62888 certs.go:381] copying /home/jenkins/minikube-integration/18774-7754/.minikube/profiles/old-k8s-version-919612/apiserver.crt.5df5e618 -> /home/jenkins/minikube-integration/18774-7754/.minikube/profiles/old-k8s-version-919612/apiserver.crt
I0429 19:56:35.573724 62888 certs.go:385] copying /home/jenkins/minikube-integration/18774-7754/.minikube/profiles/old-k8s-version-919612/apiserver.key.5df5e618 -> /home/jenkins/minikube-integration/18774-7754/.minikube/profiles/old-k8s-version-919612/apiserver.key
I0429 19:56:35.573802 62888 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/18774-7754/.minikube/profiles/old-k8s-version-919612/proxy-client.key
I0429 19:56:35.573821 62888 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18774-7754/.minikube/profiles/old-k8s-version-919612/proxy-client.crt with IP's: []
I0429 19:56:35.736196 62888 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18774-7754/.minikube/profiles/old-k8s-version-919612/proxy-client.crt ...
I0429 19:56:35.736224 62888 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18774-7754/.minikube/profiles/old-k8s-version-919612/proxy-client.crt: {Name:mke61a94e429e76eea3ec51f1094e24d62430950 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0429 19:56:35.736399 62888 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18774-7754/.minikube/profiles/old-k8s-version-919612/proxy-client.key ...
I0429 19:56:35.736416 62888 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18774-7754/.minikube/profiles/old-k8s-version-919612/proxy-client.key: {Name:mk346b12853a4171cdb3531b30de5c1498a7f1e9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0429 19:56:35.736579 62888 certs.go:484] found cert: /home/jenkins/minikube-integration/18774-7754/.minikube/certs/15124.pem (1338 bytes)
W0429 19:56:35.736620 62888 certs.go:480] ignoring /home/jenkins/minikube-integration/18774-7754/.minikube/certs/15124_empty.pem, impossibly tiny 0 bytes
I0429 19:56:35.736630 62888 certs.go:484] found cert: /home/jenkins/minikube-integration/18774-7754/.minikube/certs/ca-key.pem (1675 bytes)
I0429 19:56:35.736653 62888 certs.go:484] found cert: /home/jenkins/minikube-integration/18774-7754/.minikube/certs/ca.pem (1082 bytes)
I0429 19:56:35.736674 62888 certs.go:484] found cert: /home/jenkins/minikube-integration/18774-7754/.minikube/certs/cert.pem (1123 bytes)
I0429 19:56:35.736696 62888 certs.go:484] found cert: /home/jenkins/minikube-integration/18774-7754/.minikube/certs/key.pem (1675 bytes)
I0429 19:56:35.736730 62888 certs.go:484] found cert: /home/jenkins/minikube-integration/18774-7754/.minikube/files/etc/ssl/certs/151242.pem (1708 bytes)
I0429 19:56:35.737374 62888 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18774-7754/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0429 19:56:35.768632 62888 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18774-7754/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0429 19:56:35.803895 62888 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18774-7754/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0429 19:56:35.838928 62888 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18774-7754/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0429 19:56:35.876292 62888 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18774-7754/.minikube/profiles/old-k8s-version-919612/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0429 19:56:35.912520 62888 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18774-7754/.minikube/profiles/old-k8s-version-919612/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0429 19:56:35.942175 62888 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18774-7754/.minikube/profiles/old-k8s-version-919612/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0429 19:56:35.974567 62888 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18774-7754/.minikube/profiles/old-k8s-version-919612/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0429 19:56:36.008157 62888 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18774-7754/.minikube/certs/15124.pem --> /usr/share/ca-certificates/15124.pem (1338 bytes)
I0429 19:56:36.049185 62888 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18774-7754/.minikube/files/etc/ssl/certs/151242.pem --> /usr/share/ca-certificates/151242.pem (1708 bytes)
I0429 19:56:36.086352 62888 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18774-7754/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0429 19:56:36.119486 62888 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0429 19:56:36.140709 62888 ssh_runner.go:195] Run: openssl version
I0429 19:56:36.147731 62888 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0429 19:56:36.161251 62888 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0429 19:56:36.167024 62888 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Apr 29 18:40 /usr/share/ca-certificates/minikubeCA.pem
I0429 19:56:36.167095 62888 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0429 19:56:36.174106 62888 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0429 19:56:36.186614 62888 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/15124.pem && ln -fs /usr/share/ca-certificates/15124.pem /etc/ssl/certs/15124.pem"
I0429 19:56:36.198971 62888 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/15124.pem
I0429 19:56:36.204235 62888 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Apr 29 18:53 /usr/share/ca-certificates/15124.pem
I0429 19:56:36.204303 62888 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/15124.pem
I0429 19:56:36.210996 62888 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/15124.pem /etc/ssl/certs/51391683.0"
I0429 19:56:36.223145 62888 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/151242.pem && ln -fs /usr/share/ca-certificates/151242.pem /etc/ssl/certs/151242.pem"
I0429 19:56:36.234921 62888 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/151242.pem
I0429 19:56:36.239993 62888 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Apr 29 18:53 /usr/share/ca-certificates/151242.pem
I0429 19:56:36.240050 62888 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/151242.pem
I0429 19:56:36.247065 62888 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/151242.pem /etc/ssl/certs/3ec20f2e.0"
I0429 19:56:36.260335 62888 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0429 19:56:36.265396 62888 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0429 19:56:36.265463 62888 kubeadm.go:391] StartCluster: {Name:old-k8s-version-919612 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18706/minikube-v1.33.0-1713736271-18706-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-919612 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.240 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0429 19:56:36.265565 62888 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0429 19:56:36.265613 62888 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0429 19:56:36.308661 62888 cri.go:89] found id: ""
I0429 19:56:36.308735 62888 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0429 19:56:36.319640 62888 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0429 19:56:36.331438 62888 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0429 19:56:36.341926 62888 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0429 19:56:36.341944 62888 kubeadm.go:156] found existing configuration files:
I0429 19:56:36.341981 62888 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0429 19:56:36.352014 62888 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0429 19:56:36.352066 62888 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0429 19:56:36.363780 62888 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0429 19:56:36.374677 62888 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0429 19:56:36.374760 62888 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0429 19:56:36.386966 62888 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0429 19:56:36.398328 62888 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0429 19:56:36.398402 62888 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0429 19:56:36.409893 62888 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0429 19:56:36.420637 62888 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0429 19:56:36.420705 62888 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0429 19:56:36.432139 62888 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0429 19:56:36.550718 62888 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0429 19:56:36.550795 62888 kubeadm.go:309] [preflight] Running pre-flight checks
I0429 19:56:36.728981 62888 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0429 19:56:36.729111 62888 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0429 19:56:36.729242 62888 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0429 19:56:36.985527 62888 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0429 19:56:36.987330 62888 out.go:204] - Generating certificates and keys ...
I0429 19:56:36.987427 62888 kubeadm.go:309] [certs] Using existing ca certificate authority
I0429 19:56:36.987521 62888 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0429 19:56:37.118858 62888 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key
I0429 19:56:37.333089 62888 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key
I0429 19:56:37.496173 62888 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key
I0429 19:56:37.641895 62888 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key
I0429 19:56:37.873143 62888 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key
I0429 19:56:37.873528 62888 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-919612] and IPs [192.168.72.240 127.0.0.1 ::1]
I0429 19:56:38.271697 62888 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key
I0429 19:56:38.275435 62888 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-919612] and IPs [192.168.72.240 127.0.0.1 ::1]
I0429 19:56:38.660743 62888 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key
I0429 19:56:39.185264 62888 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key
I0429 19:56:39.473940 62888 kubeadm.go:309] [certs] Generating "sa" key and public key
I0429 19:56:39.474229 62888 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0429 19:56:39.859551 62888 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0429 19:56:40.022392 62888 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0429 19:56:40.836485 62888 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0429 19:56:41.102490 62888 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0429 19:56:41.121881 62888 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0429 19:56:41.123300 62888 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0429 19:56:41.123392 62888 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0429 19:56:41.286773 62888 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0429 19:56:41.288542 62888 out.go:204] - Booting up control plane ...
I0429 19:56:41.288652 62888 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0429 19:56:41.301600 62888 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0429 19:56:41.304419 62888 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0429 19:56:41.304492 62888 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0429 19:56:41.308498 62888 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0429 19:57:21.307942 62888 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0429 19:57:21.308668 62888 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0429 19:57:21.309037 62888 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0429 19:57:26.309655 62888 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0429 19:57:26.310111 62888 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0429 19:57:36.311240 62888 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0429 19:57:36.311522 62888 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0429 19:57:56.312127 62888 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0429 19:57:56.312384 62888 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0429 19:58:36.313502 62888 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0429 19:58:36.313785 62888 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0429 19:58:36.313799 62888 kubeadm.go:309]
I0429 19:58:36.313859 62888 kubeadm.go:309] Unfortunately, an error has occurred:
I0429 19:58:36.313917 62888 kubeadm.go:309] timed out waiting for the condition
I0429 19:58:36.313963 62888 kubeadm.go:309]
I0429 19:58:36.314030 62888 kubeadm.go:309] This error is likely caused by:
I0429 19:58:36.314101 62888 kubeadm.go:309] - The kubelet is not running
I0429 19:58:36.314282 62888 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0429 19:58:36.314302 62888 kubeadm.go:309]
I0429 19:58:36.314432 62888 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0429 19:58:36.314491 62888 kubeadm.go:309] - 'systemctl status kubelet'
I0429 19:58:36.314534 62888 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0429 19:58:36.314563 62888 kubeadm.go:309]
I0429 19:58:36.314762 62888 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0429 19:58:36.314909 62888 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0429 19:58:36.314924 62888 kubeadm.go:309]
I0429 19:58:36.315082 62888 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0429 19:58:36.315219 62888 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0429 19:58:36.315331 62888 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0429 19:58:36.315428 62888 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0429 19:58:36.315442 62888 kubeadm.go:309]
I0429 19:58:36.315832 62888 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0429 19:58:36.315961 62888 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0429 19:58:36.316059 62888 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
W0429 19:58:36.316251 62888 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-919612] and IPs [192.168.72.240 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-919612] and IPs [192.168.72.240 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-919612] and IPs [192.168.72.240 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-919612] and IPs [192.168.72.240 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0429 19:58:36.316326 62888 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0429 19:58:38.332099 62888 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (2.015744446s)
I0429 19:58:38.332172 62888 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0429 19:58:38.347419 62888 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0429 19:58:38.358162 62888 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0429 19:58:38.358187 62888 kubeadm.go:156] found existing configuration files:
I0429 19:58:38.358239 62888 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0429 19:58:38.368050 62888 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0429 19:58:38.368109 62888 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0429 19:58:38.378639 62888 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0429 19:58:38.391657 62888 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0429 19:58:38.391735 62888 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0429 19:58:38.403785 62888 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0429 19:58:38.415871 62888 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0429 19:58:38.415941 62888 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0429 19:58:38.427625 62888 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0429 19:58:38.438277 62888 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0429 19:58:38.438352 62888 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0429 19:58:38.448795 62888 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0429 19:58:38.684541 62888 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0429 20:00:34.672961 62888 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0429 20:00:34.673107 62888 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
I0429 20:00:34.674891 62888 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0429 20:00:34.674956 62888 kubeadm.go:309] [preflight] Running pre-flight checks
I0429 20:00:34.675025 62888 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0429 20:00:34.675105 62888 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0429 20:00:34.675279 62888 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0429 20:00:34.675377 62888 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0429 20:00:34.677183 62888 out.go:204] - Generating certificates and keys ...
I0429 20:00:34.677243 62888 kubeadm.go:309] [certs] Using existing ca certificate authority
I0429 20:00:34.677300 62888 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0429 20:00:34.677375 62888 kubeadm.go:309] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0429 20:00:34.677431 62888 kubeadm.go:309] [certs] Using existing front-proxy-ca certificate authority
I0429 20:00:34.677497 62888 kubeadm.go:309] [certs] Using existing front-proxy-client certificate and key on disk
I0429 20:00:34.677588 62888 kubeadm.go:309] [certs] Using existing etcd/ca certificate authority
I0429 20:00:34.677686 62888 kubeadm.go:309] [certs] Using existing etcd/server certificate and key on disk
I0429 20:00:34.677786 62888 kubeadm.go:309] [certs] Using existing etcd/peer certificate and key on disk
I0429 20:00:34.677900 62888 kubeadm.go:309] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0429 20:00:34.678015 62888 kubeadm.go:309] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0429 20:00:34.678084 62888 kubeadm.go:309] [certs] Using the existing "sa" key
I0429 20:00:34.678154 62888 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0429 20:00:34.678217 62888 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0429 20:00:34.678282 62888 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0429 20:00:34.678367 62888 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0429 20:00:34.678434 62888 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0429 20:00:34.678561 62888 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0429 20:00:34.678663 62888 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0429 20:00:34.678712 62888 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0429 20:00:34.678793 62888 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0429 20:00:34.680280 62888 out.go:204] - Booting up control plane ...
I0429 20:00:34.680414 62888 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0429 20:00:34.680518 62888 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0429 20:00:34.680610 62888 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0429 20:00:34.680740 62888 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0429 20:00:34.680964 62888 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0429 20:00:34.681018 62888 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0429 20:00:34.681099 62888 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0429 20:00:34.681313 62888 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0429 20:00:34.681394 62888 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0429 20:00:34.681646 62888 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0429 20:00:34.681726 62888 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0429 20:00:34.681946 62888 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0429 20:00:34.682025 62888 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0429 20:00:34.682294 62888 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0429 20:00:34.682417 62888 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0429 20:00:34.682612 62888 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0429 20:00:34.682624 62888 kubeadm.go:309]
I0429 20:00:34.682685 62888 kubeadm.go:309] Unfortunately, an error has occurred:
I0429 20:00:34.682750 62888 kubeadm.go:309] timed out waiting for the condition
I0429 20:00:34.682761 62888 kubeadm.go:309]
I0429 20:00:34.682817 62888 kubeadm.go:309] This error is likely caused by:
I0429 20:00:34.682861 62888 kubeadm.go:309] - The kubelet is not running
I0429 20:00:34.683000 62888 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0429 20:00:34.683009 62888 kubeadm.go:309]
I0429 20:00:34.683156 62888 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0429 20:00:34.683220 62888 kubeadm.go:309] - 'systemctl status kubelet'
I0429 20:00:34.683275 62888 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0429 20:00:34.683284 62888 kubeadm.go:309]
I0429 20:00:34.683430 62888 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0429 20:00:34.683503 62888 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0429 20:00:34.683509 62888 kubeadm.go:309]
I0429 20:00:34.683651 62888 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0429 20:00:34.683767 62888 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0429 20:00:34.683833 62888 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0429 20:00:34.683900 62888 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0429 20:00:34.683937 62888 kubeadm.go:309]
I0429 20:00:34.683958 62888 kubeadm.go:393] duration metric: took 3m58.418500346s to StartCluster
I0429 20:00:34.683992 62888 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0429 20:00:34.684038 62888 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0429 20:00:34.748527 62888 cri.go:89] found id: ""
I0429 20:00:34.748556 62888 logs.go:276] 0 containers: []
W0429 20:00:34.748566 62888 logs.go:278] No container was found matching "kube-apiserver"
I0429 20:00:34.748574 62888 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0429 20:00:34.748627 62888 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0429 20:00:34.791806 62888 cri.go:89] found id: ""
I0429 20:00:34.791833 62888 logs.go:276] 0 containers: []
W0429 20:00:34.791844 62888 logs.go:278] No container was found matching "etcd"
I0429 20:00:34.791851 62888 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0429 20:00:34.791920 62888 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0429 20:00:34.829684 62888 cri.go:89] found id: ""
I0429 20:00:34.829719 62888 logs.go:276] 0 containers: []
W0429 20:00:34.829729 62888 logs.go:278] No container was found matching "coredns"
I0429 20:00:34.829736 62888 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0429 20:00:34.829812 62888 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0429 20:00:34.871750 62888 cri.go:89] found id: ""
I0429 20:00:34.871774 62888 logs.go:276] 0 containers: []
W0429 20:00:34.871782 62888 logs.go:278] No container was found matching "kube-scheduler"
I0429 20:00:34.871787 62888 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0429 20:00:34.871853 62888 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0429 20:00:34.910948 62888 cri.go:89] found id: ""
I0429 20:00:34.910984 62888 logs.go:276] 0 containers: []
W0429 20:00:34.910995 62888 logs.go:278] No container was found matching "kube-proxy"
I0429 20:00:34.911003 62888 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0429 20:00:34.911065 62888 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0429 20:00:34.951454 62888 cri.go:89] found id: ""
I0429 20:00:34.951487 62888 logs.go:276] 0 containers: []
W0429 20:00:34.951498 62888 logs.go:278] No container was found matching "kube-controller-manager"
I0429 20:00:34.951506 62888 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0429 20:00:34.951571 62888 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0429 20:00:34.990456 62888 cri.go:89] found id: ""
I0429 20:00:34.990493 62888 logs.go:276] 0 containers: []
W0429 20:00:34.990505 62888 logs.go:278] No container was found matching "kindnet"
I0429 20:00:34.990517 62888 logs.go:123] Gathering logs for kubelet ...
I0429 20:00:34.990533 62888 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0429 20:00:35.044223 62888 logs.go:123] Gathering logs for dmesg ...
I0429 20:00:35.044262 62888 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0429 20:00:35.059140 62888 logs.go:123] Gathering logs for describe nodes ...
I0429 20:00:35.059171 62888 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0429 20:00:35.191582 62888 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0429 20:00:35.191614 62888 logs.go:123] Gathering logs for CRI-O ...
I0429 20:00:35.191628 62888 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0429 20:00:35.283768 62888 logs.go:123] Gathering logs for container status ...
I0429 20:00:35.283809 62888 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0429 20:00:35.327735 62888 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0429 20:00:35.327797 62888 out.go:239] *
*
W0429 20:00:35.327863 62888 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0429 20:00:35.327899 62888 out.go:239] *
*
W0429 20:00:35.328787 62888 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0429 20:00:35.331820 62888 out.go:177]
W0429 20:00:35.333145 62888 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0429 20:00:35.333192 62888 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0429 20:00:35.333219 62888 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0429 20:00:35.334549 62888 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-919612 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-919612 -n old-k8s-version-919612
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-919612 -n old-k8s-version-919612: exit status 6 (245.258265ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0429 20:00:35.628232 65804 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-919612" does not appear in /home/jenkins/minikube-integration/18774-7754/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-919612" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (294.32s)