=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-570369 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-570369 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m31.061867056s)
-- stdout --
* [old-k8s-version-570369] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=19307
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19307-14841/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19307-14841/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-570369" primary control-plane node in "old-k8s-version-570369" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0719 19:24:46.778481 65113 out.go:291] Setting OutFile to fd 1 ...
I0719 19:24:46.778623 65113 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0719 19:24:46.778634 65113 out.go:304] Setting ErrFile to fd 2...
I0719 19:24:46.778640 65113 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0719 19:24:46.778931 65113 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19307-14841/.minikube/bin
I0719 19:24:46.779784 65113 out.go:298] Setting JSON to false
I0719 19:24:46.781114 65113 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":7630,"bootTime":1721409457,"procs":218,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1062-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0719 19:24:46.781235 65113 start.go:139] virtualization: kvm guest
I0719 19:24:46.976105 65113 out.go:177] * [old-k8s-version-570369] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
I0719 19:24:47.194799 65113 notify.go:220] Checking for updates...
I0719 19:24:47.335830 65113 out.go:177] - MINIKUBE_LOCATION=19307
I0719 19:24:47.514616 65113 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0719 19:24:47.665795 65113 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19307-14841/kubeconfig
I0719 19:24:47.692280 65113 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19307-14841/.minikube
I0719 19:24:47.787113 65113 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0719 19:24:47.876188 65113 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0719 19:24:47.969577 65113 config.go:182] Loaded profile config "kubernetes-upgrade-821162": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.0-beta.0
I0719 19:24:47.969746 65113 config.go:182] Loaded profile config "pause-666146": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3
I0719 19:24:47.969855 65113 config.go:182] Loaded profile config "running-upgrade-197194": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.24.1
I0719 19:24:47.969983 65113 driver.go:392] Setting default libvirt URI to qemu:///system
I0719 19:24:48.033586 65113 out.go:177] * Using the kvm2 driver based on user configuration
I0719 19:24:48.063953 65113 start.go:297] selected driver: kvm2
I0719 19:24:48.063990 65113 start.go:901] validating driver "kvm2" against <nil>
I0719 19:24:48.064014 65113 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0719 19:24:48.065118 65113 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0719 19:24:48.065223 65113 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19307-14841/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0719 19:24:48.081619 65113 install.go:137] /home/jenkins/minikube-integration/19307-14841/.minikube/bin/docker-machine-driver-kvm2 version is 1.33.1
I0719 19:24:48.081667 65113 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0719 19:24:48.081883 65113 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0719 19:24:48.081932 65113 cni.go:84] Creating CNI manager for ""
I0719 19:24:48.081944 65113 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0719 19:24:48.081952 65113 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0719 19:24:48.082004 65113 start.go:340] cluster config:
{Name:old-k8s-version-570369 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-570369 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0719 19:24:48.082093 65113 iso.go:125] acquiring lock: {Name:mka126a3710ab8a115eb2a3299b735524430e5f5 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0719 19:24:48.199076 65113 out.go:177] * Starting "old-k8s-version-570369" primary control-plane node in "old-k8s-version-570369" cluster
I0719 19:24:48.281915 65113 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0719 19:24:48.281993 65113 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19307-14841/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0719 19:24:48.282002 65113 cache.go:56] Caching tarball of preloaded images
I0719 19:24:48.282074 65113 preload.go:172] Found /home/jenkins/minikube-integration/19307-14841/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0719 19:24:48.282084 65113 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0719 19:24:48.282190 65113 profile.go:143] Saving config to /home/jenkins/minikube-integration/19307-14841/.minikube/profiles/old-k8s-version-570369/config.json ...
I0719 19:24:48.282206 65113 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19307-14841/.minikube/profiles/old-k8s-version-570369/config.json: {Name:mk54da9450b8b164634b2b5375a5b0e38c46342b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0719 19:24:48.282420 65113 start.go:360] acquireMachinesLock for old-k8s-version-570369: {Name:mk45aeee801587237bb965fa260501e9fac6f233 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0719 19:24:52.052694 65113 start.go:364] duration metric: took 3.770223968s to acquireMachinesLock for "old-k8s-version-570369"
I0719 19:24:52.052754 65113 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-570369 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19298/minikube-v1.33.1-1721324531-19298-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-570369 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0719 19:24:52.052919 65113 start.go:125] createHost starting for "" (driver="kvm2")
I0719 19:24:52.054910 65113 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0719 19:24:52.055098 65113 main.go:141] libmachine: Found binary path at /home/jenkins/minikube-integration/19307-14841/.minikube/bin/docker-machine-driver-kvm2
I0719 19:24:52.055145 65113 main.go:141] libmachine: Launching plugin server for driver kvm2
I0719 19:24:52.072227 65113 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46309
I0719 19:24:52.072645 65113 main.go:141] libmachine: () Calling .GetVersion
I0719 19:24:52.073354 65113 main.go:141] libmachine: Using API Version 1
I0719 19:24:52.073377 65113 main.go:141] libmachine: () Calling .SetConfigRaw
I0719 19:24:52.073778 65113 main.go:141] libmachine: () Calling .GetMachineName
I0719 19:24:52.073984 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetMachineName
I0719 19:24:52.074165 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .DriverName
I0719 19:24:52.074342 65113 start.go:159] libmachine.API.Create for "old-k8s-version-570369" (driver="kvm2")
I0719 19:24:52.074370 65113 client.go:168] LocalClient.Create starting
I0719 19:24:52.074402 65113 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19307-14841/.minikube/certs/ca.pem
I0719 19:24:52.074441 65113 main.go:141] libmachine: Decoding PEM data...
I0719 19:24:52.074464 65113 main.go:141] libmachine: Parsing certificate...
I0719 19:24:52.074546 65113 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19307-14841/.minikube/certs/cert.pem
I0719 19:24:52.074578 65113 main.go:141] libmachine: Decoding PEM data...
I0719 19:24:52.074595 65113 main.go:141] libmachine: Parsing certificate...
I0719 19:24:52.074622 65113 main.go:141] libmachine: Running pre-create checks...
I0719 19:24:52.074640 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .PreCreateCheck
I0719 19:24:52.075033 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetConfigRaw
I0719 19:24:52.075522 65113 main.go:141] libmachine: Creating machine...
I0719 19:24:52.075549 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .Create
I0719 19:24:52.075711 65113 main.go:141] libmachine: (old-k8s-version-570369) Creating KVM machine...
I0719 19:24:52.076974 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | found existing default KVM network
I0719 19:24:52.078749 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | I0719 19:24:52.078586 65152 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0001a7370}
I0719 19:24:52.078778 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | created network xml:
I0719 19:24:52.078788 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | <network>
I0719 19:24:52.078798 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | <name>mk-old-k8s-version-570369</name>
I0719 19:24:52.078806 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | <dns enable='no'/>
I0719 19:24:52.078814 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG |
I0719 19:24:52.078823 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | <ip address='192.168.39.1' netmask='255.255.255.0'>
I0719 19:24:52.078832 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | <dhcp>
I0719 19:24:52.078841 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | <range start='192.168.39.2' end='192.168.39.253'/>
I0719 19:24:52.078850 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | </dhcp>
I0719 19:24:52.078862 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | </ip>
I0719 19:24:52.078870 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG |
I0719 19:24:52.078880 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | </network>
I0719 19:24:52.078889 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG |
I0719 19:24:52.084238 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | trying to create private KVM network mk-old-k8s-version-570369 192.168.39.0/24...
I0719 19:24:52.161823 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | private KVM network mk-old-k8s-version-570369 192.168.39.0/24 created
I0719 19:24:52.161864 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | I0719 19:24:52.161777 65152 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19307-14841/.minikube
I0719 19:24:52.161877 65113 main.go:141] libmachine: (old-k8s-version-570369) Setting up store path in /home/jenkins/minikube-integration/19307-14841/.minikube/machines/old-k8s-version-570369 ...
I0719 19:24:52.161902 65113 main.go:141] libmachine: (old-k8s-version-570369) Building disk image from file:///home/jenkins/minikube-integration/19307-14841/.minikube/cache/iso/amd64/minikube-v1.33.1-1721324531-19298-amd64.iso
I0719 19:24:52.161917 65113 main.go:141] libmachine: (old-k8s-version-570369) Downloading /home/jenkins/minikube-integration/19307-14841/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19307-14841/.minikube/cache/iso/amd64/minikube-v1.33.1-1721324531-19298-amd64.iso...
I0719 19:24:52.405997 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | I0719 19:24:52.405890 65152 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19307-14841/.minikube/machines/old-k8s-version-570369/id_rsa...
I0719 19:24:52.597198 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | I0719 19:24:52.597048 65152 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19307-14841/.minikube/machines/old-k8s-version-570369/old-k8s-version-570369.rawdisk...
I0719 19:24:52.597233 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | Writing magic tar header
I0719 19:24:52.597251 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | Writing SSH key tar header
I0719 19:24:52.597266 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | I0719 19:24:52.597170 65152 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19307-14841/.minikube/machines/old-k8s-version-570369 ...
I0719 19:24:52.597282 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19307-14841/.minikube/machines/old-k8s-version-570369
I0719 19:24:52.597319 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19307-14841/.minikube/machines
I0719 19:24:52.597352 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19307-14841/.minikube
I0719 19:24:52.597367 65113 main.go:141] libmachine: (old-k8s-version-570369) Setting executable bit set on /home/jenkins/minikube-integration/19307-14841/.minikube/machines/old-k8s-version-570369 (perms=drwx------)
I0719 19:24:52.597411 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19307-14841
I0719 19:24:52.597443 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0719 19:24:52.597459 65113 main.go:141] libmachine: (old-k8s-version-570369) Setting executable bit set on /home/jenkins/minikube-integration/19307-14841/.minikube/machines (perms=drwxr-xr-x)
I0719 19:24:52.597472 65113 main.go:141] libmachine: (old-k8s-version-570369) Setting executable bit set on /home/jenkins/minikube-integration/19307-14841/.minikube (perms=drwxr-xr-x)
I0719 19:24:52.597482 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | Checking permissions on dir: /home/jenkins
I0719 19:24:52.597501 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | Checking permissions on dir: /home
I0719 19:24:52.597524 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | Skipping /home - not owner
I0719 19:24:52.597543 65113 main.go:141] libmachine: (old-k8s-version-570369) Setting executable bit set on /home/jenkins/minikube-integration/19307-14841 (perms=drwxrwxr-x)
I0719 19:24:52.597575 65113 main.go:141] libmachine: (old-k8s-version-570369) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0719 19:24:52.597588 65113 main.go:141] libmachine: (old-k8s-version-570369) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0719 19:24:52.597595 65113 main.go:141] libmachine: (old-k8s-version-570369) Creating domain...
I0719 19:24:52.598836 65113 main.go:141] libmachine: (old-k8s-version-570369) define libvirt domain using xml:
I0719 19:24:52.598857 65113 main.go:141] libmachine: (old-k8s-version-570369) <domain type='kvm'>
I0719 19:24:52.598869 65113 main.go:141] libmachine: (old-k8s-version-570369) <name>old-k8s-version-570369</name>
I0719 19:24:52.598879 65113 main.go:141] libmachine: (old-k8s-version-570369) <memory unit='MiB'>2200</memory>
I0719 19:24:52.598890 65113 main.go:141] libmachine: (old-k8s-version-570369) <vcpu>2</vcpu>
I0719 19:24:52.598897 65113 main.go:141] libmachine: (old-k8s-version-570369) <features>
I0719 19:24:52.598905 65113 main.go:141] libmachine: (old-k8s-version-570369) <acpi/>
I0719 19:24:52.598913 65113 main.go:141] libmachine: (old-k8s-version-570369) <apic/>
I0719 19:24:52.598925 65113 main.go:141] libmachine: (old-k8s-version-570369) <pae/>
I0719 19:24:52.598944 65113 main.go:141] libmachine: (old-k8s-version-570369)
I0719 19:24:52.598956 65113 main.go:141] libmachine: (old-k8s-version-570369) </features>
I0719 19:24:52.598968 65113 main.go:141] libmachine: (old-k8s-version-570369) <cpu mode='host-passthrough'>
I0719 19:24:52.598979 65113 main.go:141] libmachine: (old-k8s-version-570369)
I0719 19:24:52.598987 65113 main.go:141] libmachine: (old-k8s-version-570369) </cpu>
I0719 19:24:52.599009 65113 main.go:141] libmachine: (old-k8s-version-570369) <os>
I0719 19:24:52.599032 65113 main.go:141] libmachine: (old-k8s-version-570369) <type>hvm</type>
I0719 19:24:52.599045 65113 main.go:141] libmachine: (old-k8s-version-570369) <boot dev='cdrom'/>
I0719 19:24:52.599076 65113 main.go:141] libmachine: (old-k8s-version-570369) <boot dev='hd'/>
I0719 19:24:52.599090 65113 main.go:141] libmachine: (old-k8s-version-570369) <bootmenu enable='no'/>
I0719 19:24:52.599101 65113 main.go:141] libmachine: (old-k8s-version-570369) </os>
I0719 19:24:52.599120 65113 main.go:141] libmachine: (old-k8s-version-570369) <devices>
I0719 19:24:52.599134 65113 main.go:141] libmachine: (old-k8s-version-570369) <disk type='file' device='cdrom'>
I0719 19:24:52.599149 65113 main.go:141] libmachine: (old-k8s-version-570369) <source file='/home/jenkins/minikube-integration/19307-14841/.minikube/machines/old-k8s-version-570369/boot2docker.iso'/>
I0719 19:24:52.599161 65113 main.go:141] libmachine: (old-k8s-version-570369) <target dev='hdc' bus='scsi'/>
I0719 19:24:52.599180 65113 main.go:141] libmachine: (old-k8s-version-570369) <readonly/>
I0719 19:24:52.599200 65113 main.go:141] libmachine: (old-k8s-version-570369) </disk>
I0719 19:24:52.599214 65113 main.go:141] libmachine: (old-k8s-version-570369) <disk type='file' device='disk'>
I0719 19:24:52.599227 65113 main.go:141] libmachine: (old-k8s-version-570369) <driver name='qemu' type='raw' cache='default' io='threads' />
I0719 19:24:52.599243 65113 main.go:141] libmachine: (old-k8s-version-570369) <source file='/home/jenkins/minikube-integration/19307-14841/.minikube/machines/old-k8s-version-570369/old-k8s-version-570369.rawdisk'/>
I0719 19:24:52.599254 65113 main.go:141] libmachine: (old-k8s-version-570369) <target dev='hda' bus='virtio'/>
I0719 19:24:52.599266 65113 main.go:141] libmachine: (old-k8s-version-570369) </disk>
I0719 19:24:52.599280 65113 main.go:141] libmachine: (old-k8s-version-570369) <interface type='network'>
I0719 19:24:52.599293 65113 main.go:141] libmachine: (old-k8s-version-570369) <source network='mk-old-k8s-version-570369'/>
I0719 19:24:52.599303 65113 main.go:141] libmachine: (old-k8s-version-570369) <model type='virtio'/>
I0719 19:24:52.599314 65113 main.go:141] libmachine: (old-k8s-version-570369) </interface>
I0719 19:24:52.599323 65113 main.go:141] libmachine: (old-k8s-version-570369) <interface type='network'>
I0719 19:24:52.599336 65113 main.go:141] libmachine: (old-k8s-version-570369) <source network='default'/>
I0719 19:24:52.599343 65113 main.go:141] libmachine: (old-k8s-version-570369) <model type='virtio'/>
I0719 19:24:52.599354 65113 main.go:141] libmachine: (old-k8s-version-570369) </interface>
I0719 19:24:52.599364 65113 main.go:141] libmachine: (old-k8s-version-570369) <serial type='pty'>
I0719 19:24:52.599374 65113 main.go:141] libmachine: (old-k8s-version-570369) <target port='0'/>
I0719 19:24:52.599384 65113 main.go:141] libmachine: (old-k8s-version-570369) </serial>
I0719 19:24:52.599393 65113 main.go:141] libmachine: (old-k8s-version-570369) <console type='pty'>
I0719 19:24:52.599404 65113 main.go:141] libmachine: (old-k8s-version-570369) <target type='serial' port='0'/>
I0719 19:24:52.599414 65113 main.go:141] libmachine: (old-k8s-version-570369) </console>
I0719 19:24:52.599425 65113 main.go:141] libmachine: (old-k8s-version-570369) <rng model='virtio'>
I0719 19:24:52.599439 65113 main.go:141] libmachine: (old-k8s-version-570369) <backend model='random'>/dev/random</backend>
I0719 19:24:52.599446 65113 main.go:141] libmachine: (old-k8s-version-570369) </rng>
I0719 19:24:52.599457 65113 main.go:141] libmachine: (old-k8s-version-570369)
I0719 19:24:52.599464 65113 main.go:141] libmachine: (old-k8s-version-570369)
I0719 19:24:52.599474 65113 main.go:141] libmachine: (old-k8s-version-570369) </devices>
I0719 19:24:52.599484 65113 main.go:141] libmachine: (old-k8s-version-570369) </domain>
I0719 19:24:52.599495 65113 main.go:141] libmachine: (old-k8s-version-570369)
I0719 19:24:52.603976 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | domain old-k8s-version-570369 has defined MAC address 52:54:00:a7:ee:27 in network default
I0719 19:24:52.604844 65113 main.go:141] libmachine: (old-k8s-version-570369) Ensuring networks are active...
I0719 19:24:52.604870 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | domain old-k8s-version-570369 has defined MAC address 52:54:00:80:e3:2b in network mk-old-k8s-version-570369
I0719 19:24:52.605637 65113 main.go:141] libmachine: (old-k8s-version-570369) Ensuring network default is active
I0719 19:24:52.606022 65113 main.go:141] libmachine: (old-k8s-version-570369) Ensuring network mk-old-k8s-version-570369 is active
I0719 19:24:52.606647 65113 main.go:141] libmachine: (old-k8s-version-570369) Getting domain xml...
I0719 19:24:52.607521 65113 main.go:141] libmachine: (old-k8s-version-570369) Creating domain...
I0719 19:24:53.965226 65113 main.go:141] libmachine: (old-k8s-version-570369) Waiting to get IP...
I0719 19:24:53.965979 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | domain old-k8s-version-570369 has defined MAC address 52:54:00:80:e3:2b in network mk-old-k8s-version-570369
I0719 19:24:53.966462 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | unable to find current IP address of domain old-k8s-version-570369 in network mk-old-k8s-version-570369
I0719 19:24:53.966485 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | I0719 19:24:53.966430 65152 retry.go:31] will retry after 210.098259ms: waiting for machine to come up
I0719 19:24:54.177771 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | domain old-k8s-version-570369 has defined MAC address 52:54:00:80:e3:2b in network mk-old-k8s-version-570369
I0719 19:24:54.178265 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | unable to find current IP address of domain old-k8s-version-570369 in network mk-old-k8s-version-570369
I0719 19:24:54.178289 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | I0719 19:24:54.178209 65152 retry.go:31] will retry after 346.884591ms: waiting for machine to come up
I0719 19:24:54.526691 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | domain old-k8s-version-570369 has defined MAC address 52:54:00:80:e3:2b in network mk-old-k8s-version-570369
I0719 19:24:54.527208 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | unable to find current IP address of domain old-k8s-version-570369 in network mk-old-k8s-version-570369
I0719 19:24:54.527238 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | I0719 19:24:54.527158 65152 retry.go:31] will retry after 422.024167ms: waiting for machine to come up
I0719 19:24:54.950926 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | domain old-k8s-version-570369 has defined MAC address 52:54:00:80:e3:2b in network mk-old-k8s-version-570369
I0719 19:24:54.951575 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | unable to find current IP address of domain old-k8s-version-570369 in network mk-old-k8s-version-570369
I0719 19:24:54.951604 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | I0719 19:24:54.951523 65152 retry.go:31] will retry after 559.854237ms: waiting for machine to come up
I0719 19:24:56.020538 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | domain old-k8s-version-570369 has defined MAC address 52:54:00:80:e3:2b in network mk-old-k8s-version-570369
I0719 19:24:56.021030 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | unable to find current IP address of domain old-k8s-version-570369 in network mk-old-k8s-version-570369
I0719 19:24:56.021069 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | I0719 19:24:56.021014 65152 retry.go:31] will retry after 670.834049ms: waiting for machine to come up
I0719 19:24:56.693977 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | domain old-k8s-version-570369 has defined MAC address 52:54:00:80:e3:2b in network mk-old-k8s-version-570369
I0719 19:24:56.694407 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | unable to find current IP address of domain old-k8s-version-570369 in network mk-old-k8s-version-570369
I0719 19:24:56.694461 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | I0719 19:24:56.694378 65152 retry.go:31] will retry after 578.315016ms: waiting for machine to come up
I0719 19:24:57.274679 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | domain old-k8s-version-570369 has defined MAC address 52:54:00:80:e3:2b in network mk-old-k8s-version-570369
I0719 19:24:57.275110 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | unable to find current IP address of domain old-k8s-version-570369 in network mk-old-k8s-version-570369
I0719 19:24:57.275149 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | I0719 19:24:57.275066 65152 retry.go:31] will retry after 995.303031ms: waiting for machine to come up
I0719 19:24:58.271721 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | domain old-k8s-version-570369 has defined MAC address 52:54:00:80:e3:2b in network mk-old-k8s-version-570369
I0719 19:24:58.272266 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | unable to find current IP address of domain old-k8s-version-570369 in network mk-old-k8s-version-570369
I0719 19:24:58.272291 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | I0719 19:24:58.272223 65152 retry.go:31] will retry after 1.158986535s: waiting for machine to come up
I0719 19:24:59.432362 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | domain old-k8s-version-570369 has defined MAC address 52:54:00:80:e3:2b in network mk-old-k8s-version-570369
I0719 19:24:59.432871 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | unable to find current IP address of domain old-k8s-version-570369 in network mk-old-k8s-version-570369
I0719 19:24:59.432895 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | I0719 19:24:59.432810 65152 retry.go:31] will retry after 1.588027525s: waiting for machine to come up
I0719 19:25:01.022797 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | domain old-k8s-version-570369 has defined MAC address 52:54:00:80:e3:2b in network mk-old-k8s-version-570369
I0719 19:25:01.023405 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | unable to find current IP address of domain old-k8s-version-570369 in network mk-old-k8s-version-570369
I0719 19:25:01.023434 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | I0719 19:25:01.023351 65152 retry.go:31] will retry after 2.211395073s: waiting for machine to come up
I0719 19:25:03.236197 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | domain old-k8s-version-570369 has defined MAC address 52:54:00:80:e3:2b in network mk-old-k8s-version-570369
I0719 19:25:03.236803 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | unable to find current IP address of domain old-k8s-version-570369 in network mk-old-k8s-version-570369
I0719 19:25:03.236838 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | I0719 19:25:03.236760 65152 retry.go:31] will retry after 2.443525966s: waiting for machine to come up
I0719 19:25:05.682770 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | domain old-k8s-version-570369 has defined MAC address 52:54:00:80:e3:2b in network mk-old-k8s-version-570369
I0719 19:25:05.683305 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | unable to find current IP address of domain old-k8s-version-570369 in network mk-old-k8s-version-570369
I0719 19:25:05.683332 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | I0719 19:25:05.683237 65152 retry.go:31] will retry after 2.660026059s: waiting for machine to come up
I0719 19:25:08.344803 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | domain old-k8s-version-570369 has defined MAC address 52:54:00:80:e3:2b in network mk-old-k8s-version-570369
I0719 19:25:08.345225 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | unable to find current IP address of domain old-k8s-version-570369 in network mk-old-k8s-version-570369
I0719 19:25:08.345244 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | I0719 19:25:08.345196 65152 retry.go:31] will retry after 3.224130913s: waiting for machine to come up
I0719 19:25:11.572864 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | domain old-k8s-version-570369 has defined MAC address 52:54:00:80:e3:2b in network mk-old-k8s-version-570369
I0719 19:25:11.573420 65113 main.go:141] libmachine: (old-k8s-version-570369) Found IP for machine: 192.168.39.220
I0719 19:25:11.573445 65113 main.go:141] libmachine: (old-k8s-version-570369) Reserving static IP address...
I0719 19:25:11.573458 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | domain old-k8s-version-570369 has current primary IP address 192.168.39.220 and MAC address 52:54:00:80:e3:2b in network mk-old-k8s-version-570369
I0719 19:25:11.573823 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-570369", mac: "52:54:00:80:e3:2b", ip: "192.168.39.220"} in network mk-old-k8s-version-570369
I0719 19:25:11.651654 65113 main.go:141] libmachine: (old-k8s-version-570369) Reserved static IP address: 192.168.39.220
I0719 19:25:11.651684 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | Getting to WaitForSSH function...
I0719 19:25:11.651693 65113 main.go:141] libmachine: (old-k8s-version-570369) Waiting for SSH to be available...
I0719 19:25:11.654924 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | domain old-k8s-version-570369 has defined MAC address 52:54:00:80:e3:2b in network mk-old-k8s-version-570369
I0719 19:25:11.655468 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:80:e3:2b", ip: ""} in network mk-old-k8s-version-570369: {Iface:virbr2 ExpiryTime:2024-07-19 20:25:06 +0000 UTC Type:0 Mac:52:54:00:80:e3:2b Iaid: IPaddr:192.168.39.220 Prefix:24 Hostname:minikube Clientid:01:52:54:00:80:e3:2b}
I0719 19:25:11.655496 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | domain old-k8s-version-570369 has defined IP address 192.168.39.220 and MAC address 52:54:00:80:e3:2b in network mk-old-k8s-version-570369
I0719 19:25:11.655738 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | Using SSH client type: external
I0719 19:25:11.655758 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | Using SSH private key: /home/jenkins/minikube-integration/19307-14841/.minikube/machines/old-k8s-version-570369/id_rsa (-rw-------)
I0719 19:25:11.655799 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.220 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19307-14841/.minikube/machines/old-k8s-version-570369/id_rsa -p 22] /usr/bin/ssh <nil>}
I0719 19:25:11.655816 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | About to run SSH command:
I0719 19:25:11.655854 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | exit 0
I0719 19:25:11.787478 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | SSH cmd err, output: <nil>:
I0719 19:25:11.787738 65113 main.go:141] libmachine: (old-k8s-version-570369) KVM machine creation complete!
I0719 19:25:11.788066 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetConfigRaw
I0719 19:25:11.788613 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .DriverName
I0719 19:25:11.788791 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .DriverName
I0719 19:25:11.788926 65113 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0719 19:25:11.788976 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetState
I0719 19:25:11.790278 65113 main.go:141] libmachine: Detecting operating system of created instance...
I0719 19:25:11.790295 65113 main.go:141] libmachine: Waiting for SSH to be available...
I0719 19:25:11.790318 65113 main.go:141] libmachine: Getting to WaitForSSH function...
I0719 19:25:11.790337 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetSSHHostname
I0719 19:25:11.792743 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | domain old-k8s-version-570369 has defined MAC address 52:54:00:80:e3:2b in network mk-old-k8s-version-570369
I0719 19:25:11.793146 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:80:e3:2b", ip: ""} in network mk-old-k8s-version-570369: {Iface:virbr2 ExpiryTime:2024-07-19 20:25:06 +0000 UTC Type:0 Mac:52:54:00:80:e3:2b Iaid: IPaddr:192.168.39.220 Prefix:24 Hostname:old-k8s-version-570369 Clientid:01:52:54:00:80:e3:2b}
I0719 19:25:11.793174 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | domain old-k8s-version-570369 has defined IP address 192.168.39.220 and MAC address 52:54:00:80:e3:2b in network mk-old-k8s-version-570369
I0719 19:25:11.793305 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetSSHPort
I0719 19:25:11.793489 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetSSHKeyPath
I0719 19:25:11.793653 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetSSHKeyPath
I0719 19:25:11.793805 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetSSHUsername
I0719 19:25:11.793956 65113 main.go:141] libmachine: Using SSH client type: native
I0719 19:25:11.794169 65113 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.39.220 22 <nil> <nil>}
I0719 19:25:11.794182 65113 main.go:141] libmachine: About to run SSH command:
exit 0
I0719 19:25:11.898823 65113 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0719 19:25:11.898850 65113 main.go:141] libmachine: Detecting the provisioner...
I0719 19:25:11.898862 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetSSHHostname
I0719 19:25:11.901673 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | domain old-k8s-version-570369 has defined MAC address 52:54:00:80:e3:2b in network mk-old-k8s-version-570369
I0719 19:25:11.901959 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:80:e3:2b", ip: ""} in network mk-old-k8s-version-570369: {Iface:virbr2 ExpiryTime:2024-07-19 20:25:06 +0000 UTC Type:0 Mac:52:54:00:80:e3:2b Iaid: IPaddr:192.168.39.220 Prefix:24 Hostname:old-k8s-version-570369 Clientid:01:52:54:00:80:e3:2b}
I0719 19:25:11.901981 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | domain old-k8s-version-570369 has defined IP address 192.168.39.220 and MAC address 52:54:00:80:e3:2b in network mk-old-k8s-version-570369
I0719 19:25:11.902159 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetSSHPort
I0719 19:25:11.902328 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetSSHKeyPath
I0719 19:25:11.902544 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetSSHKeyPath
I0719 19:25:11.902689 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetSSHUsername
I0719 19:25:11.902880 65113 main.go:141] libmachine: Using SSH client type: native
I0719 19:25:11.903047 65113 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.39.220 22 <nil> <nil>}
I0719 19:25:11.903062 65113 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0719 19:25:12.012012 65113 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0719 19:25:12.012124 65113 main.go:141] libmachine: found compatible host: buildroot
I0719 19:25:12.012140 65113 main.go:141] libmachine: Provisioning with buildroot...
I0719 19:25:12.012151 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetMachineName
I0719 19:25:12.012393 65113 buildroot.go:166] provisioning hostname "old-k8s-version-570369"
I0719 19:25:12.012418 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetMachineName
I0719 19:25:12.012624 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetSSHHostname
I0719 19:25:12.014909 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | domain old-k8s-version-570369 has defined MAC address 52:54:00:80:e3:2b in network mk-old-k8s-version-570369
I0719 19:25:12.015192 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:80:e3:2b", ip: ""} in network mk-old-k8s-version-570369: {Iface:virbr2 ExpiryTime:2024-07-19 20:25:06 +0000 UTC Type:0 Mac:52:54:00:80:e3:2b Iaid: IPaddr:192.168.39.220 Prefix:24 Hostname:old-k8s-version-570369 Clientid:01:52:54:00:80:e3:2b}
I0719 19:25:12.015233 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | domain old-k8s-version-570369 has defined IP address 192.168.39.220 and MAC address 52:54:00:80:e3:2b in network mk-old-k8s-version-570369
I0719 19:25:12.015387 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetSSHPort
I0719 19:25:12.015576 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetSSHKeyPath
I0719 19:25:12.015730 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetSSHKeyPath
I0719 19:25:12.015894 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetSSHUsername
I0719 19:25:12.016054 65113 main.go:141] libmachine: Using SSH client type: native
I0719 19:25:12.016220 65113 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.39.220 22 <nil> <nil>}
I0719 19:25:12.016234 65113 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-570369 && echo "old-k8s-version-570369" | sudo tee /etc/hostname
I0719 19:25:12.132568 65113 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-570369
I0719 19:25:12.132598 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetSSHHostname
I0719 19:25:12.135645 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | domain old-k8s-version-570369 has defined MAC address 52:54:00:80:e3:2b in network mk-old-k8s-version-570369
I0719 19:25:12.136106 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:80:e3:2b", ip: ""} in network mk-old-k8s-version-570369: {Iface:virbr2 ExpiryTime:2024-07-19 20:25:06 +0000 UTC Type:0 Mac:52:54:00:80:e3:2b Iaid: IPaddr:192.168.39.220 Prefix:24 Hostname:old-k8s-version-570369 Clientid:01:52:54:00:80:e3:2b}
I0719 19:25:12.136129 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | domain old-k8s-version-570369 has defined IP address 192.168.39.220 and MAC address 52:54:00:80:e3:2b in network mk-old-k8s-version-570369
I0719 19:25:12.136269 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetSSHPort
I0719 19:25:12.136490 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetSSHKeyPath
I0719 19:25:12.136695 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetSSHKeyPath
I0719 19:25:12.136840 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetSSHUsername
I0719 19:25:12.136996 65113 main.go:141] libmachine: Using SSH client type: native
I0719 19:25:12.137198 65113 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.39.220 22 <nil> <nil>}
I0719 19:25:12.137225 65113 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-570369' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-570369/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-570369' | sudo tee -a /etc/hosts;
fi
fi
I0719 19:25:12.251957 65113 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0719 19:25:12.251983 65113 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19307-14841/.minikube CaCertPath:/home/jenkins/minikube-integration/19307-14841/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19307-14841/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19307-14841/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19307-14841/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19307-14841/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19307-14841/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19307-14841/.minikube}
I0719 19:25:12.252024 65113 buildroot.go:174] setting up certificates
I0719 19:25:12.252033 65113 provision.go:84] configureAuth start
I0719 19:25:12.252042 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetMachineName
I0719 19:25:12.252310 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetIP
I0719 19:25:12.254951 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | domain old-k8s-version-570369 has defined MAC address 52:54:00:80:e3:2b in network mk-old-k8s-version-570369
I0719 19:25:12.255374 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:80:e3:2b", ip: ""} in network mk-old-k8s-version-570369: {Iface:virbr2 ExpiryTime:2024-07-19 20:25:06 +0000 UTC Type:0 Mac:52:54:00:80:e3:2b Iaid: IPaddr:192.168.39.220 Prefix:24 Hostname:old-k8s-version-570369 Clientid:01:52:54:00:80:e3:2b}
I0719 19:25:12.255398 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | domain old-k8s-version-570369 has defined IP address 192.168.39.220 and MAC address 52:54:00:80:e3:2b in network mk-old-k8s-version-570369
I0719 19:25:12.255649 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetSSHHostname
I0719 19:25:12.258035 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | domain old-k8s-version-570369 has defined MAC address 52:54:00:80:e3:2b in network mk-old-k8s-version-570369
I0719 19:25:12.258326 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:80:e3:2b", ip: ""} in network mk-old-k8s-version-570369: {Iface:virbr2 ExpiryTime:2024-07-19 20:25:06 +0000 UTC Type:0 Mac:52:54:00:80:e3:2b Iaid: IPaddr:192.168.39.220 Prefix:24 Hostname:old-k8s-version-570369 Clientid:01:52:54:00:80:e3:2b}
I0719 19:25:12.258348 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | domain old-k8s-version-570369 has defined IP address 192.168.39.220 and MAC address 52:54:00:80:e3:2b in network mk-old-k8s-version-570369
I0719 19:25:12.258499 65113 provision.go:143] copyHostCerts
I0719 19:25:12.258578 65113 exec_runner.go:144] found /home/jenkins/minikube-integration/19307-14841/.minikube/ca.pem, removing ...
I0719 19:25:12.258591 65113 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19307-14841/.minikube/ca.pem
I0719 19:25:12.258646 65113 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19307-14841/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19307-14841/.minikube/ca.pem (1078 bytes)
I0719 19:25:12.258748 65113 exec_runner.go:144] found /home/jenkins/minikube-integration/19307-14841/.minikube/cert.pem, removing ...
I0719 19:25:12.258756 65113 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19307-14841/.minikube/cert.pem
I0719 19:25:12.258776 65113 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19307-14841/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19307-14841/.minikube/cert.pem (1123 bytes)
I0719 19:25:12.258868 65113 exec_runner.go:144] found /home/jenkins/minikube-integration/19307-14841/.minikube/key.pem, removing ...
I0719 19:25:12.258876 65113 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19307-14841/.minikube/key.pem
I0719 19:25:12.258895 65113 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19307-14841/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19307-14841/.minikube/key.pem (1679 bytes)
I0719 19:25:12.258949 65113 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19307-14841/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19307-14841/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19307-14841/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-570369 san=[127.0.0.1 192.168.39.220 localhost minikube old-k8s-version-570369]
I0719 19:25:12.400305 65113 provision.go:177] copyRemoteCerts
I0719 19:25:12.400358 65113 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0719 19:25:12.400383 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetSSHHostname
I0719 19:25:12.403043 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | domain old-k8s-version-570369 has defined MAC address 52:54:00:80:e3:2b in network mk-old-k8s-version-570369
I0719 19:25:12.403426 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:80:e3:2b", ip: ""} in network mk-old-k8s-version-570369: {Iface:virbr2 ExpiryTime:2024-07-19 20:25:06 +0000 UTC Type:0 Mac:52:54:00:80:e3:2b Iaid: IPaddr:192.168.39.220 Prefix:24 Hostname:old-k8s-version-570369 Clientid:01:52:54:00:80:e3:2b}
I0719 19:25:12.403465 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | domain old-k8s-version-570369 has defined IP address 192.168.39.220 and MAC address 52:54:00:80:e3:2b in network mk-old-k8s-version-570369
I0719 19:25:12.403618 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetSSHPort
I0719 19:25:12.403855 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetSSHKeyPath
I0719 19:25:12.404016 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetSSHUsername
I0719 19:25:12.404212 65113 sshutil.go:53] new ssh client: &{IP:192.168.39.220 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19307-14841/.minikube/machines/old-k8s-version-570369/id_rsa Username:docker}
I0719 19:25:12.494424 65113 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19307-14841/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0719 19:25:12.518045 65113 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19307-14841/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0719 19:25:12.539532 65113 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19307-14841/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0719 19:25:12.561104 65113 provision.go:87] duration metric: took 309.061303ms to configureAuth
I0719 19:25:12.561132 65113 buildroot.go:189] setting minikube options for container-runtime
I0719 19:25:12.561318 65113 config.go:182] Loaded profile config "old-k8s-version-570369": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0719 19:25:12.561386 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetSSHHostname
I0719 19:25:12.563974 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | domain old-k8s-version-570369 has defined MAC address 52:54:00:80:e3:2b in network mk-old-k8s-version-570369
I0719 19:25:12.564298 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:80:e3:2b", ip: ""} in network mk-old-k8s-version-570369: {Iface:virbr2 ExpiryTime:2024-07-19 20:25:06 +0000 UTC Type:0 Mac:52:54:00:80:e3:2b Iaid: IPaddr:192.168.39.220 Prefix:24 Hostname:old-k8s-version-570369 Clientid:01:52:54:00:80:e3:2b}
I0719 19:25:12.564318 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | domain old-k8s-version-570369 has defined IP address 192.168.39.220 and MAC address 52:54:00:80:e3:2b in network mk-old-k8s-version-570369
I0719 19:25:12.564507 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetSSHPort
I0719 19:25:12.564707 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetSSHKeyPath
I0719 19:25:12.564869 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetSSHKeyPath
I0719 19:25:12.565004 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetSSHUsername
I0719 19:25:12.565155 65113 main.go:141] libmachine: Using SSH client type: native
I0719 19:25:12.565315 65113 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.39.220 22 <nil> <nil>}
I0719 19:25:12.565337 65113 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0719 19:25:12.845369 65113 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0719 19:25:12.845396 65113 main.go:141] libmachine: Checking connection to Docker...
I0719 19:25:12.845406 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetURL
I0719 19:25:12.846599 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | Using libvirt version 6000000
I0719 19:25:12.848848 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | domain old-k8s-version-570369 has defined MAC address 52:54:00:80:e3:2b in network mk-old-k8s-version-570369
I0719 19:25:12.849174 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:80:e3:2b", ip: ""} in network mk-old-k8s-version-570369: {Iface:virbr2 ExpiryTime:2024-07-19 20:25:06 +0000 UTC Type:0 Mac:52:54:00:80:e3:2b Iaid: IPaddr:192.168.39.220 Prefix:24 Hostname:old-k8s-version-570369 Clientid:01:52:54:00:80:e3:2b}
I0719 19:25:12.849204 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | domain old-k8s-version-570369 has defined IP address 192.168.39.220 and MAC address 52:54:00:80:e3:2b in network mk-old-k8s-version-570369
I0719 19:25:12.849424 65113 main.go:141] libmachine: Docker is up and running!
I0719 19:25:12.849439 65113 main.go:141] libmachine: Reticulating splines...
I0719 19:25:12.849447 65113 client.go:171] duration metric: took 20.775069344s to LocalClient.Create
I0719 19:25:12.849473 65113 start.go:167] duration metric: took 20.775132716s to libmachine.API.Create "old-k8s-version-570369"
I0719 19:25:12.849485 65113 start.go:293] postStartSetup for "old-k8s-version-570369" (driver="kvm2")
I0719 19:25:12.849514 65113 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0719 19:25:12.849537 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .DriverName
I0719 19:25:12.849791 65113 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0719 19:25:12.849816 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetSSHHostname
I0719 19:25:12.852334 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | domain old-k8s-version-570369 has defined MAC address 52:54:00:80:e3:2b in network mk-old-k8s-version-570369
I0719 19:25:12.852655 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:80:e3:2b", ip: ""} in network mk-old-k8s-version-570369: {Iface:virbr2 ExpiryTime:2024-07-19 20:25:06 +0000 UTC Type:0 Mac:52:54:00:80:e3:2b Iaid: IPaddr:192.168.39.220 Prefix:24 Hostname:old-k8s-version-570369 Clientid:01:52:54:00:80:e3:2b}
I0719 19:25:12.852682 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | domain old-k8s-version-570369 has defined IP address 192.168.39.220 and MAC address 52:54:00:80:e3:2b in network mk-old-k8s-version-570369
I0719 19:25:12.852867 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetSSHPort
I0719 19:25:12.853055 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetSSHKeyPath
I0719 19:25:12.853189 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetSSHUsername
I0719 19:25:12.853336 65113 sshutil.go:53] new ssh client: &{IP:192.168.39.220 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19307-14841/.minikube/machines/old-k8s-version-570369/id_rsa Username:docker}
I0719 19:25:12.934181 65113 ssh_runner.go:195] Run: cat /etc/os-release
I0719 19:25:12.938481 65113 info.go:137] Remote host: Buildroot 2023.02.9
I0719 19:25:12.938508 65113 filesync.go:126] Scanning /home/jenkins/minikube-integration/19307-14841/.minikube/addons for local assets ...
I0719 19:25:12.938572 65113 filesync.go:126] Scanning /home/jenkins/minikube-integration/19307-14841/.minikube/files for local assets ...
I0719 19:25:12.938698 65113 filesync.go:149] local asset: /home/jenkins/minikube-integration/19307-14841/.minikube/files/etc/ssl/certs/220282.pem -> 220282.pem in /etc/ssl/certs
I0719 19:25:12.938817 65113 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0719 19:25:12.947871 65113 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19307-14841/.minikube/files/etc/ssl/certs/220282.pem --> /etc/ssl/certs/220282.pem (1708 bytes)
I0719 19:25:12.970064 65113 start.go:296] duration metric: took 120.546471ms for postStartSetup
I0719 19:25:12.970121 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetConfigRaw
I0719 19:25:12.970687 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetIP
I0719 19:25:12.973371 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | domain old-k8s-version-570369 has defined MAC address 52:54:00:80:e3:2b in network mk-old-k8s-version-570369
I0719 19:25:12.973938 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:80:e3:2b", ip: ""} in network mk-old-k8s-version-570369: {Iface:virbr2 ExpiryTime:2024-07-19 20:25:06 +0000 UTC Type:0 Mac:52:54:00:80:e3:2b Iaid: IPaddr:192.168.39.220 Prefix:24 Hostname:old-k8s-version-570369 Clientid:01:52:54:00:80:e3:2b}
I0719 19:25:12.973972 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | domain old-k8s-version-570369 has defined IP address 192.168.39.220 and MAC address 52:54:00:80:e3:2b in network mk-old-k8s-version-570369
I0719 19:25:12.974312 65113 profile.go:143] Saving config to /home/jenkins/minikube-integration/19307-14841/.minikube/profiles/old-k8s-version-570369/config.json ...
I0719 19:25:12.974498 65113 start.go:128] duration metric: took 20.921561061s to createHost
I0719 19:25:12.974522 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetSSHHostname
I0719 19:25:12.976940 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | domain old-k8s-version-570369 has defined MAC address 52:54:00:80:e3:2b in network mk-old-k8s-version-570369
I0719 19:25:12.977308 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:80:e3:2b", ip: ""} in network mk-old-k8s-version-570369: {Iface:virbr2 ExpiryTime:2024-07-19 20:25:06 +0000 UTC Type:0 Mac:52:54:00:80:e3:2b Iaid: IPaddr:192.168.39.220 Prefix:24 Hostname:old-k8s-version-570369 Clientid:01:52:54:00:80:e3:2b}
I0719 19:25:12.977344 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | domain old-k8s-version-570369 has defined IP address 192.168.39.220 and MAC address 52:54:00:80:e3:2b in network mk-old-k8s-version-570369
I0719 19:25:12.977522 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetSSHPort
I0719 19:25:12.977716 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetSSHKeyPath
I0719 19:25:12.977888 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetSSHKeyPath
I0719 19:25:12.978055 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetSSHUsername
I0719 19:25:12.978235 65113 main.go:141] libmachine: Using SSH client type: native
I0719 19:25:12.978452 65113 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.39.220 22 <nil> <nil>}
I0719 19:25:12.978465 65113 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0719 19:25:13.084063 65113 main.go:141] libmachine: SSH cmd err, output: <nil>: 1721417113.046702003
I0719 19:25:13.084091 65113 fix.go:216] guest clock: 1721417113.046702003
I0719 19:25:13.084101 65113 fix.go:229] Guest: 2024-07-19 19:25:13.046702003 +0000 UTC Remote: 2024-07-19 19:25:12.974509819 +0000 UTC m=+26.255657653 (delta=72.192184ms)
I0719 19:25:13.084119 65113 fix.go:200] guest clock delta is within tolerance: 72.192184ms
I0719 19:25:13.084124 65113 start.go:83] releasing machines lock for "old-k8s-version-570369", held for 21.031406854s
I0719 19:25:13.084148 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .DriverName
I0719 19:25:13.084465 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetIP
I0719 19:25:13.087226 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | domain old-k8s-version-570369 has defined MAC address 52:54:00:80:e3:2b in network mk-old-k8s-version-570369
I0719 19:25:13.087634 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:80:e3:2b", ip: ""} in network mk-old-k8s-version-570369: {Iface:virbr2 ExpiryTime:2024-07-19 20:25:06 +0000 UTC Type:0 Mac:52:54:00:80:e3:2b Iaid: IPaddr:192.168.39.220 Prefix:24 Hostname:old-k8s-version-570369 Clientid:01:52:54:00:80:e3:2b}
I0719 19:25:13.087666 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | domain old-k8s-version-570369 has defined IP address 192.168.39.220 and MAC address 52:54:00:80:e3:2b in network mk-old-k8s-version-570369
I0719 19:25:13.087824 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .DriverName
I0719 19:25:13.088389 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .DriverName
I0719 19:25:13.088565 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .DriverName
I0719 19:25:13.088659 65113 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0719 19:25:13.088703 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetSSHHostname
I0719 19:25:13.088760 65113 ssh_runner.go:195] Run: cat /version.json
I0719 19:25:13.088783 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetSSHHostname
I0719 19:25:13.091368 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | domain old-k8s-version-570369 has defined MAC address 52:54:00:80:e3:2b in network mk-old-k8s-version-570369
I0719 19:25:13.091732 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:80:e3:2b", ip: ""} in network mk-old-k8s-version-570369: {Iface:virbr2 ExpiryTime:2024-07-19 20:25:06 +0000 UTC Type:0 Mac:52:54:00:80:e3:2b Iaid: IPaddr:192.168.39.220 Prefix:24 Hostname:old-k8s-version-570369 Clientid:01:52:54:00:80:e3:2b}
I0719 19:25:13.091821 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | domain old-k8s-version-570369 has defined IP address 192.168.39.220 and MAC address 52:54:00:80:e3:2b in network mk-old-k8s-version-570369
I0719 19:25:13.091875 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | domain old-k8s-version-570369 has defined MAC address 52:54:00:80:e3:2b in network mk-old-k8s-version-570369
I0719 19:25:13.091904 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetSSHPort
I0719 19:25:13.092069 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetSSHKeyPath
I0719 19:25:13.092221 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetSSHUsername
I0719 19:25:13.092242 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:80:e3:2b", ip: ""} in network mk-old-k8s-version-570369: {Iface:virbr2 ExpiryTime:2024-07-19 20:25:06 +0000 UTC Type:0 Mac:52:54:00:80:e3:2b Iaid: IPaddr:192.168.39.220 Prefix:24 Hostname:old-k8s-version-570369 Clientid:01:52:54:00:80:e3:2b}
I0719 19:25:13.092279 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | domain old-k8s-version-570369 has defined IP address 192.168.39.220 and MAC address 52:54:00:80:e3:2b in network mk-old-k8s-version-570369
I0719 19:25:13.092342 65113 sshutil.go:53] new ssh client: &{IP:192.168.39.220 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19307-14841/.minikube/machines/old-k8s-version-570369/id_rsa Username:docker}
I0719 19:25:13.092418 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetSSHPort
I0719 19:25:13.092555 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetSSHKeyPath
I0719 19:25:13.092703 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetSSHUsername
I0719 19:25:13.092877 65113 sshutil.go:53] new ssh client: &{IP:192.168.39.220 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19307-14841/.minikube/machines/old-k8s-version-570369/id_rsa Username:docker}
I0719 19:25:13.222667 65113 ssh_runner.go:195] Run: systemctl --version
I0719 19:25:13.229930 65113 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0719 19:25:13.389152 65113 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0719 19:25:13.397366 65113 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0719 19:25:13.397434 65113 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0719 19:25:13.417521 65113 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0719 19:25:13.417550 65113 start.go:495] detecting cgroup driver to use...
I0719 19:25:13.417617 65113 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0719 19:25:13.435143 65113 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0719 19:25:13.452657 65113 docker.go:217] disabling cri-docker service (if available) ...
I0719 19:25:13.452726 65113 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0719 19:25:13.470809 65113 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0719 19:25:13.486767 65113 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0719 19:25:13.624734 65113 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0719 19:25:13.781004 65113 docker.go:233] disabling docker service ...
I0719 19:25:13.781083 65113 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0719 19:25:13.796845 65113 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0719 19:25:13.812336 65113 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0719 19:25:13.962842 65113 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0719 19:25:14.090594 65113 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0719 19:25:14.104569 65113 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0719 19:25:14.121918 65113 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0719 19:25:14.121982 65113 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0719 19:25:14.131932 65113 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0719 19:25:14.131994 65113 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0719 19:25:14.144530 65113 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0719 19:25:14.154355 65113 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0719 19:25:14.163859 65113 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0719 19:25:14.173710 65113 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0719 19:25:14.182589 65113 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0719 19:25:14.182632 65113 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0719 19:25:14.194812 65113 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0719 19:25:14.203921 65113 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0719 19:25:14.318322 65113 ssh_runner.go:195] Run: sudo systemctl restart crio
I0719 19:25:14.495411 65113 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0719 19:25:14.495488 65113 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0719 19:25:14.501604 65113 start.go:563] Will wait 60s for crictl version
I0719 19:25:14.501662 65113 ssh_runner.go:195] Run: which crictl
I0719 19:25:14.505975 65113 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0719 19:25:14.546509 65113 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0719 19:25:14.546618 65113 ssh_runner.go:195] Run: crio --version
I0719 19:25:14.588192 65113 ssh_runner.go:195] Run: crio --version
I0719 19:25:14.623792 65113 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0719 19:25:14.624823 65113 main.go:141] libmachine: (old-k8s-version-570369) Calling .GetIP
I0719 19:25:14.628090 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | domain old-k8s-version-570369 has defined MAC address 52:54:00:80:e3:2b in network mk-old-k8s-version-570369
I0719 19:25:14.628501 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:80:e3:2b", ip: ""} in network mk-old-k8s-version-570369: {Iface:virbr2 ExpiryTime:2024-07-19 20:25:06 +0000 UTC Type:0 Mac:52:54:00:80:e3:2b Iaid: IPaddr:192.168.39.220 Prefix:24 Hostname:old-k8s-version-570369 Clientid:01:52:54:00:80:e3:2b}
I0719 19:25:14.628524 65113 main.go:141] libmachine: (old-k8s-version-570369) DBG | domain old-k8s-version-570369 has defined IP address 192.168.39.220 and MAC address 52:54:00:80:e3:2b in network mk-old-k8s-version-570369
I0719 19:25:14.628748 65113 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I0719 19:25:14.633863 65113 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0719 19:25:14.649388 65113 kubeadm.go:883] updating cluster {Name:old-k8s-version-570369 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19298/minikube-v1.33.1-1721324531-19298-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-570369 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.220 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] M
ountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0719 19:25:14.649528 65113 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0719 19:25:14.649598 65113 ssh_runner.go:195] Run: sudo crictl images --output json
I0719 19:25:14.682758 65113 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0719 19:25:14.682831 65113 ssh_runner.go:195] Run: which lz4
I0719 19:25:14.687813 65113 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0719 19:25:14.693121 65113 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0719 19:25:14.693158 65113 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19307-14841/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0719 19:25:16.198992 65113 crio.go:462] duration metric: took 1.511213625s to copy over tarball
I0719 19:25:16.199077 65113 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0719 19:25:19.116871 65113 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.917754749s)
I0719 19:25:19.116909 65113 crio.go:469] duration metric: took 2.917883315s to extract the tarball
I0719 19:25:19.116918 65113 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0719 19:25:19.158429 65113 ssh_runner.go:195] Run: sudo crictl images --output json
I0719 19:25:19.201773 65113 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0719 19:25:19.201798 65113 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0719 19:25:19.201872 65113 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0719 19:25:19.201893 65113 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0719 19:25:19.201892 65113 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0719 19:25:19.201943 65113 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0719 19:25:19.201876 65113 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0719 19:25:19.202142 65113 image.go:134] retrieving image: registry.k8s.io/pause:3.2
I0719 19:25:19.202114 65113 image.go:134] retrieving image: registry.k8s.io/coredns:1.7.0
I0719 19:25:19.201876 65113 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0719 19:25:19.203202 65113 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0719 19:25:19.203246 65113 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0719 19:25:19.203918 65113 image.go:177] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0719 19:25:19.203927 65113 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0719 19:25:19.203936 65113 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0719 19:25:19.203938 65113 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0719 19:25:19.204002 65113 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0719 19:25:19.204003 65113 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0719 19:25:19.431350 65113 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0719 19:25:19.468154 65113 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0719 19:25:19.472136 65113 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0719 19:25:19.472832 65113 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0719 19:25:19.472886 65113 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0719 19:25:19.472936 65113 ssh_runner.go:195] Run: which crictl
I0719 19:25:19.474064 65113 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0719 19:25:19.488243 65113 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0719 19:25:19.488498 65113 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0719 19:25:19.495067 65113 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0719 19:25:19.630243 65113 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0719 19:25:19.630281 65113 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0719 19:25:19.630333 65113 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0719 19:25:19.630373 65113 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0719 19:25:19.630421 65113 ssh_runner.go:195] Run: which crictl
I0719 19:25:19.630438 65113 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0719 19:25:19.630345 65113 ssh_runner.go:195] Run: which crictl
I0719 19:25:19.641299 65113 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0719 19:25:19.641337 65113 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0719 19:25:19.641377 65113 ssh_runner.go:195] Run: which crictl
I0719 19:25:19.641429 65113 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0719 19:25:19.641467 65113 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0719 19:25:19.641479 65113 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0719 19:25:19.641502 65113 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0719 19:25:19.641507 65113 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0719 19:25:19.641511 65113 ssh_runner.go:195] Run: which crictl
I0719 19:25:19.641525 65113 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0719 19:25:19.641544 65113 ssh_runner.go:195] Run: which crictl
I0719 19:25:19.641554 65113 ssh_runner.go:195] Run: which crictl
I0719 19:25:19.672961 65113 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0719 19:25:19.673019 65113 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0719 19:25:19.673044 65113 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0719 19:25:19.673084 65113 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19307-14841/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0719 19:25:19.673142 65113 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0719 19:25:19.673149 65113 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0719 19:25:19.673202 65113 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0719 19:25:19.797213 65113 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19307-14841/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0719 19:25:19.797266 65113 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19307-14841/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0719 19:25:19.797314 65113 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19307-14841/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0719 19:25:19.797373 65113 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19307-14841/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0719 19:25:19.797398 65113 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19307-14841/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0719 19:25:19.797448 65113 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19307-14841/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0719 19:25:20.486805 65113 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0719 19:25:20.623457 65113 cache_images.go:92] duration metric: took 1.421643712s to LoadCachedImages
W0719 19:25:20.623561 65113 out.go:239] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19307-14841/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19307-14841/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2: no such file or directory
I0719 19:25:20.623581 65113 kubeadm.go:934] updating node { 192.168.39.220 8443 v1.20.0 crio true true} ...
I0719 19:25:20.623709 65113 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-570369 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.39.220
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-570369 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0719 19:25:20.623772 65113 ssh_runner.go:195] Run: crio config
I0719 19:25:20.675456 65113 cni.go:84] Creating CNI manager for ""
I0719 19:25:20.675478 65113 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0719 19:25:20.675486 65113 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0719 19:25:20.675508 65113 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.220 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-570369 NodeName:old-k8s-version-570369 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.220"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.220 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0719 19:25:20.675643 65113 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.39.220
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-570369"
kubeletExtraArgs:
node-ip: 192.168.39.220
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.39.220"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0719 19:25:20.675701 65113 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0719 19:25:20.686000 65113 binaries.go:44] Found k8s binaries, skipping transfer
I0719 19:25:20.686071 65113 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0719 19:25:20.696066 65113 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0719 19:25:20.712140 65113 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0719 19:25:20.727498 65113 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0719 19:25:20.743954 65113 ssh_runner.go:195] Run: grep 192.168.39.220 control-plane.minikube.internal$ /etc/hosts
I0719 19:25:20.747396 65113 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.220 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0719 19:25:20.758968 65113 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0719 19:25:20.889758 65113 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0719 19:25:20.905948 65113 certs.go:68] Setting up /home/jenkins/minikube-integration/19307-14841/.minikube/profiles/old-k8s-version-570369 for IP: 192.168.39.220
I0719 19:25:20.905964 65113 certs.go:194] generating shared ca certs ...
I0719 19:25:20.905978 65113 certs.go:226] acquiring lock for ca certs: {Name:mk8941444a80e72b310c1e070843c9ed097d9f7a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0719 19:25:20.906119 65113 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19307-14841/.minikube/ca.key
I0719 19:25:20.906155 65113 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19307-14841/.minikube/proxy-client-ca.key
I0719 19:25:20.906164 65113 certs.go:256] generating profile certs ...
I0719 19:25:20.906214 65113 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19307-14841/.minikube/profiles/old-k8s-version-570369/client.key
I0719 19:25:20.906232 65113 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19307-14841/.minikube/profiles/old-k8s-version-570369/client.crt with IP's: []
I0719 19:25:21.039126 65113 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19307-14841/.minikube/profiles/old-k8s-version-570369/client.crt ...
I0719 19:25:21.039158 65113 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19307-14841/.minikube/profiles/old-k8s-version-570369/client.crt: {Name:mk0c0717927b787bb9a6c29182f44712ce9fe3ea Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0719 19:25:21.039374 65113 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19307-14841/.minikube/profiles/old-k8s-version-570369/client.key ...
I0719 19:25:21.039398 65113 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19307-14841/.minikube/profiles/old-k8s-version-570369/client.key: {Name:mkcff3a4be82bcd0ab02bb354461057bce059fa8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0719 19:25:21.039529 65113 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19307-14841/.minikube/profiles/old-k8s-version-570369/apiserver.key.41bb110d
I0719 19:25:21.039554 65113 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19307-14841/.minikube/profiles/old-k8s-version-570369/apiserver.crt.41bb110d with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.220]
I0719 19:25:21.186701 65113 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19307-14841/.minikube/profiles/old-k8s-version-570369/apiserver.crt.41bb110d ...
I0719 19:25:21.186739 65113 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19307-14841/.minikube/profiles/old-k8s-version-570369/apiserver.crt.41bb110d: {Name:mkadcc6bb9c4c7be3c012cf09af260a515801ef9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0719 19:25:21.186932 65113 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19307-14841/.minikube/profiles/old-k8s-version-570369/apiserver.key.41bb110d ...
I0719 19:25:21.186962 65113 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19307-14841/.minikube/profiles/old-k8s-version-570369/apiserver.key.41bb110d: {Name:mkbfaee0b7d4f20fc1b2d4ab30d4281e256b705e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0719 19:25:21.187060 65113 certs.go:381] copying /home/jenkins/minikube-integration/19307-14841/.minikube/profiles/old-k8s-version-570369/apiserver.crt.41bb110d -> /home/jenkins/minikube-integration/19307-14841/.minikube/profiles/old-k8s-version-570369/apiserver.crt
I0719 19:25:21.187158 65113 certs.go:385] copying /home/jenkins/minikube-integration/19307-14841/.minikube/profiles/old-k8s-version-570369/apiserver.key.41bb110d -> /home/jenkins/minikube-integration/19307-14841/.minikube/profiles/old-k8s-version-570369/apiserver.key
I0719 19:25:21.187239 65113 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19307-14841/.minikube/profiles/old-k8s-version-570369/proxy-client.key
I0719 19:25:21.187263 65113 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19307-14841/.minikube/profiles/old-k8s-version-570369/proxy-client.crt with IP's: []
I0719 19:25:21.350294 65113 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19307-14841/.minikube/profiles/old-k8s-version-570369/proxy-client.crt ...
I0719 19:25:21.350324 65113 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19307-14841/.minikube/profiles/old-k8s-version-570369/proxy-client.crt: {Name:mkff46854d4c04b2afbe102ad3d53582d31fac2a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0719 19:25:21.350481 65113 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19307-14841/.minikube/profiles/old-k8s-version-570369/proxy-client.key ...
I0719 19:25:21.350493 65113 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19307-14841/.minikube/profiles/old-k8s-version-570369/proxy-client.key: {Name:mk45f7518ac8f2682dcf8a6b5556cceea6e85d84 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0719 19:25:21.350655 65113 certs.go:484] found cert: /home/jenkins/minikube-integration/19307-14841/.minikube/certs/22028.pem (1338 bytes)
W0719 19:25:21.350692 65113 certs.go:480] ignoring /home/jenkins/minikube-integration/19307-14841/.minikube/certs/22028_empty.pem, impossibly tiny 0 bytes
I0719 19:25:21.350701 65113 certs.go:484] found cert: /home/jenkins/minikube-integration/19307-14841/.minikube/certs/ca-key.pem (1675 bytes)
I0719 19:25:21.350726 65113 certs.go:484] found cert: /home/jenkins/minikube-integration/19307-14841/.minikube/certs/ca.pem (1078 bytes)
I0719 19:25:21.350767 65113 certs.go:484] found cert: /home/jenkins/minikube-integration/19307-14841/.minikube/certs/cert.pem (1123 bytes)
I0719 19:25:21.350797 65113 certs.go:484] found cert: /home/jenkins/minikube-integration/19307-14841/.minikube/certs/key.pem (1679 bytes)
I0719 19:25:21.350834 65113 certs.go:484] found cert: /home/jenkins/minikube-integration/19307-14841/.minikube/files/etc/ssl/certs/220282.pem (1708 bytes)
I0719 19:25:21.351424 65113 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19307-14841/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0719 19:25:21.376565 65113 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19307-14841/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0719 19:25:21.401761 65113 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19307-14841/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0719 19:25:21.426108 65113 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19307-14841/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0719 19:25:21.449274 65113 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19307-14841/.minikube/profiles/old-k8s-version-570369/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0719 19:25:21.472921 65113 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19307-14841/.minikube/profiles/old-k8s-version-570369/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0719 19:25:21.496418 65113 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19307-14841/.minikube/profiles/old-k8s-version-570369/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0719 19:25:21.547974 65113 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19307-14841/.minikube/profiles/old-k8s-version-570369/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0719 19:25:21.572554 65113 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19307-14841/.minikube/certs/22028.pem --> /usr/share/ca-certificates/22028.pem (1338 bytes)
I0719 19:25:21.596778 65113 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19307-14841/.minikube/files/etc/ssl/certs/220282.pem --> /usr/share/ca-certificates/220282.pem (1708 bytes)
I0719 19:25:21.619518 65113 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19307-14841/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0719 19:25:21.642300 65113 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0719 19:25:21.658505 65113 ssh_runner.go:195] Run: openssl version
I0719 19:25:21.664365 65113 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/22028.pem && ln -fs /usr/share/ca-certificates/22028.pem /etc/ssl/certs/22028.pem"
I0719 19:25:21.674743 65113 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/22028.pem
I0719 19:25:21.678951 65113 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jul 19 18:26 /usr/share/ca-certificates/22028.pem
I0719 19:25:21.679007 65113 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/22028.pem
I0719 19:25:21.684625 65113 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/22028.pem /etc/ssl/certs/51391683.0"
I0719 19:25:21.694878 65113 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/220282.pem && ln -fs /usr/share/ca-certificates/220282.pem /etc/ssl/certs/220282.pem"
I0719 19:25:21.705292 65113 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/220282.pem
I0719 19:25:21.709676 65113 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jul 19 18:26 /usr/share/ca-certificates/220282.pem
I0719 19:25:21.709735 65113 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/220282.pem
I0719 19:25:21.715061 65113 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/220282.pem /etc/ssl/certs/3ec20f2e.0"
I0719 19:25:21.725472 65113 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0719 19:25:21.735799 65113 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0719 19:25:21.739954 65113 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jul 19 18:15 /usr/share/ca-certificates/minikubeCA.pem
I0719 19:25:21.740013 65113 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0719 19:25:21.745450 65113 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0719 19:25:21.756026 65113 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0719 19:25:21.759745 65113 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0719 19:25:21.759819 65113 kubeadm.go:392] StartCluster: {Name:old-k8s-version-570369 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19298/minikube-v1.33.1-1721324531-19298-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-570369 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.220 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0719 19:25:21.759920 65113 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0719 19:25:21.759980 65113 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0719 19:25:21.798868 65113 cri.go:89] found id: ""
I0719 19:25:21.798963 65113 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0719 19:25:21.808723 65113 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0719 19:25:21.820804 65113 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0719 19:25:21.830669 65113 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0719 19:25:21.830691 65113 kubeadm.go:157] found existing configuration files:
I0719 19:25:21.830743 65113 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0719 19:25:21.839685 65113 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0719 19:25:21.839762 65113 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0719 19:25:21.849166 65113 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0719 19:25:21.858491 65113 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0719 19:25:21.858541 65113 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0719 19:25:21.871326 65113 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0719 19:25:21.881930 65113 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0719 19:25:21.881990 65113 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0719 19:25:21.897810 65113 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0719 19:25:21.907889 65113 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0719 19:25:21.907940 65113 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0719 19:25:21.919872 65113 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0719 19:25:22.042825 65113 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0719 19:25:22.042907 65113 kubeadm.go:310] [preflight] Running pre-flight checks
I0719 19:25:22.200052 65113 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0719 19:25:22.200195 65113 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0719 19:25:22.200314 65113 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0719 19:25:22.419955 65113 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0719 19:25:22.422797 65113 out.go:204] - Generating certificates and keys ...
I0719 19:25:22.422900 65113 kubeadm.go:310] [certs] Using existing ca certificate authority
I0719 19:25:22.422992 65113 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0719 19:25:22.641790 65113 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0719 19:25:22.778960 65113 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0719 19:25:22.945382 65113 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0719 19:25:23.101536 65113 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0719 19:25:23.269669 65113 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0719 19:25:23.270081 65113 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-570369] and IPs [192.168.39.220 127.0.0.1 ::1]
I0719 19:25:23.399167 65113 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0719 19:25:23.399381 65113 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-570369] and IPs [192.168.39.220 127.0.0.1 ::1]
I0719 19:25:23.604808 65113 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0719 19:25:24.012178 65113 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0719 19:25:24.426962 65113 kubeadm.go:310] [certs] Generating "sa" key and public key
I0719 19:25:24.427119 65113 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0719 19:25:24.547262 65113 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0719 19:25:24.644618 65113 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0719 19:25:24.772027 65113 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0719 19:25:24.984612 65113 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0719 19:25:25.000921 65113 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0719 19:25:25.002746 65113 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0719 19:25:25.002817 65113 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0719 19:25:25.144478 65113 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0719 19:25:25.233336 65113 out.go:204] - Booting up control plane ...
I0719 19:25:25.233471 65113 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0719 19:25:25.233585 65113 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0719 19:25:25.233711 65113 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0719 19:25:25.233845 65113 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0719 19:25:25.234043 65113 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0719 19:26:05.136512 65113 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0719 19:26:05.137223 65113 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0719 19:26:05.137501 65113 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0719 19:26:10.136419 65113 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0719 19:26:10.136605 65113 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0719 19:26:20.135577 65113 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0719 19:26:20.135784 65113 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0719 19:26:40.136336 65113 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0719 19:26:40.136592 65113 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0719 19:27:20.134981 65113 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0719 19:27:20.135257 65113 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0719 19:27:20.135282 65113 kubeadm.go:310]
I0719 19:27:20.135348 65113 kubeadm.go:310] Unfortunately, an error has occurred:
I0719 19:27:20.135422 65113 kubeadm.go:310] timed out waiting for the condition
I0719 19:27:20.135433 65113 kubeadm.go:310]
I0719 19:27:20.135479 65113 kubeadm.go:310] This error is likely caused by:
I0719 19:27:20.135522 65113 kubeadm.go:310] - The kubelet is not running
I0719 19:27:20.135655 65113 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0719 19:27:20.135667 65113 kubeadm.go:310]
I0719 19:27:20.135796 65113 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0719 19:27:20.135861 65113 kubeadm.go:310] - 'systemctl status kubelet'
I0719 19:27:20.135904 65113 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0719 19:27:20.135910 65113 kubeadm.go:310]
I0719 19:27:20.135994 65113 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0719 19:27:20.136058 65113 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0719 19:27:20.136064 65113 kubeadm.go:310]
I0719 19:27:20.136139 65113 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0719 19:27:20.136206 65113 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0719 19:27:20.136285 65113 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0719 19:27:20.136368 65113 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0719 19:27:20.136380 65113 kubeadm.go:310]
I0719 19:27:20.136964 65113 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0719 19:27:20.137065 65113 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0719 19:27:20.137146 65113 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
W0719 19:27:20.137298 65113 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-570369] and IPs [192.168.39.220 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-570369] and IPs [192.168.39.220 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-570369] and IPs [192.168.39.220 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-570369] and IPs [192.168.39.220 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0719 19:27:20.137358 65113 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0719 19:27:20.617718 65113 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0719 19:27:20.633031 65113 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0719 19:27:20.642444 65113 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0719 19:27:20.642464 65113 kubeadm.go:157] found existing configuration files:
I0719 19:27:20.642512 65113 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0719 19:27:20.651559 65113 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0719 19:27:20.651618 65113 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0719 19:27:20.661343 65113 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0719 19:27:20.671275 65113 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0719 19:27:20.671332 65113 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0719 19:27:20.684528 65113 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0719 19:27:20.694337 65113 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0719 19:27:20.694405 65113 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0719 19:27:20.706165 65113 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0719 19:27:20.716845 65113 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0719 19:27:20.716903 65113 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0719 19:27:20.726664 65113 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0719 19:27:20.799892 65113 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0719 19:27:20.799959 65113 kubeadm.go:310] [preflight] Running pre-flight checks
I0719 19:27:20.951514 65113 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0719 19:27:20.951659 65113 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0719 19:27:20.951777 65113 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0719 19:27:21.140034 65113 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0719 19:27:21.143045 65113 out.go:204] - Generating certificates and keys ...
I0719 19:27:21.143160 65113 kubeadm.go:310] [certs] Using existing ca certificate authority
I0719 19:27:21.143242 65113 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0719 19:27:21.143353 65113 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0719 19:27:21.143444 65113 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0719 19:27:21.143557 65113 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0719 19:27:21.143652 65113 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0719 19:27:21.143735 65113 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0719 19:27:21.143810 65113 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0719 19:27:21.143923 65113 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0719 19:27:21.144047 65113 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0719 19:27:21.144113 65113 kubeadm.go:310] [certs] Using the existing "sa" key
I0719 19:27:21.144195 65113 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0719 19:27:21.275403 65113 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0719 19:27:21.693185 65113 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0719 19:27:21.818726 65113 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0719 19:27:22.046389 65113 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0719 19:27:22.067369 65113 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0719 19:27:22.068424 65113 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0719 19:27:22.068510 65113 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0719 19:27:22.201200 65113 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0719 19:27:22.203215 65113 out.go:204] - Booting up control plane ...
I0719 19:27:22.203358 65113 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0719 19:27:22.214399 65113 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0719 19:27:22.215300 65113 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0719 19:27:22.215960 65113 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0719 19:27:22.218109 65113 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0719 19:28:02.220303 65113 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0719 19:28:02.220391 65113 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0719 19:28:02.220577 65113 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0719 19:28:07.221150 65113 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0719 19:28:07.221414 65113 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0719 19:28:17.221921 65113 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0719 19:28:17.222124 65113 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0719 19:28:37.223621 65113 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0719 19:28:37.223809 65113 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0719 19:29:17.222914 65113 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0719 19:29:17.223158 65113 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0719 19:29:17.223178 65113 kubeadm.go:310]
I0719 19:29:17.223237 65113 kubeadm.go:310] Unfortunately, an error has occurred:
I0719 19:29:17.223294 65113 kubeadm.go:310] timed out waiting for the condition
I0719 19:29:17.223304 65113 kubeadm.go:310]
I0719 19:29:17.223356 65113 kubeadm.go:310] This error is likely caused by:
I0719 19:29:17.223409 65113 kubeadm.go:310] - The kubelet is not running
I0719 19:29:17.223562 65113 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0719 19:29:17.223586 65113 kubeadm.go:310]
I0719 19:29:17.223732 65113 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0719 19:29:17.223801 65113 kubeadm.go:310] - 'systemctl status kubelet'
I0719 19:29:17.223873 65113 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0719 19:29:17.223883 65113 kubeadm.go:310]
I0719 19:29:17.223998 65113 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0719 19:29:17.224118 65113 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0719 19:29:17.224129 65113 kubeadm.go:310]
I0719 19:29:17.224253 65113 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0719 19:29:17.224406 65113 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0719 19:29:17.224519 65113 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0719 19:29:17.224619 65113 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0719 19:29:17.224632 65113 kubeadm.go:310]
I0719 19:29:17.225254 65113 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0719 19:29:17.225374 65113 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0719 19:29:17.225478 65113 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0719 19:29:17.225562 65113 kubeadm.go:394] duration metric: took 3m55.465747381s to StartCluster
I0719 19:29:17.225615 65113 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0719 19:29:17.225671 65113 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0719 19:29:17.263830 65113 cri.go:89] found id: ""
I0719 19:29:17.263877 65113 logs.go:276] 0 containers: []
W0719 19:29:17.263887 65113 logs.go:278] No container was found matching "kube-apiserver"
I0719 19:29:17.263894 65113 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0719 19:29:17.263955 65113 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0719 19:29:17.294800 65113 cri.go:89] found id: ""
I0719 19:29:17.294833 65113 logs.go:276] 0 containers: []
W0719 19:29:17.294843 65113 logs.go:278] No container was found matching "etcd"
I0719 19:29:17.294848 65113 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0719 19:29:17.294907 65113 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0719 19:29:17.328134 65113 cri.go:89] found id: ""
I0719 19:29:17.328161 65113 logs.go:276] 0 containers: []
W0719 19:29:17.328168 65113 logs.go:278] No container was found matching "coredns"
I0719 19:29:17.328173 65113 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0719 19:29:17.328219 65113 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0719 19:29:17.364163 65113 cri.go:89] found id: ""
I0719 19:29:17.364189 65113 logs.go:276] 0 containers: []
W0719 19:29:17.364197 65113 logs.go:278] No container was found matching "kube-scheduler"
I0719 19:29:17.364203 65113 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0719 19:29:17.364247 65113 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0719 19:29:17.394203 65113 cri.go:89] found id: ""
I0719 19:29:17.394230 65113 logs.go:276] 0 containers: []
W0719 19:29:17.394239 65113 logs.go:278] No container was found matching "kube-proxy"
I0719 19:29:17.394245 65113 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0719 19:29:17.394290 65113 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0719 19:29:17.427733 65113 cri.go:89] found id: ""
I0719 19:29:17.427763 65113 logs.go:276] 0 containers: []
W0719 19:29:17.427772 65113 logs.go:278] No container was found matching "kube-controller-manager"
I0719 19:29:17.427777 65113 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0719 19:29:17.427922 65113 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0719 19:29:17.459107 65113 cri.go:89] found id: ""
I0719 19:29:17.459135 65113 logs.go:276] 0 containers: []
W0719 19:29:17.459146 65113 logs.go:278] No container was found matching "kindnet"
I0719 19:29:17.459163 65113 logs.go:123] Gathering logs for kubelet ...
I0719 19:29:17.459178 65113 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0719 19:29:17.508505 65113 logs.go:123] Gathering logs for dmesg ...
I0719 19:29:17.508536 65113 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0719 19:29:17.521136 65113 logs.go:123] Gathering logs for describe nodes ...
I0719 19:29:17.521165 65113 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0719 19:29:17.630674 65113 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0719 19:29:17.630695 65113 logs.go:123] Gathering logs for CRI-O ...
I0719 19:29:17.630710 65113 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0719 19:29:17.727001 65113 logs.go:123] Gathering logs for container status ...
I0719 19:29:17.727040 65113 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0719 19:29:17.762797 65113 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0719 19:29:17.762842 65113 out.go:239] *
*
W0719 19:29:17.762892 65113 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0719 19:29:17.762919 65113 out.go:239] *
*
W0719 19:29:17.764165 65113 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0719 19:29:17.770367 65113 out.go:177]
W0719 19:29:17.771584 65113 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0719 19:29:17.771633 65113 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0719 19:29:17.771648 65113 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0719 19:29:17.773051 65113 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-570369 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-570369 -n old-k8s-version-570369
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-570369 -n old-k8s-version-570369: exit status 6 (240.883883ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0719 19:29:18.062337 68029 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-570369" does not appear in /home/jenkins/minikube-integration/19307-14841/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-570369" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (271.36s)