=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-496808 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-496808 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m41.673989091s)
-- stdout --
* [old-k8s-version-496808] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=18333
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/18333-911675/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/18333-911675/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-496808" primary control-plane node in "old-k8s-version-496808" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0308 04:04:03.481454 956560 out.go:291] Setting OutFile to fd 1 ...
I0308 04:04:03.481574 956560 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0308 04:04:03.481590 956560 out.go:304] Setting ErrFile to fd 2...
I0308 04:04:03.481594 956560 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0308 04:04:03.481807 956560 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18333-911675/.minikube/bin
I0308 04:04:03.482409 956560 out.go:298] Setting JSON to false
I0308 04:04:03.483515 956560 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-13","uptime":27970,"bootTime":1709842674,"procs":220,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1053-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0308 04:04:03.484079 956560 start.go:139] virtualization: kvm guest
I0308 04:04:03.487038 956560 out.go:177] * [old-k8s-version-496808] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
I0308 04:04:03.488909 956560 out.go:177] - MINIKUBE_LOCATION=18333
I0308 04:04:03.490435 956560 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0308 04:04:03.488909 956560 notify.go:220] Checking for updates...
I0308 04:04:03.492167 956560 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18333-911675/kubeconfig
I0308 04:04:03.493686 956560 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18333-911675/.minikube
I0308 04:04:03.495125 956560 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0308 04:04:03.496515 956560 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0308 04:04:03.498585 956560 config.go:182] Loaded profile config "cert-expiration-401581": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0308 04:04:03.498755 956560 config.go:182] Loaded profile config "force-systemd-env-292856": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0308 04:04:03.498912 956560 config.go:182] Loaded profile config "kubernetes-upgrade-219954": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.29.0-rc.2
I0308 04:04:03.499048 956560 driver.go:392] Setting default libvirt URI to qemu:///system
I0308 04:04:03.541326 956560 out.go:177] * Using the kvm2 driver based on user configuration
I0308 04:04:03.542661 956560 start.go:297] selected driver: kvm2
I0308 04:04:03.542680 956560 start.go:901] validating driver "kvm2" against <nil>
I0308 04:04:03.542696 956560 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0308 04:04:03.543465 956560 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0308 04:04:03.543596 956560 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/18333-911675/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0308 04:04:03.560341 956560 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.32.0
I0308 04:04:03.560393 956560 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0308 04:04:03.560622 956560 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0308 04:04:03.560697 956560 cni.go:84] Creating CNI manager for ""
I0308 04:04:03.560710 956560 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0308 04:04:03.560719 956560 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0308 04:04:03.560769 956560 start.go:340] cluster config:
{Name:old-k8s-version-496808 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-496808 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0308 04:04:03.560866 956560 iso.go:125] acquiring lock: {Name:mk32d156c748b457afd5db822e9825f7e52fc960 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0308 04:04:03.563692 956560 out.go:177] * Starting "old-k8s-version-496808" primary control-plane node in "old-k8s-version-496808" cluster
I0308 04:04:03.565119 956560 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0308 04:04:03.565199 956560 preload.go:147] Found local preload: /home/jenkins/minikube-integration/18333-911675/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0308 04:04:03.565214 956560 cache.go:56] Caching tarball of preloaded images
I0308 04:04:03.565339 956560 preload.go:173] Found /home/jenkins/minikube-integration/18333-911675/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0308 04:04:03.565356 956560 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0308 04:04:03.565459 956560 profile.go:142] Saving config to /home/jenkins/minikube-integration/18333-911675/.minikube/profiles/old-k8s-version-496808/config.json ...
I0308 04:04:03.565478 956560 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18333-911675/.minikube/profiles/old-k8s-version-496808/config.json: {Name:mk271a2bcf5b0fb2154966e5daca22ef37eb427b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0308 04:04:03.565642 956560 start.go:360] acquireMachinesLock for old-k8s-version-496808: {Name:mkbe5f6692e9dd9c44a0d74f7d275f14772a7948 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0308 04:04:12.354588 956560 start.go:364] duration metric: took 8.788882277s to acquireMachinesLock for "old-k8s-version-496808"
I0308 04:04:12.354667 956560 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-496808 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-496808 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0308 04:04:12.354807 956560 start.go:125] createHost starting for "" (driver="kvm2")
I0308 04:04:12.357067 956560 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0308 04:04:12.357314 956560 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0308 04:04:12.357385 956560 main.go:141] libmachine: Launching plugin server for driver kvm2
I0308 04:04:12.376323 956560 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37557
I0308 04:04:12.376854 956560 main.go:141] libmachine: () Calling .GetVersion
I0308 04:04:12.377531 956560 main.go:141] libmachine: Using API Version 1
I0308 04:04:12.377566 956560 main.go:141] libmachine: () Calling .SetConfigRaw
I0308 04:04:12.377969 956560 main.go:141] libmachine: () Calling .GetMachineName
I0308 04:04:12.378217 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetMachineName
I0308 04:04:12.378401 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .DriverName
I0308 04:04:12.378585 956560 start.go:159] libmachine.API.Create for "old-k8s-version-496808" (driver="kvm2")
I0308 04:04:12.378653 956560 client.go:168] LocalClient.Create starting
I0308 04:04:12.378694 956560 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18333-911675/.minikube/certs/ca.pem
I0308 04:04:12.378740 956560 main.go:141] libmachine: Decoding PEM data...
I0308 04:04:12.378767 956560 main.go:141] libmachine: Parsing certificate...
I0308 04:04:12.378839 956560 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18333-911675/.minikube/certs/cert.pem
I0308 04:04:12.378868 956560 main.go:141] libmachine: Decoding PEM data...
I0308 04:04:12.378884 956560 main.go:141] libmachine: Parsing certificate...
I0308 04:04:12.378904 956560 main.go:141] libmachine: Running pre-create checks...
I0308 04:04:12.378916 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .PreCreateCheck
I0308 04:04:12.379600 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetConfigRaw
I0308 04:04:12.380107 956560 main.go:141] libmachine: Creating machine...
I0308 04:04:12.380127 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .Create
I0308 04:04:12.380317 956560 main.go:141] libmachine: (old-k8s-version-496808) Creating KVM machine...
I0308 04:04:12.381700 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | found existing default KVM network
I0308 04:04:12.383050 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | I0308 04:04:12.382896 956779 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000015730}
I0308 04:04:12.383092 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | created network xml:
I0308 04:04:12.383115 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | <network>
I0308 04:04:12.383134 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | <name>mk-old-k8s-version-496808</name>
I0308 04:04:12.383149 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | <dns enable='no'/>
I0308 04:04:12.383156 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG |
I0308 04:04:12.383166 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | <ip address='192.168.39.1' netmask='255.255.255.0'>
I0308 04:04:12.383183 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | <dhcp>
I0308 04:04:12.383196 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | <range start='192.168.39.2' end='192.168.39.253'/>
I0308 04:04:12.383211 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | </dhcp>
I0308 04:04:12.383227 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | </ip>
I0308 04:04:12.383237 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG |
I0308 04:04:12.383268 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | </network>
I0308 04:04:12.383300 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG |
I0308 04:04:12.389080 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | trying to create private KVM network mk-old-k8s-version-496808 192.168.39.0/24...
I0308 04:04:12.460541 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | private KVM network mk-old-k8s-version-496808 192.168.39.0/24 created
I0308 04:04:12.460592 956560 main.go:141] libmachine: (old-k8s-version-496808) Setting up store path in /home/jenkins/minikube-integration/18333-911675/.minikube/machines/old-k8s-version-496808 ...
I0308 04:04:12.460608 956560 main.go:141] libmachine: (old-k8s-version-496808) Building disk image from file:///home/jenkins/minikube-integration/18333-911675/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso
I0308 04:04:12.460621 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | I0308 04:04:12.460513 956779 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/18333-911675/.minikube
I0308 04:04:12.460883 956560 main.go:141] libmachine: (old-k8s-version-496808) Downloading /home/jenkins/minikube-integration/18333-911675/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/18333-911675/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
I0308 04:04:12.712696 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | I0308 04:04:12.712557 956779 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/18333-911675/.minikube/machines/old-k8s-version-496808/id_rsa...
I0308 04:04:12.900758 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | I0308 04:04:12.900586 956779 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/18333-911675/.minikube/machines/old-k8s-version-496808/old-k8s-version-496808.rawdisk...
I0308 04:04:12.900801 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | Writing magic tar header
I0308 04:04:12.900846 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | Writing SSH key tar header
I0308 04:04:12.900916 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | I0308 04:04:12.900707 956779 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/18333-911675/.minikube/machines/old-k8s-version-496808 ...
I0308 04:04:12.900937 956560 main.go:141] libmachine: (old-k8s-version-496808) Setting executable bit set on /home/jenkins/minikube-integration/18333-911675/.minikube/machines/old-k8s-version-496808 (perms=drwx------)
I0308 04:04:12.900950 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18333-911675/.minikube/machines/old-k8s-version-496808
I0308 04:04:12.900972 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18333-911675/.minikube/machines
I0308 04:04:12.901001 956560 main.go:141] libmachine: (old-k8s-version-496808) Setting executable bit set on /home/jenkins/minikube-integration/18333-911675/.minikube/machines (perms=drwxr-xr-x)
I0308 04:04:12.901011 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18333-911675/.minikube
I0308 04:04:12.901030 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18333-911675
I0308 04:04:12.901046 956560 main.go:141] libmachine: (old-k8s-version-496808) Setting executable bit set on /home/jenkins/minikube-integration/18333-911675/.minikube (perms=drwxr-xr-x)
I0308 04:04:12.901064 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0308 04:04:12.901075 956560 main.go:141] libmachine: (old-k8s-version-496808) Setting executable bit set on /home/jenkins/minikube-integration/18333-911675 (perms=drwxrwxr-x)
I0308 04:04:12.901096 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | Checking permissions on dir: /home/jenkins
I0308 04:04:12.901106 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | Checking permissions on dir: /home
I0308 04:04:12.901112 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | Skipping /home - not owner
I0308 04:04:12.901128 956560 main.go:141] libmachine: (old-k8s-version-496808) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0308 04:04:12.901140 956560 main.go:141] libmachine: (old-k8s-version-496808) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0308 04:04:12.901153 956560 main.go:141] libmachine: (old-k8s-version-496808) Creating domain...
I0308 04:04:12.902238 956560 main.go:141] libmachine: (old-k8s-version-496808) define libvirt domain using xml:
I0308 04:04:12.902263 956560 main.go:141] libmachine: (old-k8s-version-496808) <domain type='kvm'>
I0308 04:04:12.902279 956560 main.go:141] libmachine: (old-k8s-version-496808) <name>old-k8s-version-496808</name>
I0308 04:04:12.902292 956560 main.go:141] libmachine: (old-k8s-version-496808) <memory unit='MiB'>2200</memory>
I0308 04:04:12.902301 956560 main.go:141] libmachine: (old-k8s-version-496808) <vcpu>2</vcpu>
I0308 04:04:12.902313 956560 main.go:141] libmachine: (old-k8s-version-496808) <features>
I0308 04:04:12.902325 956560 main.go:141] libmachine: (old-k8s-version-496808) <acpi/>
I0308 04:04:12.902332 956560 main.go:141] libmachine: (old-k8s-version-496808) <apic/>
I0308 04:04:12.902343 956560 main.go:141] libmachine: (old-k8s-version-496808) <pae/>
I0308 04:04:12.902359 956560 main.go:141] libmachine: (old-k8s-version-496808)
I0308 04:04:12.902386 956560 main.go:141] libmachine: (old-k8s-version-496808) </features>
I0308 04:04:12.902407 956560 main.go:141] libmachine: (old-k8s-version-496808) <cpu mode='host-passthrough'>
I0308 04:04:12.902416 956560 main.go:141] libmachine: (old-k8s-version-496808)
I0308 04:04:12.902427 956560 main.go:141] libmachine: (old-k8s-version-496808) </cpu>
I0308 04:04:12.902439 956560 main.go:141] libmachine: (old-k8s-version-496808) <os>
I0308 04:04:12.902448 956560 main.go:141] libmachine: (old-k8s-version-496808) <type>hvm</type>
I0308 04:04:12.902454 956560 main.go:141] libmachine: (old-k8s-version-496808) <boot dev='cdrom'/>
I0308 04:04:12.902460 956560 main.go:141] libmachine: (old-k8s-version-496808) <boot dev='hd'/>
I0308 04:04:12.902466 956560 main.go:141] libmachine: (old-k8s-version-496808) <bootmenu enable='no'/>
I0308 04:04:12.902472 956560 main.go:141] libmachine: (old-k8s-version-496808) </os>
I0308 04:04:12.902478 956560 main.go:141] libmachine: (old-k8s-version-496808) <devices>
I0308 04:04:12.902488 956560 main.go:141] libmachine: (old-k8s-version-496808) <disk type='file' device='cdrom'>
I0308 04:04:12.902505 956560 main.go:141] libmachine: (old-k8s-version-496808) <source file='/home/jenkins/minikube-integration/18333-911675/.minikube/machines/old-k8s-version-496808/boot2docker.iso'/>
I0308 04:04:12.902517 956560 main.go:141] libmachine: (old-k8s-version-496808) <target dev='hdc' bus='scsi'/>
I0308 04:04:12.902537 956560 main.go:141] libmachine: (old-k8s-version-496808) <readonly/>
I0308 04:04:12.902558 956560 main.go:141] libmachine: (old-k8s-version-496808) </disk>
I0308 04:04:12.902569 956560 main.go:141] libmachine: (old-k8s-version-496808) <disk type='file' device='disk'>
I0308 04:04:12.902582 956560 main.go:141] libmachine: (old-k8s-version-496808) <driver name='qemu' type='raw' cache='default' io='threads' />
I0308 04:04:12.902611 956560 main.go:141] libmachine: (old-k8s-version-496808) <source file='/home/jenkins/minikube-integration/18333-911675/.minikube/machines/old-k8s-version-496808/old-k8s-version-496808.rawdisk'/>
I0308 04:04:12.902623 956560 main.go:141] libmachine: (old-k8s-version-496808) <target dev='hda' bus='virtio'/>
I0308 04:04:12.902648 956560 main.go:141] libmachine: (old-k8s-version-496808) </disk>
I0308 04:04:12.902682 956560 main.go:141] libmachine: (old-k8s-version-496808) <interface type='network'>
I0308 04:04:12.902697 956560 main.go:141] libmachine: (old-k8s-version-496808) <source network='mk-old-k8s-version-496808'/>
I0308 04:04:12.902709 956560 main.go:141] libmachine: (old-k8s-version-496808) <model type='virtio'/>
I0308 04:04:12.902722 956560 main.go:141] libmachine: (old-k8s-version-496808) </interface>
I0308 04:04:12.902733 956560 main.go:141] libmachine: (old-k8s-version-496808) <interface type='network'>
I0308 04:04:12.902744 956560 main.go:141] libmachine: (old-k8s-version-496808) <source network='default'/>
I0308 04:04:12.902759 956560 main.go:141] libmachine: (old-k8s-version-496808) <model type='virtio'/>
I0308 04:04:12.902771 956560 main.go:141] libmachine: (old-k8s-version-496808) </interface>
I0308 04:04:12.902781 956560 main.go:141] libmachine: (old-k8s-version-496808) <serial type='pty'>
I0308 04:04:12.902794 956560 main.go:141] libmachine: (old-k8s-version-496808) <target port='0'/>
I0308 04:04:12.902805 956560 main.go:141] libmachine: (old-k8s-version-496808) </serial>
I0308 04:04:12.902817 956560 main.go:141] libmachine: (old-k8s-version-496808) <console type='pty'>
I0308 04:04:12.902830 956560 main.go:141] libmachine: (old-k8s-version-496808) <target type='serial' port='0'/>
I0308 04:04:12.902840 956560 main.go:141] libmachine: (old-k8s-version-496808) </console>
I0308 04:04:12.902847 956560 main.go:141] libmachine: (old-k8s-version-496808) <rng model='virtio'>
I0308 04:04:12.902864 956560 main.go:141] libmachine: (old-k8s-version-496808) <backend model='random'>/dev/random</backend>
I0308 04:04:12.902873 956560 main.go:141] libmachine: (old-k8s-version-496808) </rng>
I0308 04:04:12.902881 956560 main.go:141] libmachine: (old-k8s-version-496808)
I0308 04:04:12.902891 956560 main.go:141] libmachine: (old-k8s-version-496808)
I0308 04:04:12.902909 956560 main.go:141] libmachine: (old-k8s-version-496808) </devices>
I0308 04:04:12.902929 956560 main.go:141] libmachine: (old-k8s-version-496808) </domain>
I0308 04:04:12.902945 956560 main.go:141] libmachine: (old-k8s-version-496808)
I0308 04:04:12.907290 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has defined MAC address 52:54:00:cb:0b:3f in network default
I0308 04:04:12.908018 956560 main.go:141] libmachine: (old-k8s-version-496808) Ensuring networks are active...
I0308 04:04:12.908044 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has defined MAC address 52:54:00:0b:c9:35 in network mk-old-k8s-version-496808
I0308 04:04:12.908985 956560 main.go:141] libmachine: (old-k8s-version-496808) Ensuring network default is active
I0308 04:04:12.909364 956560 main.go:141] libmachine: (old-k8s-version-496808) Ensuring network mk-old-k8s-version-496808 is active
I0308 04:04:12.910030 956560 main.go:141] libmachine: (old-k8s-version-496808) Getting domain xml...
I0308 04:04:12.911044 956560 main.go:141] libmachine: (old-k8s-version-496808) Creating domain...
I0308 04:04:14.238567 956560 main.go:141] libmachine: (old-k8s-version-496808) Waiting to get IP...
I0308 04:04:14.239475 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has defined MAC address 52:54:00:0b:c9:35 in network mk-old-k8s-version-496808
I0308 04:04:14.239946 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | unable to find current IP address of domain old-k8s-version-496808 in network mk-old-k8s-version-496808
I0308 04:04:14.240034 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | I0308 04:04:14.239918 956779 retry.go:31] will retry after 255.529524ms: waiting for machine to come up
I0308 04:04:14.497634 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has defined MAC address 52:54:00:0b:c9:35 in network mk-old-k8s-version-496808
I0308 04:04:14.498215 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | unable to find current IP address of domain old-k8s-version-496808 in network mk-old-k8s-version-496808
I0308 04:04:14.498269 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | I0308 04:04:14.498162 956779 retry.go:31] will retry after 368.440696ms: waiting for machine to come up
I0308 04:04:14.868963 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has defined MAC address 52:54:00:0b:c9:35 in network mk-old-k8s-version-496808
I0308 04:04:14.869557 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | unable to find current IP address of domain old-k8s-version-496808 in network mk-old-k8s-version-496808
I0308 04:04:14.869590 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | I0308 04:04:14.869502 956779 retry.go:31] will retry after 465.663722ms: waiting for machine to come up
I0308 04:04:15.337114 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has defined MAC address 52:54:00:0b:c9:35 in network mk-old-k8s-version-496808
I0308 04:04:15.337748 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | unable to find current IP address of domain old-k8s-version-496808 in network mk-old-k8s-version-496808
I0308 04:04:15.337795 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | I0308 04:04:15.337702 956779 retry.go:31] will retry after 450.953902ms: waiting for machine to come up
I0308 04:04:15.790523 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has defined MAC address 52:54:00:0b:c9:35 in network mk-old-k8s-version-496808
I0308 04:04:15.791079 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | unable to find current IP address of domain old-k8s-version-496808 in network mk-old-k8s-version-496808
I0308 04:04:15.791111 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | I0308 04:04:15.791019 956779 retry.go:31] will retry after 539.22044ms: waiting for machine to come up
I0308 04:04:16.331651 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has defined MAC address 52:54:00:0b:c9:35 in network mk-old-k8s-version-496808
I0308 04:04:16.332101 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | unable to find current IP address of domain old-k8s-version-496808 in network mk-old-k8s-version-496808
I0308 04:04:16.332126 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | I0308 04:04:16.332064 956779 retry.go:31] will retry after 756.785663ms: waiting for machine to come up
I0308 04:04:17.090030 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has defined MAC address 52:54:00:0b:c9:35 in network mk-old-k8s-version-496808
I0308 04:04:17.090401 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | unable to find current IP address of domain old-k8s-version-496808 in network mk-old-k8s-version-496808
I0308 04:04:17.090454 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | I0308 04:04:17.090342 956779 retry.go:31] will retry after 794.859759ms: waiting for machine to come up
I0308 04:04:17.886639 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has defined MAC address 52:54:00:0b:c9:35 in network mk-old-k8s-version-496808
I0308 04:04:17.887115 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | unable to find current IP address of domain old-k8s-version-496808 in network mk-old-k8s-version-496808
I0308 04:04:17.887144 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | I0308 04:04:17.887061 956779 retry.go:31] will retry after 1.219252022s: waiting for machine to come up
I0308 04:04:19.108333 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has defined MAC address 52:54:00:0b:c9:35 in network mk-old-k8s-version-496808
I0308 04:04:19.108863 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | unable to find current IP address of domain old-k8s-version-496808 in network mk-old-k8s-version-496808
I0308 04:04:19.108894 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | I0308 04:04:19.108816 956779 retry.go:31] will retry after 1.700842235s: waiting for machine to come up
I0308 04:04:20.811150 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has defined MAC address 52:54:00:0b:c9:35 in network mk-old-k8s-version-496808
I0308 04:04:20.811704 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | unable to find current IP address of domain old-k8s-version-496808 in network mk-old-k8s-version-496808
I0308 04:04:20.811735 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | I0308 04:04:20.811655 956779 retry.go:31] will retry after 2.197064085s: waiting for machine to come up
I0308 04:04:23.010692 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has defined MAC address 52:54:00:0b:c9:35 in network mk-old-k8s-version-496808
I0308 04:04:23.011174 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | unable to find current IP address of domain old-k8s-version-496808 in network mk-old-k8s-version-496808
I0308 04:04:23.011201 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | I0308 04:04:23.011101 956779 retry.go:31] will retry after 2.53605479s: waiting for machine to come up
I0308 04:04:25.551007 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has defined MAC address 52:54:00:0b:c9:35 in network mk-old-k8s-version-496808
I0308 04:04:25.551658 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | unable to find current IP address of domain old-k8s-version-496808 in network mk-old-k8s-version-496808
I0308 04:04:25.551716 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | I0308 04:04:25.551599 956779 retry.go:31] will retry after 2.637016781s: waiting for machine to come up
I0308 04:04:28.190349 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has defined MAC address 52:54:00:0b:c9:35 in network mk-old-k8s-version-496808
I0308 04:04:28.190825 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | unable to find current IP address of domain old-k8s-version-496808 in network mk-old-k8s-version-496808
I0308 04:04:28.190867 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | I0308 04:04:28.190792 956779 retry.go:31] will retry after 3.238039351s: waiting for machine to come up
I0308 04:04:31.431204 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has defined MAC address 52:54:00:0b:c9:35 in network mk-old-k8s-version-496808
I0308 04:04:31.431723 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | unable to find current IP address of domain old-k8s-version-496808 in network mk-old-k8s-version-496808
I0308 04:04:31.431757 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | I0308 04:04:31.431672 956779 retry.go:31] will retry after 4.939229076s: waiting for machine to come up
I0308 04:04:36.375498 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has defined MAC address 52:54:00:0b:c9:35 in network mk-old-k8s-version-496808
I0308 04:04:36.376224 956560 main.go:141] libmachine: (old-k8s-version-496808) Found IP for machine: 192.168.39.3
I0308 04:04:36.376251 956560 main.go:141] libmachine: (old-k8s-version-496808) Reserving static IP address...
I0308 04:04:36.376265 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has current primary IP address 192.168.39.3 and MAC address 52:54:00:0b:c9:35 in network mk-old-k8s-version-496808
I0308 04:04:36.376682 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-496808", mac: "52:54:00:0b:c9:35", ip: "192.168.39.3"} in network mk-old-k8s-version-496808
I0308 04:04:36.451672 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | Getting to WaitForSSH function...
I0308 04:04:36.451707 956560 main.go:141] libmachine: (old-k8s-version-496808) Reserved static IP address: 192.168.39.3
I0308 04:04:36.451722 956560 main.go:141] libmachine: (old-k8s-version-496808) Waiting for SSH to be available...
I0308 04:04:36.454942 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has defined MAC address 52:54:00:0b:c9:35 in network mk-old-k8s-version-496808
I0308 04:04:36.455398 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:c9:35", ip: ""} in network mk-old-k8s-version-496808: {Iface:virbr1 ExpiryTime:2024-03-08 05:04:29 +0000 UTC Type:0 Mac:52:54:00:0b:c9:35 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:minikube Clientid:01:52:54:00:0b:c9:35}
I0308 04:04:36.455428 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has defined IP address 192.168.39.3 and MAC address 52:54:00:0b:c9:35 in network mk-old-k8s-version-496808
I0308 04:04:36.455594 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | Using SSH client type: external
I0308 04:04:36.455622 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | Using SSH private key: /home/jenkins/minikube-integration/18333-911675/.minikube/machines/old-k8s-version-496808/id_rsa (-rw-------)
I0308 04:04:36.455665 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.3 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/18333-911675/.minikube/machines/old-k8s-version-496808/id_rsa -p 22] /usr/bin/ssh <nil>}
I0308 04:04:36.455688 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | About to run SSH command:
I0308 04:04:36.455699 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | exit 0
I0308 04:04:36.581637 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | SSH cmd err, output: <nil>:
I0308 04:04:36.581956 956560 main.go:141] libmachine: (old-k8s-version-496808) KVM machine creation complete!
I0308 04:04:36.582264 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetConfigRaw
I0308 04:04:36.583020 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .DriverName
I0308 04:04:36.583249 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .DriverName
I0308 04:04:36.583458 956560 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0308 04:04:36.583480 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetState
I0308 04:04:36.584863 956560 main.go:141] libmachine: Detecting operating system of created instance...
I0308 04:04:36.584881 956560 main.go:141] libmachine: Waiting for SSH to be available...
I0308 04:04:36.584889 956560 main.go:141] libmachine: Getting to WaitForSSH function...
I0308 04:04:36.584898 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetSSHHostname
I0308 04:04:36.587209 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has defined MAC address 52:54:00:0b:c9:35 in network mk-old-k8s-version-496808
I0308 04:04:36.587597 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:c9:35", ip: ""} in network mk-old-k8s-version-496808: {Iface:virbr1 ExpiryTime:2024-03-08 05:04:29 +0000 UTC Type:0 Mac:52:54:00:0b:c9:35 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:old-k8s-version-496808 Clientid:01:52:54:00:0b:c9:35}
I0308 04:04:36.587641 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has defined IP address 192.168.39.3 and MAC address 52:54:00:0b:c9:35 in network mk-old-k8s-version-496808
I0308 04:04:36.587809 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetSSHPort
I0308 04:04:36.588009 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetSSHKeyPath
I0308 04:04:36.588173 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetSSHKeyPath
I0308 04:04:36.588317 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetSSHUsername
I0308 04:04:36.588486 956560 main.go:141] libmachine: Using SSH client type: native
I0308 04:04:36.588693 956560 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.39.3 22 <nil> <nil>}
I0308 04:04:36.588706 956560 main.go:141] libmachine: About to run SSH command:
exit 0
I0308 04:04:36.688950 956560 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0308 04:04:36.688978 956560 main.go:141] libmachine: Detecting the provisioner...
I0308 04:04:36.688988 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetSSHHostname
I0308 04:04:36.691619 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has defined MAC address 52:54:00:0b:c9:35 in network mk-old-k8s-version-496808
I0308 04:04:36.691932 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:c9:35", ip: ""} in network mk-old-k8s-version-496808: {Iface:virbr1 ExpiryTime:2024-03-08 05:04:29 +0000 UTC Type:0 Mac:52:54:00:0b:c9:35 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:old-k8s-version-496808 Clientid:01:52:54:00:0b:c9:35}
I0308 04:04:36.691992 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has defined IP address 192.168.39.3 and MAC address 52:54:00:0b:c9:35 in network mk-old-k8s-version-496808
I0308 04:04:36.692129 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetSSHPort
I0308 04:04:36.692336 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetSSHKeyPath
I0308 04:04:36.692506 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetSSHKeyPath
I0308 04:04:36.692625 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetSSHUsername
I0308 04:04:36.692795 956560 main.go:141] libmachine: Using SSH client type: native
I0308 04:04:36.693036 956560 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.39.3 22 <nil> <nil>}
I0308 04:04:36.693051 956560 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0308 04:04:36.794553 956560 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0308 04:04:36.794654 956560 main.go:141] libmachine: found compatible host: buildroot
I0308 04:04:36.794667 956560 main.go:141] libmachine: Provisioning with buildroot...
I0308 04:04:36.794679 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetMachineName
I0308 04:04:36.794968 956560 buildroot.go:166] provisioning hostname "old-k8s-version-496808"
I0308 04:04:36.795001 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetMachineName
I0308 04:04:36.795211 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetSSHHostname
I0308 04:04:36.798043 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has defined MAC address 52:54:00:0b:c9:35 in network mk-old-k8s-version-496808
I0308 04:04:36.798440 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:c9:35", ip: ""} in network mk-old-k8s-version-496808: {Iface:virbr1 ExpiryTime:2024-03-08 05:04:29 +0000 UTC Type:0 Mac:52:54:00:0b:c9:35 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:old-k8s-version-496808 Clientid:01:52:54:00:0b:c9:35}
I0308 04:04:36.798472 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has defined IP address 192.168.39.3 and MAC address 52:54:00:0b:c9:35 in network mk-old-k8s-version-496808
I0308 04:04:36.798646 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetSSHPort
I0308 04:04:36.798832 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetSSHKeyPath
I0308 04:04:36.798976 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetSSHKeyPath
I0308 04:04:36.799095 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetSSHUsername
I0308 04:04:36.799244 956560 main.go:141] libmachine: Using SSH client type: native
I0308 04:04:36.799432 956560 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.39.3 22 <nil> <nil>}
I0308 04:04:36.799445 956560 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-496808 && echo "old-k8s-version-496808" | sudo tee /etc/hostname
I0308 04:04:36.914974 956560 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-496808
I0308 04:04:36.915005 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetSSHHostname
I0308 04:04:36.917763 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has defined MAC address 52:54:00:0b:c9:35 in network mk-old-k8s-version-496808
I0308 04:04:36.918100 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:c9:35", ip: ""} in network mk-old-k8s-version-496808: {Iface:virbr1 ExpiryTime:2024-03-08 05:04:29 +0000 UTC Type:0 Mac:52:54:00:0b:c9:35 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:old-k8s-version-496808 Clientid:01:52:54:00:0b:c9:35}
I0308 04:04:36.918129 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has defined IP address 192.168.39.3 and MAC address 52:54:00:0b:c9:35 in network mk-old-k8s-version-496808
I0308 04:04:36.918253 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetSSHPort
I0308 04:04:36.918478 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetSSHKeyPath
I0308 04:04:36.918674 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetSSHKeyPath
I0308 04:04:36.918859 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetSSHUsername
I0308 04:04:36.919006 956560 main.go:141] libmachine: Using SSH client type: native
I0308 04:04:36.919192 956560 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.39.3 22 <nil> <nil>}
I0308 04:04:36.919216 956560 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-496808' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-496808/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-496808' | sudo tee -a /etc/hosts;
fi
fi
I0308 04:04:37.028601 956560 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0308 04:04:37.028641 956560 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/18333-911675/.minikube CaCertPath:/home/jenkins/minikube-integration/18333-911675/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18333-911675/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18333-911675/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18333-911675/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18333-911675/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18333-911675/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18333-911675/.minikube}
I0308 04:04:37.028691 956560 buildroot.go:174] setting up certificates
I0308 04:04:37.028701 956560 provision.go:84] configureAuth start
I0308 04:04:37.028717 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetMachineName
I0308 04:04:37.029035 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetIP
I0308 04:04:37.031866 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has defined MAC address 52:54:00:0b:c9:35 in network mk-old-k8s-version-496808
I0308 04:04:37.032336 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:c9:35", ip: ""} in network mk-old-k8s-version-496808: {Iface:virbr1 ExpiryTime:2024-03-08 05:04:29 +0000 UTC Type:0 Mac:52:54:00:0b:c9:35 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:old-k8s-version-496808 Clientid:01:52:54:00:0b:c9:35}
I0308 04:04:37.032370 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has defined IP address 192.168.39.3 and MAC address 52:54:00:0b:c9:35 in network mk-old-k8s-version-496808
I0308 04:04:37.032568 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetSSHHostname
I0308 04:04:37.034821 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has defined MAC address 52:54:00:0b:c9:35 in network mk-old-k8s-version-496808
I0308 04:04:37.035157 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:c9:35", ip: ""} in network mk-old-k8s-version-496808: {Iface:virbr1 ExpiryTime:2024-03-08 05:04:29 +0000 UTC Type:0 Mac:52:54:00:0b:c9:35 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:old-k8s-version-496808 Clientid:01:52:54:00:0b:c9:35}
I0308 04:04:37.035185 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has defined IP address 192.168.39.3 and MAC address 52:54:00:0b:c9:35 in network mk-old-k8s-version-496808
I0308 04:04:37.035288 956560 provision.go:143] copyHostCerts
I0308 04:04:37.035349 956560 exec_runner.go:144] found /home/jenkins/minikube-integration/18333-911675/.minikube/ca.pem, removing ...
I0308 04:04:37.035362 956560 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18333-911675/.minikube/ca.pem
I0308 04:04:37.035433 956560 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18333-911675/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18333-911675/.minikube/ca.pem (1082 bytes)
I0308 04:04:37.035559 956560 exec_runner.go:144] found /home/jenkins/minikube-integration/18333-911675/.minikube/cert.pem, removing ...
I0308 04:04:37.035581 956560 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18333-911675/.minikube/cert.pem
I0308 04:04:37.035615 956560 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18333-911675/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18333-911675/.minikube/cert.pem (1123 bytes)
I0308 04:04:37.035710 956560 exec_runner.go:144] found /home/jenkins/minikube-integration/18333-911675/.minikube/key.pem, removing ...
I0308 04:04:37.035721 956560 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18333-911675/.minikube/key.pem
I0308 04:04:37.035744 956560 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18333-911675/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18333-911675/.minikube/key.pem (1679 bytes)
I0308 04:04:37.035840 956560 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18333-911675/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18333-911675/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18333-911675/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-496808 san=[127.0.0.1 192.168.39.3 localhost minikube old-k8s-version-496808]
I0308 04:04:37.169594 956560 provision.go:177] copyRemoteCerts
I0308 04:04:37.169653 956560 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0308 04:04:37.169682 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetSSHHostname
I0308 04:04:37.172368 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has defined MAC address 52:54:00:0b:c9:35 in network mk-old-k8s-version-496808
I0308 04:04:37.172766 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:c9:35", ip: ""} in network mk-old-k8s-version-496808: {Iface:virbr1 ExpiryTime:2024-03-08 05:04:29 +0000 UTC Type:0 Mac:52:54:00:0b:c9:35 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:old-k8s-version-496808 Clientid:01:52:54:00:0b:c9:35}
I0308 04:04:37.172790 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has defined IP address 192.168.39.3 and MAC address 52:54:00:0b:c9:35 in network mk-old-k8s-version-496808
I0308 04:04:37.173029 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetSSHPort
I0308 04:04:37.173223 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetSSHKeyPath
I0308 04:04:37.173435 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetSSHUsername
I0308 04:04:37.173598 956560 sshutil.go:53] new ssh client: &{IP:192.168.39.3 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18333-911675/.minikube/machines/old-k8s-version-496808/id_rsa Username:docker}
I0308 04:04:37.251972 956560 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18333-911675/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0308 04:04:37.278919 956560 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18333-911675/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0308 04:04:37.305430 956560 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18333-911675/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0308 04:04:37.331495 956560 provision.go:87] duration metric: took 302.774505ms to configureAuth
I0308 04:04:37.331531 956560 buildroot.go:189] setting minikube options for container-runtime
I0308 04:04:37.331700 956560 config.go:182] Loaded profile config "old-k8s-version-496808": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0308 04:04:37.331781 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetSSHHostname
I0308 04:04:37.334485 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has defined MAC address 52:54:00:0b:c9:35 in network mk-old-k8s-version-496808
I0308 04:04:37.334790 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:c9:35", ip: ""} in network mk-old-k8s-version-496808: {Iface:virbr1 ExpiryTime:2024-03-08 05:04:29 +0000 UTC Type:0 Mac:52:54:00:0b:c9:35 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:old-k8s-version-496808 Clientid:01:52:54:00:0b:c9:35}
I0308 04:04:37.334831 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has defined IP address 192.168.39.3 and MAC address 52:54:00:0b:c9:35 in network mk-old-k8s-version-496808
I0308 04:04:37.334960 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetSSHPort
I0308 04:04:37.335183 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetSSHKeyPath
I0308 04:04:37.335366 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetSSHKeyPath
I0308 04:04:37.335512 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetSSHUsername
I0308 04:04:37.335650 956560 main.go:141] libmachine: Using SSH client type: native
I0308 04:04:37.335828 956560 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.39.3 22 <nil> <nil>}
I0308 04:04:37.335845 956560 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0308 04:04:37.632903 956560 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0308 04:04:37.632930 956560 main.go:141] libmachine: Checking connection to Docker...
I0308 04:04:37.632939 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetURL
I0308 04:04:37.634290 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | Using libvirt version 6000000
I0308 04:04:37.636516 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has defined MAC address 52:54:00:0b:c9:35 in network mk-old-k8s-version-496808
I0308 04:04:37.636913 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:c9:35", ip: ""} in network mk-old-k8s-version-496808: {Iface:virbr1 ExpiryTime:2024-03-08 05:04:29 +0000 UTC Type:0 Mac:52:54:00:0b:c9:35 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:old-k8s-version-496808 Clientid:01:52:54:00:0b:c9:35}
I0308 04:04:37.636940 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has defined IP address 192.168.39.3 and MAC address 52:54:00:0b:c9:35 in network mk-old-k8s-version-496808
I0308 04:04:37.637100 956560 main.go:141] libmachine: Docker is up and running!
I0308 04:04:37.637116 956560 main.go:141] libmachine: Reticulating splines...
I0308 04:04:37.637124 956560 client.go:171] duration metric: took 25.258456958s to LocalClient.Create
I0308 04:04:37.637146 956560 start.go:167] duration metric: took 25.258564545s to libmachine.API.Create "old-k8s-version-496808"
I0308 04:04:37.637175 956560 start.go:293] postStartSetup for "old-k8s-version-496808" (driver="kvm2")
I0308 04:04:37.637188 956560 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0308 04:04:37.637222 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .DriverName
I0308 04:04:37.637536 956560 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0308 04:04:37.637561 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetSSHHostname
I0308 04:04:37.639739 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has defined MAC address 52:54:00:0b:c9:35 in network mk-old-k8s-version-496808
I0308 04:04:37.640065 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:c9:35", ip: ""} in network mk-old-k8s-version-496808: {Iface:virbr1 ExpiryTime:2024-03-08 05:04:29 +0000 UTC Type:0 Mac:52:54:00:0b:c9:35 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:old-k8s-version-496808 Clientid:01:52:54:00:0b:c9:35}
I0308 04:04:37.640095 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has defined IP address 192.168.39.3 and MAC address 52:54:00:0b:c9:35 in network mk-old-k8s-version-496808
I0308 04:04:37.640254 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetSSHPort
I0308 04:04:37.640433 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetSSHKeyPath
I0308 04:04:37.640580 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetSSHUsername
I0308 04:04:37.640750 956560 sshutil.go:53] new ssh client: &{IP:192.168.39.3 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18333-911675/.minikube/machines/old-k8s-version-496808/id_rsa Username:docker}
I0308 04:04:37.721368 956560 ssh_runner.go:195] Run: cat /etc/os-release
I0308 04:04:37.726204 956560 info.go:137] Remote host: Buildroot 2023.02.9
I0308 04:04:37.726232 956560 filesync.go:126] Scanning /home/jenkins/minikube-integration/18333-911675/.minikube/addons for local assets ...
I0308 04:04:37.726304 956560 filesync.go:126] Scanning /home/jenkins/minikube-integration/18333-911675/.minikube/files for local assets ...
I0308 04:04:37.726375 956560 filesync.go:149] local asset: /home/jenkins/minikube-integration/18333-911675/.minikube/files/etc/ssl/certs/9189882.pem -> 9189882.pem in /etc/ssl/certs
I0308 04:04:37.726463 956560 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0308 04:04:37.736455 956560 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18333-911675/.minikube/files/etc/ssl/certs/9189882.pem --> /etc/ssl/certs/9189882.pem (1708 bytes)
I0308 04:04:37.762649 956560 start.go:296] duration metric: took 125.458934ms for postStartSetup
I0308 04:04:37.762700 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetConfigRaw
I0308 04:04:37.763354 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetIP
I0308 04:04:37.766186 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has defined MAC address 52:54:00:0b:c9:35 in network mk-old-k8s-version-496808
I0308 04:04:37.766543 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:c9:35", ip: ""} in network mk-old-k8s-version-496808: {Iface:virbr1 ExpiryTime:2024-03-08 05:04:29 +0000 UTC Type:0 Mac:52:54:00:0b:c9:35 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:old-k8s-version-496808 Clientid:01:52:54:00:0b:c9:35}
I0308 04:04:37.766584 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has defined IP address 192.168.39.3 and MAC address 52:54:00:0b:c9:35 in network mk-old-k8s-version-496808
I0308 04:04:37.766897 956560 profile.go:142] Saving config to /home/jenkins/minikube-integration/18333-911675/.minikube/profiles/old-k8s-version-496808/config.json ...
I0308 04:04:37.767149 956560 start.go:128] duration metric: took 25.412322495s to createHost
I0308 04:04:37.767188 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetSSHHostname
I0308 04:04:37.769566 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has defined MAC address 52:54:00:0b:c9:35 in network mk-old-k8s-version-496808
I0308 04:04:37.769871 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:c9:35", ip: ""} in network mk-old-k8s-version-496808: {Iface:virbr1 ExpiryTime:2024-03-08 05:04:29 +0000 UTC Type:0 Mac:52:54:00:0b:c9:35 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:old-k8s-version-496808 Clientid:01:52:54:00:0b:c9:35}
I0308 04:04:37.769892 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has defined IP address 192.168.39.3 and MAC address 52:54:00:0b:c9:35 in network mk-old-k8s-version-496808
I0308 04:04:37.770037 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetSSHPort
I0308 04:04:37.770222 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetSSHKeyPath
I0308 04:04:37.770394 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetSSHKeyPath
I0308 04:04:37.770554 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetSSHUsername
I0308 04:04:37.770726 956560 main.go:141] libmachine: Using SSH client type: native
I0308 04:04:37.770938 956560 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.39.3 22 <nil> <nil>}
I0308 04:04:37.770958 956560 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0308 04:04:37.870626 956560 main.go:141] libmachine: SSH cmd err, output: <nil>: 1709870677.849663957
I0308 04:04:37.870653 956560 fix.go:216] guest clock: 1709870677.849663957
I0308 04:04:37.870660 956560 fix.go:229] Guest: 2024-03-08 04:04:37.849663957 +0000 UTC Remote: 2024-03-08 04:04:37.767164091 +0000 UTC m=+34.335914987 (delta=82.499866ms)
I0308 04:04:37.870679 956560 fix.go:200] guest clock delta is within tolerance: 82.499866ms
I0308 04:04:37.870684 956560 start.go:83] releasing machines lock for "old-k8s-version-496808", held for 25.516058909s
I0308 04:04:37.870711 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .DriverName
I0308 04:04:37.871025 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetIP
I0308 04:04:37.873951 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has defined MAC address 52:54:00:0b:c9:35 in network mk-old-k8s-version-496808
I0308 04:04:37.874347 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:c9:35", ip: ""} in network mk-old-k8s-version-496808: {Iface:virbr1 ExpiryTime:2024-03-08 05:04:29 +0000 UTC Type:0 Mac:52:54:00:0b:c9:35 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:old-k8s-version-496808 Clientid:01:52:54:00:0b:c9:35}
I0308 04:04:37.874373 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has defined IP address 192.168.39.3 and MAC address 52:54:00:0b:c9:35 in network mk-old-k8s-version-496808
I0308 04:04:37.874507 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .DriverName
I0308 04:04:37.875018 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .DriverName
I0308 04:04:37.875222 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .DriverName
I0308 04:04:37.875340 956560 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0308 04:04:37.875379 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetSSHHostname
I0308 04:04:37.875402 956560 ssh_runner.go:195] Run: cat /version.json
I0308 04:04:37.875421 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetSSHHostname
I0308 04:04:37.877990 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has defined MAC address 52:54:00:0b:c9:35 in network mk-old-k8s-version-496808
I0308 04:04:37.879152 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:c9:35", ip: ""} in network mk-old-k8s-version-496808: {Iface:virbr1 ExpiryTime:2024-03-08 05:04:29 +0000 UTC Type:0 Mac:52:54:00:0b:c9:35 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:old-k8s-version-496808 Clientid:01:52:54:00:0b:c9:35}
I0308 04:04:37.879193 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has defined IP address 192.168.39.3 and MAC address 52:54:00:0b:c9:35 in network mk-old-k8s-version-496808
I0308 04:04:37.879217 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has defined MAC address 52:54:00:0b:c9:35 in network mk-old-k8s-version-496808
I0308 04:04:37.879231 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetSSHPort
I0308 04:04:37.879441 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetSSHKeyPath
I0308 04:04:37.879626 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetSSHUsername
I0308 04:04:37.879633 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:c9:35", ip: ""} in network mk-old-k8s-version-496808: {Iface:virbr1 ExpiryTime:2024-03-08 05:04:29 +0000 UTC Type:0 Mac:52:54:00:0b:c9:35 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:old-k8s-version-496808 Clientid:01:52:54:00:0b:c9:35}
I0308 04:04:37.879650 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has defined IP address 192.168.39.3 and MAC address 52:54:00:0b:c9:35 in network mk-old-k8s-version-496808
I0308 04:04:37.879785 956560 sshutil.go:53] new ssh client: &{IP:192.168.39.3 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18333-911675/.minikube/machines/old-k8s-version-496808/id_rsa Username:docker}
I0308 04:04:37.879889 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetSSHPort
I0308 04:04:37.880052 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetSSHKeyPath
I0308 04:04:37.880180 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetSSHUsername
I0308 04:04:37.880286 956560 sshutil.go:53] new ssh client: &{IP:192.168.39.3 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18333-911675/.minikube/machines/old-k8s-version-496808/id_rsa Username:docker}
I0308 04:04:37.987076 956560 ssh_runner.go:195] Run: systemctl --version
I0308 04:04:37.993762 956560 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0308 04:04:38.347754 956560 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0308 04:04:38.356057 956560 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0308 04:04:38.356125 956560 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0308 04:04:38.380855 956560 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0308 04:04:38.380883 956560 start.go:494] detecting cgroup driver to use...
I0308 04:04:38.380956 956560 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0308 04:04:38.403714 956560 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0308 04:04:38.421325 956560 docker.go:217] disabling cri-docker service (if available) ...
I0308 04:04:38.421381 956560 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0308 04:04:38.437824 956560 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0308 04:04:38.454012 956560 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0308 04:04:38.596781 956560 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0308 04:04:38.745214 956560 docker.go:233] disabling docker service ...
I0308 04:04:38.745319 956560 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0308 04:04:38.762254 956560 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0308 04:04:38.778010 956560 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0308 04:04:38.929994 956560 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0308 04:04:39.048301 956560 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0308 04:04:39.064024 956560 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0308 04:04:39.085952 956560 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0308 04:04:39.086044 956560 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0308 04:04:39.097749 956560 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0308 04:04:39.097816 956560 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0308 04:04:39.109414 956560 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0308 04:04:39.120792 956560 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0308 04:04:39.132036 956560 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0308 04:04:39.143417 956560 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0308 04:04:39.153910 956560 crio.go:148] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0308 04:04:39.153962 956560 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0308 04:04:39.168813 956560 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0308 04:04:39.179974 956560 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0308 04:04:39.322754 956560 ssh_runner.go:195] Run: sudo systemctl restart crio
I0308 04:04:39.484826 956560 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0308 04:04:39.484898 956560 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0308 04:04:39.490500 956560 start.go:562] Will wait 60s for crictl version
I0308 04:04:39.490559 956560 ssh_runner.go:195] Run: which crictl
I0308 04:04:39.494965 956560 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0308 04:04:39.535674 956560 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0308 04:04:39.535812 956560 ssh_runner.go:195] Run: crio --version
I0308 04:04:39.568453 956560 ssh_runner.go:195] Run: crio --version
I0308 04:04:39.601119 956560 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0308 04:04:39.602581 956560 main.go:141] libmachine: (old-k8s-version-496808) Calling .GetIP
I0308 04:04:39.605988 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has defined MAC address 52:54:00:0b:c9:35 in network mk-old-k8s-version-496808
I0308 04:04:39.606469 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:c9:35", ip: ""} in network mk-old-k8s-version-496808: {Iface:virbr1 ExpiryTime:2024-03-08 05:04:29 +0000 UTC Type:0 Mac:52:54:00:0b:c9:35 Iaid: IPaddr:192.168.39.3 Prefix:24 Hostname:old-k8s-version-496808 Clientid:01:52:54:00:0b:c9:35}
I0308 04:04:39.606494 956560 main.go:141] libmachine: (old-k8s-version-496808) DBG | domain old-k8s-version-496808 has defined IP address 192.168.39.3 and MAC address 52:54:00:0b:c9:35 in network mk-old-k8s-version-496808
I0308 04:04:39.606779 956560 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I0308 04:04:39.611994 956560 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0308 04:04:39.628053 956560 kubeadm.go:877] updating cluster {Name:old-k8s-version-496808 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-496808 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.3 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mou
ntPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0308 04:04:39.628169 956560 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0308 04:04:39.628240 956560 ssh_runner.go:195] Run: sudo crictl images --output json
I0308 04:04:39.667784 956560 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0308 04:04:39.667857 956560 ssh_runner.go:195] Run: which lz4
I0308 04:04:39.672766 956560 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0308 04:04:39.678025 956560 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0308 04:04:39.678073 956560 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18333-911675/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0308 04:04:41.780687 956560 crio.go:444] duration metric: took 2.107964858s to copy over tarball
I0308 04:04:41.780762 956560 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0308 04:04:44.615803 956560 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.835010041s)
I0308 04:04:44.615839 956560 crio.go:451] duration metric: took 2.835118328s to extract the tarball
I0308 04:04:44.615850 956560 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0308 04:04:44.663178 956560 ssh_runner.go:195] Run: sudo crictl images --output json
I0308 04:04:44.710785 956560 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0308 04:04:44.710823 956560 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0308 04:04:44.710953 956560 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0308 04:04:44.710991 956560 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0308 04:04:44.711010 956560 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0308 04:04:44.710920 956560 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0308 04:04:44.711136 956560 image.go:134] retrieving image: registry.k8s.io/coredns:1.7.0
I0308 04:04:44.710929 956560 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0308 04:04:44.710968 956560 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0308 04:04:44.710979 956560 image.go:134] retrieving image: registry.k8s.io/pause:3.2
I0308 04:04:44.712838 956560 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0308 04:04:44.712937 956560 image.go:177] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0308 04:04:44.712847 956560 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0308 04:04:44.712846 956560 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0308 04:04:44.712857 956560 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0308 04:04:44.712856 956560 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0308 04:04:44.712852 956560 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0308 04:04:44.712870 956560 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0308 04:04:44.849753 956560 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0308 04:04:44.857199 956560 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0308 04:04:44.869192 956560 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0308 04:04:44.872787 956560 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0308 04:04:44.876718 956560 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0308 04:04:44.925506 956560 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0308 04:04:44.927407 956560 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0308 04:04:44.954914 956560 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0308 04:04:44.955007 956560 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0308 04:04:44.954924 956560 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0308 04:04:44.955059 956560 ssh_runner.go:195] Run: which crictl
I0308 04:04:44.955068 956560 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0308 04:04:44.955108 956560 ssh_runner.go:195] Run: which crictl
I0308 04:04:45.004659 956560 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0308 04:04:45.012449 956560 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0308 04:04:45.012504 956560 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0308 04:04:45.012570 956560 ssh_runner.go:195] Run: which crictl
I0308 04:04:45.041835 956560 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0308 04:04:45.041893 956560 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0308 04:04:45.041896 956560 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0308 04:04:45.041930 956560 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0308 04:04:45.041946 956560 ssh_runner.go:195] Run: which crictl
I0308 04:04:45.041984 956560 ssh_runner.go:195] Run: which crictl
I0308 04:04:45.086494 956560 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0308 04:04:45.086548 956560 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0308 04:04:45.086600 956560 ssh_runner.go:195] Run: which crictl
I0308 04:04:45.100770 956560 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0308 04:04:45.100870 956560 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0308 04:04:45.100878 956560 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0308 04:04:45.100979 956560 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0308 04:04:45.100986 956560 ssh_runner.go:195] Run: which crictl
I0308 04:04:45.214177 956560 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0308 04:04:45.214247 956560 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0308 04:04:45.214185 956560 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0308 04:04:45.214391 956560 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0308 04:04:45.214424 956560 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18333-911675/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0308 04:04:45.214525 956560 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18333-911675/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0308 04:04:45.214568 956560 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0308 04:04:45.326340 956560 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18333-911675/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0308 04:04:45.326596 956560 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18333-911675/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0308 04:04:45.351209 956560 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18333-911675/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0308 04:04:45.351221 956560 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18333-911675/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0308 04:04:45.351254 956560 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18333-911675/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0308 04:04:45.351358 956560 cache_images.go:92] duration metric: took 640.512004ms to LoadCachedImages
W0308 04:04:45.351468 956560 out.go:239] X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/18333-911675/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0: no such file or directory
X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/18333-911675/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0: no such file or directory
I0308 04:04:45.351485 956560 kubeadm.go:928] updating node { 192.168.39.3 8443 v1.20.0 crio true true} ...
I0308 04:04:45.351686 956560 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-496808 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.39.3
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-496808 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0308 04:04:45.351771 956560 ssh_runner.go:195] Run: crio config
I0308 04:04:45.406777 956560 cni.go:84] Creating CNI manager for ""
I0308 04:04:45.406809 956560 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0308 04:04:45.406831 956560 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0308 04:04:45.406854 956560 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.3 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-496808 NodeName:old-k8s-version-496808 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.3"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.3 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPo
dPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0308 04:04:45.407058 956560 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.39.3
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-496808"
kubeletExtraArgs:
node-ip: 192.168.39.3
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.39.3"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0308 04:04:45.407153 956560 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0308 04:04:45.418823 956560 binaries.go:44] Found k8s binaries, skipping transfer
I0308 04:04:45.418903 956560 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0308 04:04:45.430421 956560 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (428 bytes)
I0308 04:04:45.449095 956560 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0308 04:04:45.467992 956560 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2117 bytes)
I0308 04:04:45.487596 956560 ssh_runner.go:195] Run: grep 192.168.39.3 control-plane.minikube.internal$ /etc/hosts
I0308 04:04:45.492208 956560 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.3 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0308 04:04:45.506937 956560 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0308 04:04:45.648717 956560 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0308 04:04:45.673716 956560 certs.go:68] Setting up /home/jenkins/minikube-integration/18333-911675/.minikube/profiles/old-k8s-version-496808 for IP: 192.168.39.3
I0308 04:04:45.673747 956560 certs.go:194] generating shared ca certs ...
I0308 04:04:45.673771 956560 certs.go:226] acquiring lock for ca certs: {Name:mkfae87099c574fdada8a9cfe1c1bc4501d8767b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0308 04:04:45.673977 956560 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18333-911675/.minikube/ca.key
I0308 04:04:45.674046 956560 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18333-911675/.minikube/proxy-client-ca.key
I0308 04:04:45.674059 956560 certs.go:256] generating profile certs ...
I0308 04:04:45.674132 956560 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/18333-911675/.minikube/profiles/old-k8s-version-496808/client.key
I0308 04:04:45.674155 956560 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18333-911675/.minikube/profiles/old-k8s-version-496808/client.crt with IP's: []
I0308 04:04:45.901658 956560 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18333-911675/.minikube/profiles/old-k8s-version-496808/client.crt ...
I0308 04:04:45.901699 956560 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18333-911675/.minikube/profiles/old-k8s-version-496808/client.crt: {Name:mkedb6886e5d6679a08540728db100dbc5f2db9b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0308 04:04:45.901913 956560 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18333-911675/.minikube/profiles/old-k8s-version-496808/client.key ...
I0308 04:04:45.901939 956560 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18333-911675/.minikube/profiles/old-k8s-version-496808/client.key: {Name:mk5cb275a3b33aeb3902f7d702b630ca1c0f28ab Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0308 04:04:45.902057 956560 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/18333-911675/.minikube/profiles/old-k8s-version-496808/apiserver.key.bb63bcf1
I0308 04:04:45.902088 956560 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18333-911675/.minikube/profiles/old-k8s-version-496808/apiserver.crt.bb63bcf1 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.3]
I0308 04:04:46.156405 956560 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18333-911675/.minikube/profiles/old-k8s-version-496808/apiserver.crt.bb63bcf1 ...
I0308 04:04:46.156445 956560 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18333-911675/.minikube/profiles/old-k8s-version-496808/apiserver.crt.bb63bcf1: {Name:mk31893a0c976dbc1ae64b9059201d98d50a9cbf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0308 04:04:46.156653 956560 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18333-911675/.minikube/profiles/old-k8s-version-496808/apiserver.key.bb63bcf1 ...
I0308 04:04:46.156676 956560 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18333-911675/.minikube/profiles/old-k8s-version-496808/apiserver.key.bb63bcf1: {Name:mk560f8b3ddf676281b9bac59c53ec37aac6c564 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0308 04:04:46.156784 956560 certs.go:381] copying /home/jenkins/minikube-integration/18333-911675/.minikube/profiles/old-k8s-version-496808/apiserver.crt.bb63bcf1 -> /home/jenkins/minikube-integration/18333-911675/.minikube/profiles/old-k8s-version-496808/apiserver.crt
I0308 04:04:46.156893 956560 certs.go:385] copying /home/jenkins/minikube-integration/18333-911675/.minikube/profiles/old-k8s-version-496808/apiserver.key.bb63bcf1 -> /home/jenkins/minikube-integration/18333-911675/.minikube/profiles/old-k8s-version-496808/apiserver.key
I0308 04:04:46.156975 956560 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/18333-911675/.minikube/profiles/old-k8s-version-496808/proxy-client.key
I0308 04:04:46.156995 956560 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18333-911675/.minikube/profiles/old-k8s-version-496808/proxy-client.crt with IP's: []
I0308 04:04:46.363488 956560 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18333-911675/.minikube/profiles/old-k8s-version-496808/proxy-client.crt ...
I0308 04:04:46.363527 956560 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18333-911675/.minikube/profiles/old-k8s-version-496808/proxy-client.crt: {Name:mk55deba8065940fd30ff70d3b91a02d78d93a64 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0308 04:04:46.363716 956560 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18333-911675/.minikube/profiles/old-k8s-version-496808/proxy-client.key ...
I0308 04:04:46.363735 956560 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18333-911675/.minikube/profiles/old-k8s-version-496808/proxy-client.key: {Name:mk24d8422e03500cf4b215d9bf2c2750ff5b220c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0308 04:04:46.363947 956560 certs.go:484] found cert: /home/jenkins/minikube-integration/18333-911675/.minikube/certs/918988.pem (1338 bytes)
W0308 04:04:46.363986 956560 certs.go:480] ignoring /home/jenkins/minikube-integration/18333-911675/.minikube/certs/918988_empty.pem, impossibly tiny 0 bytes
I0308 04:04:46.363999 956560 certs.go:484] found cert: /home/jenkins/minikube-integration/18333-911675/.minikube/certs/ca-key.pem (1679 bytes)
I0308 04:04:46.364019 956560 certs.go:484] found cert: /home/jenkins/minikube-integration/18333-911675/.minikube/certs/ca.pem (1082 bytes)
I0308 04:04:46.364041 956560 certs.go:484] found cert: /home/jenkins/minikube-integration/18333-911675/.minikube/certs/cert.pem (1123 bytes)
I0308 04:04:46.364063 956560 certs.go:484] found cert: /home/jenkins/minikube-integration/18333-911675/.minikube/certs/key.pem (1679 bytes)
I0308 04:04:46.364104 956560 certs.go:484] found cert: /home/jenkins/minikube-integration/18333-911675/.minikube/files/etc/ssl/certs/9189882.pem (1708 bytes)
I0308 04:04:46.364782 956560 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18333-911675/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0308 04:04:46.394392 956560 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18333-911675/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0308 04:04:46.429898 956560 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18333-911675/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0308 04:04:46.455817 956560 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18333-911675/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0308 04:04:46.486038 956560 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18333-911675/.minikube/profiles/old-k8s-version-496808/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0308 04:04:46.516802 956560 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18333-911675/.minikube/profiles/old-k8s-version-496808/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0308 04:04:46.545102 956560 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18333-911675/.minikube/profiles/old-k8s-version-496808/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0308 04:04:46.576893 956560 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18333-911675/.minikube/profiles/old-k8s-version-496808/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0308 04:04:46.618814 956560 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18333-911675/.minikube/files/etc/ssl/certs/9189882.pem --> /usr/share/ca-certificates/9189882.pem (1708 bytes)
I0308 04:04:46.651013 956560 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18333-911675/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0308 04:04:46.681507 956560 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18333-911675/.minikube/certs/918988.pem --> /usr/share/ca-certificates/918988.pem (1338 bytes)
I0308 04:04:46.710806 956560 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0308 04:04:46.730522 956560 ssh_runner.go:195] Run: openssl version
I0308 04:04:46.738026 956560 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/9189882.pem && ln -fs /usr/share/ca-certificates/9189882.pem /etc/ssl/certs/9189882.pem"
I0308 04:04:46.751460 956560 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/9189882.pem
I0308 04:04:46.757108 956560 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Mar 8 03:05 /usr/share/ca-certificates/9189882.pem
I0308 04:04:46.757176 956560 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/9189882.pem
I0308 04:04:46.764502 956560 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/9189882.pem /etc/ssl/certs/3ec20f2e.0"
I0308 04:04:46.777126 956560 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0308 04:04:46.790453 956560 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0308 04:04:46.795929 956560 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Mar 8 02:56 /usr/share/ca-certificates/minikubeCA.pem
I0308 04:04:46.795999 956560 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0308 04:04:46.803384 956560 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0308 04:04:46.817092 956560 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/918988.pem && ln -fs /usr/share/ca-certificates/918988.pem /etc/ssl/certs/918988.pem"
I0308 04:04:46.830593 956560 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/918988.pem
I0308 04:04:46.836048 956560 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Mar 8 03:05 /usr/share/ca-certificates/918988.pem
I0308 04:04:46.836113 956560 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/918988.pem
I0308 04:04:46.842566 956560 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/918988.pem /etc/ssl/certs/51391683.0"
I0308 04:04:46.854666 956560 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0308 04:04:46.859457 956560 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0308 04:04:46.859518 956560 kubeadm.go:391] StartCluster: {Name:old-k8s-version-496808 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-496808 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.3 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountP
ort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0308 04:04:46.859673 956560 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0308 04:04:46.859727 956560 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0308 04:04:46.904062 956560 cri.go:89] found id: ""
I0308 04:04:46.904160 956560 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0308 04:04:46.914790 956560 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0308 04:04:46.924948 956560 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0308 04:04:46.935985 956560 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0308 04:04:46.936007 956560 kubeadm.go:156] found existing configuration files:
I0308 04:04:46.936051 956560 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0308 04:04:46.947364 956560 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0308 04:04:46.947433 956560 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0308 04:04:46.958148 956560 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0308 04:04:46.968585 956560 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0308 04:04:46.968649 956560 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0308 04:04:46.978905 956560 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0308 04:04:46.988792 956560 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0308 04:04:46.988856 956560 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0308 04:04:46.998920 956560 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0308 04:04:47.008963 956560 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0308 04:04:47.009029 956560 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0308 04:04:47.018973 956560 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0308 04:04:47.295341 956560 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0308 04:06:45.281611 956560 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0308 04:06:45.281763 956560 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
I0308 04:06:45.283261 956560 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0308 04:06:45.283362 956560 kubeadm.go:309] [preflight] Running pre-flight checks
I0308 04:06:45.283471 956560 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0308 04:06:45.283596 956560 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0308 04:06:45.283741 956560 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0308 04:06:45.283848 956560 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0308 04:06:45.285682 956560 out.go:204] - Generating certificates and keys ...
I0308 04:06:45.285780 956560 kubeadm.go:309] [certs] Using existing ca certificate authority
I0308 04:06:45.285874 956560 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0308 04:06:45.285962 956560 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key
I0308 04:06:45.286063 956560 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key
I0308 04:06:45.286167 956560 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key
I0308 04:06:45.286268 956560 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key
I0308 04:06:45.286345 956560 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key
I0308 04:06:45.286448 956560 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-496808] and IPs [192.168.39.3 127.0.0.1 ::1]
I0308 04:06:45.286498 956560 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key
I0308 04:06:45.286610 956560 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-496808] and IPs [192.168.39.3 127.0.0.1 ::1]
I0308 04:06:45.286668 956560 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key
I0308 04:06:45.286720 956560 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key
I0308 04:06:45.286765 956560 kubeadm.go:309] [certs] Generating "sa" key and public key
I0308 04:06:45.286827 956560 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0308 04:06:45.286874 956560 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0308 04:06:45.286956 956560 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0308 04:06:45.287027 956560 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0308 04:06:45.287111 956560 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0308 04:06:45.287276 956560 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0308 04:06:45.287382 956560 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0308 04:06:45.287441 956560 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0308 04:06:45.287533 956560 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0308 04:06:45.289650 956560 out.go:204] - Booting up control plane ...
I0308 04:06:45.289757 956560 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0308 04:06:45.289840 956560 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0308 04:06:45.289928 956560 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0308 04:06:45.290027 956560 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0308 04:06:45.290213 956560 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0308 04:06:45.290260 956560 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0308 04:06:45.290317 956560 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0308 04:06:45.290483 956560 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0308 04:06:45.290545 956560 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0308 04:06:45.290763 956560 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0308 04:06:45.290857 956560 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0308 04:06:45.291137 956560 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0308 04:06:45.291242 956560 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0308 04:06:45.291516 956560 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0308 04:06:45.291619 956560 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0308 04:06:45.291870 956560 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0308 04:06:45.291880 956560 kubeadm.go:309]
I0308 04:06:45.291939 956560 kubeadm.go:309] Unfortunately, an error has occurred:
I0308 04:06:45.291996 956560 kubeadm.go:309] timed out waiting for the condition
I0308 04:06:45.292010 956560 kubeadm.go:309]
I0308 04:06:45.292056 956560 kubeadm.go:309] This error is likely caused by:
I0308 04:06:45.292087 956560 kubeadm.go:309] - The kubelet is not running
I0308 04:06:45.292196 956560 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0308 04:06:45.292208 956560 kubeadm.go:309]
I0308 04:06:45.292353 956560 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0308 04:06:45.292415 956560 kubeadm.go:309] - 'systemctl status kubelet'
I0308 04:06:45.292462 956560 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0308 04:06:45.292472 956560 kubeadm.go:309]
I0308 04:06:45.292629 956560 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0308 04:06:45.292732 956560 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0308 04:06:45.292744 956560 kubeadm.go:309]
I0308 04:06:45.292888 956560 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0308 04:06:45.292990 956560 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0308 04:06:45.293099 956560 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0308 04:06:45.293211 956560 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0308 04:06:45.293289 956560 kubeadm.go:309]
W0308 04:06:45.293388 956560 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-496808] and IPs [192.168.39.3 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-496808] and IPs [192.168.39.3 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-496808] and IPs [192.168.39.3 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-496808] and IPs [192.168.39.3 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0308 04:06:45.293434 956560 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0308 04:06:47.558047 956560 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (2.264572842s)
I0308 04:06:47.558149 956560 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0308 04:06:47.575276 956560 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0308 04:06:47.588818 956560 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0308 04:06:47.588847 956560 kubeadm.go:156] found existing configuration files:
I0308 04:06:47.588905 956560 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0308 04:06:47.601535 956560 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0308 04:06:47.601626 956560 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0308 04:06:47.614816 956560 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0308 04:06:47.627893 956560 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0308 04:06:47.627989 956560 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0308 04:06:47.641949 956560 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0308 04:06:47.652575 956560 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0308 04:06:47.652635 956560 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0308 04:06:47.663300 956560 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0308 04:06:47.673510 956560 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0308 04:06:47.673580 956560 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0308 04:06:47.684778 956560 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0308 04:06:47.765233 956560 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0308 04:06:47.765422 956560 kubeadm.go:309] [preflight] Running pre-flight checks
I0308 04:06:47.935656 956560 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0308 04:06:47.935846 956560 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0308 04:06:47.936006 956560 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0308 04:06:48.151222 956560 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0308 04:06:48.153098 956560 out.go:204] - Generating certificates and keys ...
I0308 04:06:48.153188 956560 kubeadm.go:309] [certs] Using existing ca certificate authority
I0308 04:06:48.153270 956560 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0308 04:06:48.153422 956560 kubeadm.go:309] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0308 04:06:48.153532 956560 kubeadm.go:309] [certs] Using existing front-proxy-ca certificate authority
I0308 04:06:48.153626 956560 kubeadm.go:309] [certs] Using existing front-proxy-client certificate and key on disk
I0308 04:06:48.153715 956560 kubeadm.go:309] [certs] Using existing etcd/ca certificate authority
I0308 04:06:48.153814 956560 kubeadm.go:309] [certs] Using existing etcd/server certificate and key on disk
I0308 04:06:48.153900 956560 kubeadm.go:309] [certs] Using existing etcd/peer certificate and key on disk
I0308 04:06:48.153976 956560 kubeadm.go:309] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0308 04:06:48.154148 956560 kubeadm.go:309] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0308 04:06:48.154728 956560 kubeadm.go:309] [certs] Using the existing "sa" key
I0308 04:06:48.154981 956560 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0308 04:06:48.406875 956560 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0308 04:06:48.778332 956560 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0308 04:06:48.855424 956560 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0308 04:06:49.230365 956560 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0308 04:06:49.247306 956560 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0308 04:06:49.248489 956560 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0308 04:06:49.248570 956560 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0308 04:06:49.398400 956560 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0308 04:06:49.400189 956560 out.go:204] - Booting up control plane ...
I0308 04:06:49.400310 956560 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0308 04:06:49.404745 956560 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0308 04:06:49.413477 956560 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0308 04:06:49.414689 956560 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0308 04:06:49.417743 956560 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0308 04:07:29.420509 956560 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0308 04:07:29.421464 956560 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0308 04:07:29.421780 956560 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0308 04:07:34.422672 956560 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0308 04:07:34.422909 956560 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0308 04:07:44.423596 956560 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0308 04:07:44.423819 956560 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0308 04:08:04.425107 956560 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0308 04:08:04.425344 956560 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0308 04:08:44.425116 956560 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0308 04:08:44.425394 956560 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0308 04:08:44.425414 956560 kubeadm.go:309]
I0308 04:08:44.425457 956560 kubeadm.go:309] Unfortunately, an error has occurred:
I0308 04:08:44.425726 956560 kubeadm.go:309] timed out waiting for the condition
I0308 04:08:44.425742 956560 kubeadm.go:309]
I0308 04:08:44.425789 956560 kubeadm.go:309] This error is likely caused by:
I0308 04:08:44.425848 956560 kubeadm.go:309] - The kubelet is not running
I0308 04:08:44.425991 956560 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0308 04:08:44.426004 956560 kubeadm.go:309]
I0308 04:08:44.426145 956560 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0308 04:08:44.426215 956560 kubeadm.go:309] - 'systemctl status kubelet'
I0308 04:08:44.426292 956560 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0308 04:08:44.426313 956560 kubeadm.go:309]
I0308 04:08:44.426460 956560 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0308 04:08:44.426585 956560 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0308 04:08:44.426603 956560 kubeadm.go:309]
I0308 04:08:44.426730 956560 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0308 04:08:44.426850 956560 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0308 04:08:44.426954 956560 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0308 04:08:44.427054 956560 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0308 04:08:44.427074 956560 kubeadm.go:309]
I0308 04:08:44.428527 956560 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0308 04:08:44.428629 956560 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0308 04:08:44.428716 956560 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
I0308 04:08:44.428790 956560 kubeadm.go:393] duration metric: took 3m57.569278513s to StartCluster
I0308 04:08:44.428836 956560 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0308 04:08:44.428897 956560 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0308 04:08:44.486126 956560 cri.go:89] found id: ""
I0308 04:08:44.486172 956560 logs.go:276] 0 containers: []
W0308 04:08:44.486181 956560 logs.go:278] No container was found matching "kube-apiserver"
I0308 04:08:44.486187 956560 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0308 04:08:44.486240 956560 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0308 04:08:44.533687 956560 cri.go:89] found id: ""
I0308 04:08:44.533717 956560 logs.go:276] 0 containers: []
W0308 04:08:44.533726 956560 logs.go:278] No container was found matching "etcd"
I0308 04:08:44.533739 956560 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0308 04:08:44.533795 956560 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0308 04:08:44.572560 956560 cri.go:89] found id: ""
I0308 04:08:44.572592 956560 logs.go:276] 0 containers: []
W0308 04:08:44.572605 956560 logs.go:278] No container was found matching "coredns"
I0308 04:08:44.572612 956560 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0308 04:08:44.572668 956560 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0308 04:08:44.613212 956560 cri.go:89] found id: ""
I0308 04:08:44.613250 956560 logs.go:276] 0 containers: []
W0308 04:08:44.613262 956560 logs.go:278] No container was found matching "kube-scheduler"
I0308 04:08:44.613271 956560 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0308 04:08:44.613363 956560 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0308 04:08:44.651372 956560 cri.go:89] found id: ""
I0308 04:08:44.651407 956560 logs.go:276] 0 containers: []
W0308 04:08:44.651418 956560 logs.go:278] No container was found matching "kube-proxy"
I0308 04:08:44.651428 956560 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0308 04:08:44.651500 956560 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0308 04:08:44.691605 956560 cri.go:89] found id: ""
I0308 04:08:44.691636 956560 logs.go:276] 0 containers: []
W0308 04:08:44.691659 956560 logs.go:278] No container was found matching "kube-controller-manager"
I0308 04:08:44.691666 956560 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0308 04:08:44.691722 956560 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0308 04:08:44.729883 956560 cri.go:89] found id: ""
I0308 04:08:44.729911 956560 logs.go:276] 0 containers: []
W0308 04:08:44.729918 956560 logs.go:278] No container was found matching "kindnet"
I0308 04:08:44.729929 956560 logs.go:123] Gathering logs for describe nodes ...
I0308 04:08:44.729947 956560 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0308 04:08:44.863555 956560 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0308 04:08:44.863581 956560 logs.go:123] Gathering logs for CRI-O ...
I0308 04:08:44.863599 956560 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0308 04:08:44.960270 956560 logs.go:123] Gathering logs for container status ...
I0308 04:08:44.960321 956560 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0308 04:08:45.022079 956560 logs.go:123] Gathering logs for kubelet ...
I0308 04:08:45.022110 956560 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0308 04:08:45.072362 956560 logs.go:123] Gathering logs for dmesg ...
I0308 04:08:45.072400 956560 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
W0308 04:08:45.086741 956560 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0308 04:08:45.086787 956560 out.go:239] *
*
W0308 04:08:45.086852 956560 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0308 04:08:45.086882 956560 out.go:239] *
*
W0308 04:08:45.087973 956560 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0308 04:08:45.091881 956560 out.go:177]
W0308 04:08:45.093424 956560 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0308 04:08:45.093481 956560 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0308 04:08:45.093504 956560 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0308 04:08:45.095097 956560 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-496808 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-496808 -n old-k8s-version-496808
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-496808 -n old-k8s-version-496808: exit status 6 (239.939356ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0308 04:08:45.376328 958964 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-496808" does not appear in /home/jenkins/minikube-integration/18333-911675/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-496808" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (281.97s)