=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-166693 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-166693 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m25.187075016s)
-- stdout --
* [old-k8s-version-166693] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=19046
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19046-3880/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19046-3880/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-166693" primary control-plane node in "old-k8s-version-166693" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0610 11:38:57.017319 54458 out.go:291] Setting OutFile to fd 1 ...
I0610 11:38:57.017439 54458 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0610 11:38:57.017451 54458 out.go:304] Setting ErrFile to fd 2...
I0610 11:38:57.017455 54458 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0610 11:38:57.017693 54458 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19046-3880/.minikube/bin
I0610 11:38:57.018395 54458 out.go:298] Setting JSON to false
I0610 11:38:57.019424 54458 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-9","uptime":4878,"bootTime":1718014659,"procs":211,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1062-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0610 11:38:57.019487 54458 start.go:139] virtualization: kvm guest
I0610 11:38:57.022013 54458 out.go:177] * [old-k8s-version-166693] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
I0610 11:38:57.023907 54458 out.go:177] - MINIKUBE_LOCATION=19046
I0610 11:38:57.023881 54458 notify.go:220] Checking for updates...
I0610 11:38:57.025394 54458 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0610 11:38:57.026939 54458 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19046-3880/kubeconfig
I0610 11:38:57.028383 54458 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19046-3880/.minikube
I0610 11:38:57.029727 54458 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0610 11:38:57.031056 54458 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0610 11:38:57.032992 54458 config.go:182] Loaded profile config "cert-expiration-324836": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.1
I0610 11:38:57.033140 54458 config.go:182] Loaded profile config "kubernetes-upgrade-685160": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0610 11:38:57.033287 54458 config.go:182] Loaded profile config "stopped-upgrade-161665": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.24.1
I0610 11:38:57.033416 54458 driver.go:392] Setting default libvirt URI to qemu:///system
I0610 11:38:57.080063 54458 out.go:177] * Using the kvm2 driver based on user configuration
I0610 11:38:57.081676 54458 start.go:297] selected driver: kvm2
I0610 11:38:57.081702 54458 start.go:901] validating driver "kvm2" against <nil>
I0610 11:38:57.081718 54458 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0610 11:38:57.082838 54458 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0610 11:38:57.082984 54458 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19046-3880/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0610 11:38:57.107481 54458 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.1
I0610 11:38:57.107541 54458 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0610 11:38:57.107766 54458 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0610 11:38:57.107790 54458 cni.go:84] Creating CNI manager for ""
I0610 11:38:57.107803 54458 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0610 11:38:57.107811 54458 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0610 11:38:57.107866 54458 start.go:340] cluster config:
{Name:old-k8s-version-166693 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1717668449-19038@sha256:30d191eb345232f513c52f7ac036e7a34a8cc441d88353f92985384bcddf00d6 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-166693 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0610 11:38:57.108002 54458 iso.go:125] acquiring lock: {Name:mk85871dbcb370cef71a4aa2ff7ef43503908c3b Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0610 11:38:57.109821 54458 out.go:177] * Starting "old-k8s-version-166693" primary control-plane node in "old-k8s-version-166693" cluster
I0610 11:38:57.111261 54458 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0610 11:38:57.111302 54458 preload.go:147] Found local preload: /home/jenkins/minikube-integration/19046-3880/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0610 11:38:57.111314 54458 cache.go:56] Caching tarball of preloaded images
I0610 11:38:57.111407 54458 preload.go:173] Found /home/jenkins/minikube-integration/19046-3880/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0610 11:38:57.111422 54458 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0610 11:38:57.111557 54458 profile.go:143] Saving config to /home/jenkins/minikube-integration/19046-3880/.minikube/profiles/old-k8s-version-166693/config.json ...
I0610 11:38:57.111580 54458 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19046-3880/.minikube/profiles/old-k8s-version-166693/config.json: {Name:mka9f7511c21135f3d449d39c92f524984407e64 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0610 11:38:57.111754 54458 start.go:360] acquireMachinesLock for old-k8s-version-166693: {Name:mk97d1bc660650f670f4180e5028cc6bf11b1450 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0610 11:38:57.111793 54458 start.go:364] duration metric: took 18.524µs to acquireMachinesLock for "old-k8s-version-166693"
I0610 11:38:57.111812 54458 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-166693 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19038/minikube-v1.33.1-1717668912-19038-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1717668449-19038@sha256:30d191eb345232f513c52f7ac036e7a34a8cc441d88353f92985384bcddf00d6 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-166693 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0610 11:38:57.111889 54458 start.go:125] createHost starting for "" (driver="kvm2")
I0610 11:38:57.113446 54458 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0610 11:38:57.113608 54458 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0610 11:38:57.113660 54458 main.go:141] libmachine: Launching plugin server for driver kvm2
I0610 11:38:57.128366 54458 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33779
I0610 11:38:57.128888 54458 main.go:141] libmachine: () Calling .GetVersion
I0610 11:38:57.129569 54458 main.go:141] libmachine: Using API Version 1
I0610 11:38:57.129590 54458 main.go:141] libmachine: () Calling .SetConfigRaw
I0610 11:38:57.129962 54458 main.go:141] libmachine: () Calling .GetMachineName
I0610 11:38:57.130161 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetMachineName
I0610 11:38:57.130295 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .DriverName
I0610 11:38:57.130429 54458 start.go:159] libmachine.API.Create for "old-k8s-version-166693" (driver="kvm2")
I0610 11:38:57.130452 54458 client.go:168] LocalClient.Create starting
I0610 11:38:57.130486 54458 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19046-3880/.minikube/certs/ca.pem
I0610 11:38:57.130522 54458 main.go:141] libmachine: Decoding PEM data...
I0610 11:38:57.130537 54458 main.go:141] libmachine: Parsing certificate...
I0610 11:38:57.130583 54458 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19046-3880/.minikube/certs/cert.pem
I0610 11:38:57.130601 54458 main.go:141] libmachine: Decoding PEM data...
I0610 11:38:57.130612 54458 main.go:141] libmachine: Parsing certificate...
I0610 11:38:57.130626 54458 main.go:141] libmachine: Running pre-create checks...
I0610 11:38:57.130635 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .PreCreateCheck
I0610 11:38:57.131011 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetConfigRaw
I0610 11:38:57.131381 54458 main.go:141] libmachine: Creating machine...
I0610 11:38:57.131394 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .Create
I0610 11:38:57.131543 54458 main.go:141] libmachine: (old-k8s-version-166693) Creating KVM machine...
I0610 11:38:57.132913 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | found existing default KVM network
I0610 11:38:57.134537 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | I0610 11:38:57.134369 54478 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:4c:d0:b9} reservation:<nil>}
I0610 11:38:57.135738 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | I0610 11:38:57.135646 54478 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:93:50:cc} reservation:<nil>}
I0610 11:38:57.137082 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | I0610 11:38:57.136938 54478 network.go:211] skipping subnet 192.168.61.0/24 that is taken: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName:virbr4 IfaceIPv4:192.168.61.1 IfaceMTU:1500 IfaceMAC:52:54:00:3e:67:dd} reservation:<nil>}
I0610 11:38:57.138541 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | I0610 11:38:57.138474 54478 network.go:206] using free private subnet 192.168.72.0/24: &{IP:192.168.72.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.72.0/24 Gateway:192.168.72.1 ClientMin:192.168.72.2 ClientMax:192.168.72.254 Broadcast:192.168.72.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0003091b0}
I0610 11:38:57.138611 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | created network xml:
I0610 11:38:57.138630 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | <network>
I0610 11:38:57.138642 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | <name>mk-old-k8s-version-166693</name>
I0610 11:38:57.138650 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | <dns enable='no'/>
I0610 11:38:57.138658 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG |
I0610 11:38:57.138668 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | <ip address='192.168.72.1' netmask='255.255.255.0'>
I0610 11:38:57.138678 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | <dhcp>
I0610 11:38:57.138687 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | <range start='192.168.72.2' end='192.168.72.253'/>
I0610 11:38:57.138696 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | </dhcp>
I0610 11:38:57.138703 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | </ip>
I0610 11:38:57.138720 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG |
I0610 11:38:57.138731 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | </network>
I0610 11:38:57.138759 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG |
I0610 11:38:57.145013 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | trying to create private KVM network mk-old-k8s-version-166693 192.168.72.0/24...
I0610 11:38:57.232805 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | private KVM network mk-old-k8s-version-166693 192.168.72.0/24 created
I0610 11:38:57.232859 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | I0610 11:38:57.232756 54478 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19046-3880/.minikube
I0610 11:38:57.232888 54458 main.go:141] libmachine: (old-k8s-version-166693) Setting up store path in /home/jenkins/minikube-integration/19046-3880/.minikube/machines/old-k8s-version-166693 ...
I0610 11:38:57.232901 54458 main.go:141] libmachine: (old-k8s-version-166693) Building disk image from file:///home/jenkins/minikube-integration/19046-3880/.minikube/cache/iso/amd64/minikube-v1.33.1-1717668912-19038-amd64.iso
I0610 11:38:57.232929 54458 main.go:141] libmachine: (old-k8s-version-166693) Downloading /home/jenkins/minikube-integration/19046-3880/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19046-3880/.minikube/cache/iso/amd64/minikube-v1.33.1-1717668912-19038-amd64.iso...
I0610 11:38:57.461731 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | I0610 11:38:57.461576 54478 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19046-3880/.minikube/machines/old-k8s-version-166693/id_rsa...
I0610 11:38:57.600466 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | I0610 11:38:57.600305 54478 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19046-3880/.minikube/machines/old-k8s-version-166693/old-k8s-version-166693.rawdisk...
I0610 11:38:57.600565 54458 main.go:141] libmachine: (old-k8s-version-166693) Setting executable bit set on /home/jenkins/minikube-integration/19046-3880/.minikube/machines/old-k8s-version-166693 (perms=drwx------)
I0610 11:38:57.600580 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | Writing magic tar header
I0610 11:38:57.600596 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | Writing SSH key tar header
I0610 11:38:57.600625 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | I0610 11:38:57.600418 54478 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19046-3880/.minikube/machines/old-k8s-version-166693 ...
I0610 11:38:57.600658 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19046-3880/.minikube/machines/old-k8s-version-166693
I0610 11:38:57.600678 54458 main.go:141] libmachine: (old-k8s-version-166693) Setting executable bit set on /home/jenkins/minikube-integration/19046-3880/.minikube/machines (perms=drwxr-xr-x)
I0610 11:38:57.600761 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19046-3880/.minikube/machines
I0610 11:38:57.600800 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19046-3880/.minikube
I0610 11:38:57.600852 54458 main.go:141] libmachine: (old-k8s-version-166693) Setting executable bit set on /home/jenkins/minikube-integration/19046-3880/.minikube (perms=drwxr-xr-x)
I0610 11:38:57.600867 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19046-3880
I0610 11:38:57.600882 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0610 11:38:57.600902 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | Checking permissions on dir: /home/jenkins
I0610 11:38:57.600913 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | Checking permissions on dir: /home
I0610 11:38:57.600919 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | Skipping /home - not owner
I0610 11:38:57.600958 54458 main.go:141] libmachine: (old-k8s-version-166693) Setting executable bit set on /home/jenkins/minikube-integration/19046-3880 (perms=drwxrwxr-x)
I0610 11:38:57.600985 54458 main.go:141] libmachine: (old-k8s-version-166693) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0610 11:38:57.601002 54458 main.go:141] libmachine: (old-k8s-version-166693) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0610 11:38:57.601015 54458 main.go:141] libmachine: (old-k8s-version-166693) Creating domain...
I0610 11:38:57.602160 54458 main.go:141] libmachine: (old-k8s-version-166693) define libvirt domain using xml:
I0610 11:38:57.602205 54458 main.go:141] libmachine: (old-k8s-version-166693) <domain type='kvm'>
I0610 11:38:57.602220 54458 main.go:141] libmachine: (old-k8s-version-166693) <name>old-k8s-version-166693</name>
I0610 11:38:57.602230 54458 main.go:141] libmachine: (old-k8s-version-166693) <memory unit='MiB'>2200</memory>
I0610 11:38:57.602239 54458 main.go:141] libmachine: (old-k8s-version-166693) <vcpu>2</vcpu>
I0610 11:38:57.602259 54458 main.go:141] libmachine: (old-k8s-version-166693) <features>
I0610 11:38:57.602288 54458 main.go:141] libmachine: (old-k8s-version-166693) <acpi/>
I0610 11:38:57.602305 54458 main.go:141] libmachine: (old-k8s-version-166693) <apic/>
I0610 11:38:57.602314 54458 main.go:141] libmachine: (old-k8s-version-166693) <pae/>
I0610 11:38:57.602331 54458 main.go:141] libmachine: (old-k8s-version-166693)
I0610 11:38:57.602375 54458 main.go:141] libmachine: (old-k8s-version-166693) </features>
I0610 11:38:57.602409 54458 main.go:141] libmachine: (old-k8s-version-166693) <cpu mode='host-passthrough'>
I0610 11:38:57.602431 54458 main.go:141] libmachine: (old-k8s-version-166693)
I0610 11:38:57.602447 54458 main.go:141] libmachine: (old-k8s-version-166693) </cpu>
I0610 11:38:57.602465 54458 main.go:141] libmachine: (old-k8s-version-166693) <os>
I0610 11:38:57.602480 54458 main.go:141] libmachine: (old-k8s-version-166693) <type>hvm</type>
I0610 11:38:57.602497 54458 main.go:141] libmachine: (old-k8s-version-166693) <boot dev='cdrom'/>
I0610 11:38:57.602515 54458 main.go:141] libmachine: (old-k8s-version-166693) <boot dev='hd'/>
I0610 11:38:57.602540 54458 main.go:141] libmachine: (old-k8s-version-166693) <bootmenu enable='no'/>
I0610 11:38:57.602558 54458 main.go:141] libmachine: (old-k8s-version-166693) </os>
I0610 11:38:57.602582 54458 main.go:141] libmachine: (old-k8s-version-166693) <devices>
I0610 11:38:57.602618 54458 main.go:141] libmachine: (old-k8s-version-166693) <disk type='file' device='cdrom'>
I0610 11:38:57.602643 54458 main.go:141] libmachine: (old-k8s-version-166693) <source file='/home/jenkins/minikube-integration/19046-3880/.minikube/machines/old-k8s-version-166693/boot2docker.iso'/>
I0610 11:38:57.602669 54458 main.go:141] libmachine: (old-k8s-version-166693) <target dev='hdc' bus='scsi'/>
I0610 11:38:57.602680 54458 main.go:141] libmachine: (old-k8s-version-166693) <readonly/>
I0610 11:38:57.602688 54458 main.go:141] libmachine: (old-k8s-version-166693) </disk>
I0610 11:38:57.602699 54458 main.go:141] libmachine: (old-k8s-version-166693) <disk type='file' device='disk'>
I0610 11:38:57.602711 54458 main.go:141] libmachine: (old-k8s-version-166693) <driver name='qemu' type='raw' cache='default' io='threads' />
I0610 11:38:57.602724 54458 main.go:141] libmachine: (old-k8s-version-166693) <source file='/home/jenkins/minikube-integration/19046-3880/.minikube/machines/old-k8s-version-166693/old-k8s-version-166693.rawdisk'/>
I0610 11:38:57.602758 54458 main.go:141] libmachine: (old-k8s-version-166693) <target dev='hda' bus='virtio'/>
I0610 11:38:57.602776 54458 main.go:141] libmachine: (old-k8s-version-166693) </disk>
I0610 11:38:57.602795 54458 main.go:141] libmachine: (old-k8s-version-166693) <interface type='network'>
I0610 11:38:57.602803 54458 main.go:141] libmachine: (old-k8s-version-166693) <source network='mk-old-k8s-version-166693'/>
I0610 11:38:57.602813 54458 main.go:141] libmachine: (old-k8s-version-166693) <model type='virtio'/>
I0610 11:38:57.602820 54458 main.go:141] libmachine: (old-k8s-version-166693) </interface>
I0610 11:38:57.602830 54458 main.go:141] libmachine: (old-k8s-version-166693) <interface type='network'>
I0610 11:38:57.602837 54458 main.go:141] libmachine: (old-k8s-version-166693) <source network='default'/>
I0610 11:38:57.602846 54458 main.go:141] libmachine: (old-k8s-version-166693) <model type='virtio'/>
I0610 11:38:57.602854 54458 main.go:141] libmachine: (old-k8s-version-166693) </interface>
I0610 11:38:57.602863 54458 main.go:141] libmachine: (old-k8s-version-166693) <serial type='pty'>
I0610 11:38:57.602870 54458 main.go:141] libmachine: (old-k8s-version-166693) <target port='0'/>
I0610 11:38:57.602877 54458 main.go:141] libmachine: (old-k8s-version-166693) </serial>
I0610 11:38:57.602885 54458 main.go:141] libmachine: (old-k8s-version-166693) <console type='pty'>
I0610 11:38:57.602893 54458 main.go:141] libmachine: (old-k8s-version-166693) <target type='serial' port='0'/>
I0610 11:38:57.602901 54458 main.go:141] libmachine: (old-k8s-version-166693) </console>
I0610 11:38:57.602908 54458 main.go:141] libmachine: (old-k8s-version-166693) <rng model='virtio'>
I0610 11:38:57.602918 54458 main.go:141] libmachine: (old-k8s-version-166693) <backend model='random'>/dev/random</backend>
I0610 11:38:57.602924 54458 main.go:141] libmachine: (old-k8s-version-166693) </rng>
I0610 11:38:57.602932 54458 main.go:141] libmachine: (old-k8s-version-166693)
I0610 11:38:57.602938 54458 main.go:141] libmachine: (old-k8s-version-166693)
I0610 11:38:57.602945 54458 main.go:141] libmachine: (old-k8s-version-166693) </devices>
I0610 11:38:57.602951 54458 main.go:141] libmachine: (old-k8s-version-166693) </domain>
I0610 11:38:57.602960 54458 main.go:141] libmachine: (old-k8s-version-166693)
I0610 11:38:57.606935 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | domain old-k8s-version-166693 has defined MAC address 52:54:00:0a:96:eb in network default
I0610 11:38:57.607693 54458 main.go:141] libmachine: (old-k8s-version-166693) Ensuring networks are active...
I0610 11:38:57.607721 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | domain old-k8s-version-166693 has defined MAC address 52:54:00:43:ea:f9 in network mk-old-k8s-version-166693
I0610 11:38:57.608673 54458 main.go:141] libmachine: (old-k8s-version-166693) Ensuring network default is active
I0610 11:38:57.609252 54458 main.go:141] libmachine: (old-k8s-version-166693) Ensuring network mk-old-k8s-version-166693 is active
I0610 11:38:57.609868 54458 main.go:141] libmachine: (old-k8s-version-166693) Getting domain xml...
I0610 11:38:57.610774 54458 main.go:141] libmachine: (old-k8s-version-166693) Creating domain...
I0610 11:38:58.954669 54458 main.go:141] libmachine: (old-k8s-version-166693) Waiting to get IP...
I0610 11:38:58.955670 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | domain old-k8s-version-166693 has defined MAC address 52:54:00:43:ea:f9 in network mk-old-k8s-version-166693
I0610 11:38:58.956203 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | unable to find current IP address of domain old-k8s-version-166693 in network mk-old-k8s-version-166693
I0610 11:38:58.956227 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | I0610 11:38:58.956146 54478 retry.go:31] will retry after 254.646578ms: waiting for machine to come up
I0610 11:38:59.213490 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | domain old-k8s-version-166693 has defined MAC address 52:54:00:43:ea:f9 in network mk-old-k8s-version-166693
I0610 11:38:59.213583 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | unable to find current IP address of domain old-k8s-version-166693 in network mk-old-k8s-version-166693
I0610 11:38:59.213615 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | I0610 11:38:59.213213 54478 retry.go:31] will retry after 375.560944ms: waiting for machine to come up
I0610 11:38:59.590327 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | domain old-k8s-version-166693 has defined MAC address 52:54:00:43:ea:f9 in network mk-old-k8s-version-166693
I0610 11:38:59.591039 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | unable to find current IP address of domain old-k8s-version-166693 in network mk-old-k8s-version-166693
I0610 11:38:59.591095 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | I0610 11:38:59.590952 54478 retry.go:31] will retry after 405.142842ms: waiting for machine to come up
I0610 11:38:59.997445 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | domain old-k8s-version-166693 has defined MAC address 52:54:00:43:ea:f9 in network mk-old-k8s-version-166693
I0610 11:38:59.998060 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | unable to find current IP address of domain old-k8s-version-166693 in network mk-old-k8s-version-166693
I0610 11:38:59.998091 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | I0610 11:38:59.998005 54478 retry.go:31] will retry after 503.729327ms: waiting for machine to come up
I0610 11:39:00.503627 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | domain old-k8s-version-166693 has defined MAC address 52:54:00:43:ea:f9 in network mk-old-k8s-version-166693
I0610 11:39:00.504210 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | unable to find current IP address of domain old-k8s-version-166693 in network mk-old-k8s-version-166693
I0610 11:39:00.504240 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | I0610 11:39:00.504169 54478 retry.go:31] will retry after 759.003753ms: waiting for machine to come up
I0610 11:39:01.265481 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | domain old-k8s-version-166693 has defined MAC address 52:54:00:43:ea:f9 in network mk-old-k8s-version-166693
I0610 11:39:01.265978 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | unable to find current IP address of domain old-k8s-version-166693 in network mk-old-k8s-version-166693
I0610 11:39:01.266025 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | I0610 11:39:01.265904 54478 retry.go:31] will retry after 832.773921ms: waiting for machine to come up
I0610 11:39:02.100061 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | domain old-k8s-version-166693 has defined MAC address 52:54:00:43:ea:f9 in network mk-old-k8s-version-166693
I0610 11:39:02.100540 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | unable to find current IP address of domain old-k8s-version-166693 in network mk-old-k8s-version-166693
I0610 11:39:02.100569 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | I0610 11:39:02.100489 54478 retry.go:31] will retry after 912.47266ms: waiting for machine to come up
I0610 11:39:03.015175 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | domain old-k8s-version-166693 has defined MAC address 52:54:00:43:ea:f9 in network mk-old-k8s-version-166693
I0610 11:39:03.015712 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | unable to find current IP address of domain old-k8s-version-166693 in network mk-old-k8s-version-166693
I0610 11:39:03.015744 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | I0610 11:39:03.015658 54478 retry.go:31] will retry after 1.298082273s: waiting for machine to come up
I0610 11:39:04.315020 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | domain old-k8s-version-166693 has defined MAC address 52:54:00:43:ea:f9 in network mk-old-k8s-version-166693
I0610 11:39:04.315665 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | unable to find current IP address of domain old-k8s-version-166693 in network mk-old-k8s-version-166693
I0610 11:39:04.315690 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | I0610 11:39:04.315612 54478 retry.go:31] will retry after 1.157323325s: waiting for machine to come up
I0610 11:39:05.474752 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | domain old-k8s-version-166693 has defined MAC address 52:54:00:43:ea:f9 in network mk-old-k8s-version-166693
I0610 11:39:05.475373 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | unable to find current IP address of domain old-k8s-version-166693 in network mk-old-k8s-version-166693
I0610 11:39:05.475400 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | I0610 11:39:05.475316 54478 retry.go:31] will retry after 2.136356657s: waiting for machine to come up
I0610 11:39:07.709149 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | domain old-k8s-version-166693 has defined MAC address 52:54:00:43:ea:f9 in network mk-old-k8s-version-166693
I0610 11:39:07.709650 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | unable to find current IP address of domain old-k8s-version-166693 in network mk-old-k8s-version-166693
I0610 11:39:07.709675 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | I0610 11:39:07.709596 54478 retry.go:31] will retry after 1.888747417s: waiting for machine to come up
I0610 11:39:09.600720 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | domain old-k8s-version-166693 has defined MAC address 52:54:00:43:ea:f9 in network mk-old-k8s-version-166693
I0610 11:39:09.601192 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | unable to find current IP address of domain old-k8s-version-166693 in network mk-old-k8s-version-166693
I0610 11:39:09.601229 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | I0610 11:39:09.601159 54478 retry.go:31] will retry after 3.602278077s: waiting for machine to come up
I0610 11:39:13.205366 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | domain old-k8s-version-166693 has defined MAC address 52:54:00:43:ea:f9 in network mk-old-k8s-version-166693
I0610 11:39:13.206094 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | unable to find current IP address of domain old-k8s-version-166693 in network mk-old-k8s-version-166693
I0610 11:39:13.206119 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | I0610 11:39:13.206056 54478 retry.go:31] will retry after 3.634741011s: waiting for machine to come up
I0610 11:39:16.845110 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | domain old-k8s-version-166693 has defined MAC address 52:54:00:43:ea:f9 in network mk-old-k8s-version-166693
I0610 11:39:16.845606 54458 main.go:141] libmachine: (old-k8s-version-166693) Found IP for machine: 192.168.72.34
I0610 11:39:16.845638 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | domain old-k8s-version-166693 has current primary IP address 192.168.72.34 and MAC address 52:54:00:43:ea:f9 in network mk-old-k8s-version-166693
I0610 11:39:16.845648 54458 main.go:141] libmachine: (old-k8s-version-166693) Reserving static IP address...
I0610 11:39:16.845990 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-166693", mac: "52:54:00:43:ea:f9", ip: "192.168.72.34"} in network mk-old-k8s-version-166693
I0610 11:39:16.922622 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | Getting to WaitForSSH function...
I0610 11:39:16.922652 54458 main.go:141] libmachine: (old-k8s-version-166693) Reserved static IP address: 192.168.72.34
I0610 11:39:16.922667 54458 main.go:141] libmachine: (old-k8s-version-166693) Waiting for SSH to be available...
I0610 11:39:16.925550 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | domain old-k8s-version-166693 has defined MAC address 52:54:00:43:ea:f9 in network mk-old-k8s-version-166693
I0610 11:39:16.926117 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:43:ea:f9", ip: ""} in network mk-old-k8s-version-166693: {Iface:virbr3 ExpiryTime:2024-06-10 12:39:11 +0000 UTC Type:0 Mac:52:54:00:43:ea:f9 Iaid: IPaddr:192.168.72.34 Prefix:24 Hostname:minikube Clientid:01:52:54:00:43:ea:f9}
I0610 11:39:16.926149 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | domain old-k8s-version-166693 has defined IP address 192.168.72.34 and MAC address 52:54:00:43:ea:f9 in network mk-old-k8s-version-166693
I0610 11:39:16.926361 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | Using SSH client type: external
I0610 11:39:16.926391 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | Using SSH private key: /home/jenkins/minikube-integration/19046-3880/.minikube/machines/old-k8s-version-166693/id_rsa (-rw-------)
I0610 11:39:16.926435 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.72.34 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19046-3880/.minikube/machines/old-k8s-version-166693/id_rsa -p 22] /usr/bin/ssh <nil>}
I0610 11:39:16.926448 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | About to run SSH command:
I0610 11:39:16.926462 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | exit 0
I0610 11:39:17.058068 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | SSH cmd err, output: <nil>:
I0610 11:39:17.058332 54458 main.go:141] libmachine: (old-k8s-version-166693) KVM machine creation complete!
I0610 11:39:17.058681 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetConfigRaw
I0610 11:39:17.059260 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .DriverName
I0610 11:39:17.059447 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .DriverName
I0610 11:39:17.059648 54458 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0610 11:39:17.059662 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetState
I0610 11:39:17.061025 54458 main.go:141] libmachine: Detecting operating system of created instance...
I0610 11:39:17.061038 54458 main.go:141] libmachine: Waiting for SSH to be available...
I0610 11:39:17.061043 54458 main.go:141] libmachine: Getting to WaitForSSH function...
I0610 11:39:17.061061 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetSSHHostname
I0610 11:39:17.063658 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | domain old-k8s-version-166693 has defined MAC address 52:54:00:43:ea:f9 in network mk-old-k8s-version-166693
I0610 11:39:17.064069 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:43:ea:f9", ip: ""} in network mk-old-k8s-version-166693: {Iface:virbr3 ExpiryTime:2024-06-10 12:39:11 +0000 UTC Type:0 Mac:52:54:00:43:ea:f9 Iaid: IPaddr:192.168.72.34 Prefix:24 Hostname:old-k8s-version-166693 Clientid:01:52:54:00:43:ea:f9}
I0610 11:39:17.064090 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | domain old-k8s-version-166693 has defined IP address 192.168.72.34 and MAC address 52:54:00:43:ea:f9 in network mk-old-k8s-version-166693
I0610 11:39:17.064313 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetSSHPort
I0610 11:39:17.064489 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetSSHKeyPath
I0610 11:39:17.064677 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetSSHKeyPath
I0610 11:39:17.064846 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetSSHUsername
I0610 11:39:17.065056 54458 main.go:141] libmachine: Using SSH client type: native
I0610 11:39:17.065270 54458 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d880] 0x8305e0 <nil> [] 0s} 192.168.72.34 22 <nil> <nil>}
I0610 11:39:17.065282 54458 main.go:141] libmachine: About to run SSH command:
exit 0
I0610 11:39:17.176926 54458 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0610 11:39:17.176971 54458 main.go:141] libmachine: Detecting the provisioner...
I0610 11:39:17.176984 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetSSHHostname
I0610 11:39:17.180039 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | domain old-k8s-version-166693 has defined MAC address 52:54:00:43:ea:f9 in network mk-old-k8s-version-166693
I0610 11:39:17.180432 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:43:ea:f9", ip: ""} in network mk-old-k8s-version-166693: {Iface:virbr3 ExpiryTime:2024-06-10 12:39:11 +0000 UTC Type:0 Mac:52:54:00:43:ea:f9 Iaid: IPaddr:192.168.72.34 Prefix:24 Hostname:old-k8s-version-166693 Clientid:01:52:54:00:43:ea:f9}
I0610 11:39:17.180461 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | domain old-k8s-version-166693 has defined IP address 192.168.72.34 and MAC address 52:54:00:43:ea:f9 in network mk-old-k8s-version-166693
I0610 11:39:17.180688 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetSSHPort
I0610 11:39:17.180913 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetSSHKeyPath
I0610 11:39:17.181101 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetSSHKeyPath
I0610 11:39:17.181270 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetSSHUsername
I0610 11:39:17.181476 54458 main.go:141] libmachine: Using SSH client type: native
I0610 11:39:17.181634 54458 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d880] 0x8305e0 <nil> [] 0s} 192.168.72.34 22 <nil> <nil>}
I0610 11:39:17.181644 54458 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0610 11:39:17.289596 54458 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0610 11:39:17.289695 54458 main.go:141] libmachine: found compatible host: buildroot
I0610 11:39:17.289709 54458 main.go:141] libmachine: Provisioning with buildroot...
I0610 11:39:17.289721 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetMachineName
I0610 11:39:17.289987 54458 buildroot.go:166] provisioning hostname "old-k8s-version-166693"
I0610 11:39:17.290009 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetMachineName
I0610 11:39:17.290180 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetSSHHostname
I0610 11:39:17.292668 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | domain old-k8s-version-166693 has defined MAC address 52:54:00:43:ea:f9 in network mk-old-k8s-version-166693
I0610 11:39:17.293097 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:43:ea:f9", ip: ""} in network mk-old-k8s-version-166693: {Iface:virbr3 ExpiryTime:2024-06-10 12:39:11 +0000 UTC Type:0 Mac:52:54:00:43:ea:f9 Iaid: IPaddr:192.168.72.34 Prefix:24 Hostname:old-k8s-version-166693 Clientid:01:52:54:00:43:ea:f9}
I0610 11:39:17.293131 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | domain old-k8s-version-166693 has defined IP address 192.168.72.34 and MAC address 52:54:00:43:ea:f9 in network mk-old-k8s-version-166693
I0610 11:39:17.293294 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetSSHPort
I0610 11:39:17.293534 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetSSHKeyPath
I0610 11:39:17.293713 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetSSHKeyPath
I0610 11:39:17.293868 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetSSHUsername
I0610 11:39:17.294065 54458 main.go:141] libmachine: Using SSH client type: native
I0610 11:39:17.294248 54458 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d880] 0x8305e0 <nil> [] 0s} 192.168.72.34 22 <nil> <nil>}
I0610 11:39:17.294264 54458 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-166693 && echo "old-k8s-version-166693" | sudo tee /etc/hostname
I0610 11:39:17.418894 54458 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-166693
I0610 11:39:17.418929 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetSSHHostname
I0610 11:39:17.421980 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | domain old-k8s-version-166693 has defined MAC address 52:54:00:43:ea:f9 in network mk-old-k8s-version-166693
I0610 11:39:17.422359 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:43:ea:f9", ip: ""} in network mk-old-k8s-version-166693: {Iface:virbr3 ExpiryTime:2024-06-10 12:39:11 +0000 UTC Type:0 Mac:52:54:00:43:ea:f9 Iaid: IPaddr:192.168.72.34 Prefix:24 Hostname:old-k8s-version-166693 Clientid:01:52:54:00:43:ea:f9}
I0610 11:39:17.422385 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | domain old-k8s-version-166693 has defined IP address 192.168.72.34 and MAC address 52:54:00:43:ea:f9 in network mk-old-k8s-version-166693
I0610 11:39:17.422585 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetSSHPort
I0610 11:39:17.422772 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetSSHKeyPath
I0610 11:39:17.422907 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetSSHKeyPath
I0610 11:39:17.423055 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetSSHUsername
I0610 11:39:17.423223 54458 main.go:141] libmachine: Using SSH client type: native
I0610 11:39:17.423433 54458 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d880] 0x8305e0 <nil> [] 0s} 192.168.72.34 22 <nil> <nil>}
I0610 11:39:17.423463 54458 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-166693' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-166693/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-166693' | sudo tee -a /etc/hosts;
fi
fi
I0610 11:39:17.537271 54458 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0610 11:39:17.537308 54458 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19046-3880/.minikube CaCertPath:/home/jenkins/minikube-integration/19046-3880/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19046-3880/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19046-3880/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19046-3880/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19046-3880/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19046-3880/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19046-3880/.minikube}
I0610 11:39:17.537338 54458 buildroot.go:174] setting up certificates
I0610 11:39:17.537350 54458 provision.go:84] configureAuth start
I0610 11:39:17.537363 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetMachineName
I0610 11:39:17.537665 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetIP
I0610 11:39:17.540744 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | domain old-k8s-version-166693 has defined MAC address 52:54:00:43:ea:f9 in network mk-old-k8s-version-166693
I0610 11:39:17.541140 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:43:ea:f9", ip: ""} in network mk-old-k8s-version-166693: {Iface:virbr3 ExpiryTime:2024-06-10 12:39:11 +0000 UTC Type:0 Mac:52:54:00:43:ea:f9 Iaid: IPaddr:192.168.72.34 Prefix:24 Hostname:old-k8s-version-166693 Clientid:01:52:54:00:43:ea:f9}
I0610 11:39:17.541169 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | domain old-k8s-version-166693 has defined IP address 192.168.72.34 and MAC address 52:54:00:43:ea:f9 in network mk-old-k8s-version-166693
I0610 11:39:17.541320 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetSSHHostname
I0610 11:39:17.543790 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | domain old-k8s-version-166693 has defined MAC address 52:54:00:43:ea:f9 in network mk-old-k8s-version-166693
I0610 11:39:17.544212 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:43:ea:f9", ip: ""} in network mk-old-k8s-version-166693: {Iface:virbr3 ExpiryTime:2024-06-10 12:39:11 +0000 UTC Type:0 Mac:52:54:00:43:ea:f9 Iaid: IPaddr:192.168.72.34 Prefix:24 Hostname:old-k8s-version-166693 Clientid:01:52:54:00:43:ea:f9}
I0610 11:39:17.544238 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | domain old-k8s-version-166693 has defined IP address 192.168.72.34 and MAC address 52:54:00:43:ea:f9 in network mk-old-k8s-version-166693
I0610 11:39:17.544402 54458 provision.go:143] copyHostCerts
I0610 11:39:17.544495 54458 exec_runner.go:144] found /home/jenkins/minikube-integration/19046-3880/.minikube/ca.pem, removing ...
I0610 11:39:17.544507 54458 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19046-3880/.minikube/ca.pem
I0610 11:39:17.544575 54458 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19046-3880/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19046-3880/.minikube/ca.pem (1082 bytes)
I0610 11:39:17.544805 54458 exec_runner.go:144] found /home/jenkins/minikube-integration/19046-3880/.minikube/cert.pem, removing ...
I0610 11:39:17.544822 54458 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19046-3880/.minikube/cert.pem
I0610 11:39:17.544870 54458 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19046-3880/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19046-3880/.minikube/cert.pem (1123 bytes)
I0610 11:39:17.545005 54458 exec_runner.go:144] found /home/jenkins/minikube-integration/19046-3880/.minikube/key.pem, removing ...
I0610 11:39:17.545023 54458 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19046-3880/.minikube/key.pem
I0610 11:39:17.545055 54458 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19046-3880/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19046-3880/.minikube/key.pem (1675 bytes)
I0610 11:39:17.545129 54458 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19046-3880/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19046-3880/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19046-3880/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-166693 san=[127.0.0.1 192.168.72.34 localhost minikube old-k8s-version-166693]
I0610 11:39:17.711292 54458 provision.go:177] copyRemoteCerts
I0610 11:39:17.711348 54458 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0610 11:39:17.711371 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetSSHHostname
I0610 11:39:17.713997 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | domain old-k8s-version-166693 has defined MAC address 52:54:00:43:ea:f9 in network mk-old-k8s-version-166693
I0610 11:39:17.714348 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:43:ea:f9", ip: ""} in network mk-old-k8s-version-166693: {Iface:virbr3 ExpiryTime:2024-06-10 12:39:11 +0000 UTC Type:0 Mac:52:54:00:43:ea:f9 Iaid: IPaddr:192.168.72.34 Prefix:24 Hostname:old-k8s-version-166693 Clientid:01:52:54:00:43:ea:f9}
I0610 11:39:17.714396 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | domain old-k8s-version-166693 has defined IP address 192.168.72.34 and MAC address 52:54:00:43:ea:f9 in network mk-old-k8s-version-166693
I0610 11:39:17.714599 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetSSHPort
I0610 11:39:17.714785 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetSSHKeyPath
I0610 11:39:17.715002 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetSSHUsername
I0610 11:39:17.715175 54458 sshutil.go:53] new ssh client: &{IP:192.168.72.34 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19046-3880/.minikube/machines/old-k8s-version-166693/id_rsa Username:docker}
I0610 11:39:17.800523 54458 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19046-3880/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0610 11:39:17.825460 54458 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19046-3880/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0610 11:39:17.850466 54458 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19046-3880/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0610 11:39:17.875461 54458 provision.go:87] duration metric: took 338.100212ms to configureAuth
I0610 11:39:17.875489 54458 buildroot.go:189] setting minikube options for container-runtime
I0610 11:39:17.875641 54458 config.go:182] Loaded profile config "old-k8s-version-166693": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0610 11:39:17.875709 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetSSHHostname
I0610 11:39:17.878576 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | domain old-k8s-version-166693 has defined MAC address 52:54:00:43:ea:f9 in network mk-old-k8s-version-166693
I0610 11:39:17.879097 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:43:ea:f9", ip: ""} in network mk-old-k8s-version-166693: {Iface:virbr3 ExpiryTime:2024-06-10 12:39:11 +0000 UTC Type:0 Mac:52:54:00:43:ea:f9 Iaid: IPaddr:192.168.72.34 Prefix:24 Hostname:old-k8s-version-166693 Clientid:01:52:54:00:43:ea:f9}
I0610 11:39:17.879129 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | domain old-k8s-version-166693 has defined IP address 192.168.72.34 and MAC address 52:54:00:43:ea:f9 in network mk-old-k8s-version-166693
I0610 11:39:17.879279 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetSSHPort
I0610 11:39:17.879554 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetSSHKeyPath
I0610 11:39:17.879768 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetSSHKeyPath
I0610 11:39:17.879946 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetSSHUsername
I0610 11:39:17.880177 54458 main.go:141] libmachine: Using SSH client type: native
I0610 11:39:17.880328 54458 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d880] 0x8305e0 <nil> [] 0s} 192.168.72.34 22 <nil> <nil>}
I0610 11:39:17.880344 54458 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0610 11:39:18.134844 54458 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0610 11:39:18.134879 54458 main.go:141] libmachine: Checking connection to Docker...
I0610 11:39:18.134892 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetURL
I0610 11:39:18.135986 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | Using libvirt version 6000000
I0610 11:39:18.138297 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | domain old-k8s-version-166693 has defined MAC address 52:54:00:43:ea:f9 in network mk-old-k8s-version-166693
I0610 11:39:18.138674 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:43:ea:f9", ip: ""} in network mk-old-k8s-version-166693: {Iface:virbr3 ExpiryTime:2024-06-10 12:39:11 +0000 UTC Type:0 Mac:52:54:00:43:ea:f9 Iaid: IPaddr:192.168.72.34 Prefix:24 Hostname:old-k8s-version-166693 Clientid:01:52:54:00:43:ea:f9}
I0610 11:39:18.138703 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | domain old-k8s-version-166693 has defined IP address 192.168.72.34 and MAC address 52:54:00:43:ea:f9 in network mk-old-k8s-version-166693
I0610 11:39:18.138885 54458 main.go:141] libmachine: Docker is up and running!
I0610 11:39:18.138900 54458 main.go:141] libmachine: Reticulating splines...
I0610 11:39:18.138908 54458 client.go:171] duration metric: took 21.008447556s to LocalClient.Create
I0610 11:39:18.138934 54458 start.go:167] duration metric: took 21.00850591s to libmachine.API.Create "old-k8s-version-166693"
I0610 11:39:18.138946 54458 start.go:293] postStartSetup for "old-k8s-version-166693" (driver="kvm2")
I0610 11:39:18.138961 54458 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0610 11:39:18.138986 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .DriverName
I0610 11:39:18.139341 54458 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0610 11:39:18.139367 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetSSHHostname
I0610 11:39:18.141733 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | domain old-k8s-version-166693 has defined MAC address 52:54:00:43:ea:f9 in network mk-old-k8s-version-166693
I0610 11:39:18.142111 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:43:ea:f9", ip: ""} in network mk-old-k8s-version-166693: {Iface:virbr3 ExpiryTime:2024-06-10 12:39:11 +0000 UTC Type:0 Mac:52:54:00:43:ea:f9 Iaid: IPaddr:192.168.72.34 Prefix:24 Hostname:old-k8s-version-166693 Clientid:01:52:54:00:43:ea:f9}
I0610 11:39:18.142142 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | domain old-k8s-version-166693 has defined IP address 192.168.72.34 and MAC address 52:54:00:43:ea:f9 in network mk-old-k8s-version-166693
I0610 11:39:18.142268 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetSSHPort
I0610 11:39:18.142430 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetSSHKeyPath
I0610 11:39:18.142578 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetSSHUsername
I0610 11:39:18.142700 54458 sshutil.go:53] new ssh client: &{IP:192.168.72.34 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19046-3880/.minikube/machines/old-k8s-version-166693/id_rsa Username:docker}
I0610 11:39:18.223550 54458 ssh_runner.go:195] Run: cat /etc/os-release
I0610 11:39:18.227856 54458 info.go:137] Remote host: Buildroot 2023.02.9
I0610 11:39:18.227884 54458 filesync.go:126] Scanning /home/jenkins/minikube-integration/19046-3880/.minikube/addons for local assets ...
I0610 11:39:18.227975 54458 filesync.go:126] Scanning /home/jenkins/minikube-integration/19046-3880/.minikube/files for local assets ...
I0610 11:39:18.228069 54458 filesync.go:149] local asset: /home/jenkins/minikube-integration/19046-3880/.minikube/files/etc/ssl/certs/107582.pem -> 107582.pem in /etc/ssl/certs
I0610 11:39:18.228181 54458 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0610 11:39:18.241150 54458 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19046-3880/.minikube/files/etc/ssl/certs/107582.pem --> /etc/ssl/certs/107582.pem (1708 bytes)
I0610 11:39:18.267239 54458 start.go:296] duration metric: took 128.276706ms for postStartSetup
I0610 11:39:18.267297 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetConfigRaw
I0610 11:39:18.268118 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetIP
I0610 11:39:18.270815 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | domain old-k8s-version-166693 has defined MAC address 52:54:00:43:ea:f9 in network mk-old-k8s-version-166693
I0610 11:39:18.271204 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:43:ea:f9", ip: ""} in network mk-old-k8s-version-166693: {Iface:virbr3 ExpiryTime:2024-06-10 12:39:11 +0000 UTC Type:0 Mac:52:54:00:43:ea:f9 Iaid: IPaddr:192.168.72.34 Prefix:24 Hostname:old-k8s-version-166693 Clientid:01:52:54:00:43:ea:f9}
I0610 11:39:18.271242 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | domain old-k8s-version-166693 has defined IP address 192.168.72.34 and MAC address 52:54:00:43:ea:f9 in network mk-old-k8s-version-166693
I0610 11:39:18.271489 54458 profile.go:143] Saving config to /home/jenkins/minikube-integration/19046-3880/.minikube/profiles/old-k8s-version-166693/config.json ...
I0610 11:39:18.271675 54458 start.go:128] duration metric: took 21.159777341s to createHost
I0610 11:39:18.271702 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetSSHHostname
I0610 11:39:18.274078 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | domain old-k8s-version-166693 has defined MAC address 52:54:00:43:ea:f9 in network mk-old-k8s-version-166693
I0610 11:39:18.274519 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:43:ea:f9", ip: ""} in network mk-old-k8s-version-166693: {Iface:virbr3 ExpiryTime:2024-06-10 12:39:11 +0000 UTC Type:0 Mac:52:54:00:43:ea:f9 Iaid: IPaddr:192.168.72.34 Prefix:24 Hostname:old-k8s-version-166693 Clientid:01:52:54:00:43:ea:f9}
I0610 11:39:18.274555 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | domain old-k8s-version-166693 has defined IP address 192.168.72.34 and MAC address 52:54:00:43:ea:f9 in network mk-old-k8s-version-166693
I0610 11:39:18.274691 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetSSHPort
I0610 11:39:18.274881 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetSSHKeyPath
I0610 11:39:18.275034 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetSSHKeyPath
I0610 11:39:18.275181 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetSSHUsername
I0610 11:39:18.275358 54458 main.go:141] libmachine: Using SSH client type: native
I0610 11:39:18.275506 54458 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d880] 0x8305e0 <nil> [] 0s} 192.168.72.34 22 <nil> <nil>}
I0610 11:39:18.275521 54458 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0610 11:39:18.385394 54458 main.go:141] libmachine: SSH cmd err, output: <nil>: 1718019558.356464123
I0610 11:39:18.385424 54458 fix.go:216] guest clock: 1718019558.356464123
I0610 11:39:18.385433 54458 fix.go:229] Guest: 2024-06-10 11:39:18.356464123 +0000 UTC Remote: 2024-06-10 11:39:18.271687647 +0000 UTC m=+21.299597860 (delta=84.776476ms)
I0610 11:39:18.385458 54458 fix.go:200] guest clock delta is within tolerance: 84.776476ms
I0610 11:39:18.385465 54458 start.go:83] releasing machines lock for "old-k8s-version-166693", held for 21.273663894s
I0610 11:39:18.385496 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .DriverName
I0610 11:39:18.385790 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetIP
I0610 11:39:18.388852 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | domain old-k8s-version-166693 has defined MAC address 52:54:00:43:ea:f9 in network mk-old-k8s-version-166693
I0610 11:39:18.389278 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:43:ea:f9", ip: ""} in network mk-old-k8s-version-166693: {Iface:virbr3 ExpiryTime:2024-06-10 12:39:11 +0000 UTC Type:0 Mac:52:54:00:43:ea:f9 Iaid: IPaddr:192.168.72.34 Prefix:24 Hostname:old-k8s-version-166693 Clientid:01:52:54:00:43:ea:f9}
I0610 11:39:18.389309 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | domain old-k8s-version-166693 has defined IP address 192.168.72.34 and MAC address 52:54:00:43:ea:f9 in network mk-old-k8s-version-166693
I0610 11:39:18.389510 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .DriverName
I0610 11:39:18.390099 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .DriverName
I0610 11:39:18.390318 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .DriverName
I0610 11:39:18.390407 54458 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0610 11:39:18.390451 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetSSHHostname
I0610 11:39:18.390554 54458 ssh_runner.go:195] Run: cat /version.json
I0610 11:39:18.390581 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetSSHHostname
I0610 11:39:18.393294 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | domain old-k8s-version-166693 has defined MAC address 52:54:00:43:ea:f9 in network mk-old-k8s-version-166693
I0610 11:39:18.393437 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | domain old-k8s-version-166693 has defined MAC address 52:54:00:43:ea:f9 in network mk-old-k8s-version-166693
I0610 11:39:18.393738 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:43:ea:f9", ip: ""} in network mk-old-k8s-version-166693: {Iface:virbr3 ExpiryTime:2024-06-10 12:39:11 +0000 UTC Type:0 Mac:52:54:00:43:ea:f9 Iaid: IPaddr:192.168.72.34 Prefix:24 Hostname:old-k8s-version-166693 Clientid:01:52:54:00:43:ea:f9}
I0610 11:39:18.393770 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | domain old-k8s-version-166693 has defined IP address 192.168.72.34 and MAC address 52:54:00:43:ea:f9 in network mk-old-k8s-version-166693
I0610 11:39:18.393800 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:43:ea:f9", ip: ""} in network mk-old-k8s-version-166693: {Iface:virbr3 ExpiryTime:2024-06-10 12:39:11 +0000 UTC Type:0 Mac:52:54:00:43:ea:f9 Iaid: IPaddr:192.168.72.34 Prefix:24 Hostname:old-k8s-version-166693 Clientid:01:52:54:00:43:ea:f9}
I0610 11:39:18.393841 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | domain old-k8s-version-166693 has defined IP address 192.168.72.34 and MAC address 52:54:00:43:ea:f9 in network mk-old-k8s-version-166693
I0610 11:39:18.393907 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetSSHPort
I0610 11:39:18.394093 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetSSHPort
I0610 11:39:18.394100 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetSSHKeyPath
I0610 11:39:18.394276 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetSSHUsername
I0610 11:39:18.394277 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetSSHKeyPath
I0610 11:39:18.394462 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetSSHUsername
I0610 11:39:18.394460 54458 sshutil.go:53] new ssh client: &{IP:192.168.72.34 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19046-3880/.minikube/machines/old-k8s-version-166693/id_rsa Username:docker}
I0610 11:39:18.394576 54458 sshutil.go:53] new ssh client: &{IP:192.168.72.34 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19046-3880/.minikube/machines/old-k8s-version-166693/id_rsa Username:docker}
I0610 11:39:18.479471 54458 ssh_runner.go:195] Run: systemctl --version
I0610 11:39:18.508981 54458 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0610 11:39:18.679789 54458 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0610 11:39:18.688542 54458 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0610 11:39:18.688626 54458 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0610 11:39:18.716555 54458 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0610 11:39:18.716581 54458 start.go:494] detecting cgroup driver to use...
I0610 11:39:18.716650 54458 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0610 11:39:18.738358 54458 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0610 11:39:18.756346 54458 docker.go:217] disabling cri-docker service (if available) ...
I0610 11:39:18.756414 54458 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0610 11:39:18.776621 54458 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0610 11:39:18.796257 54458 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0610 11:39:18.939255 54458 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0610 11:39:19.125347 54458 docker.go:233] disabling docker service ...
I0610 11:39:19.125429 54458 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0610 11:39:19.140241 54458 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0610 11:39:19.154346 54458 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0610 11:39:19.279829 54458 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0610 11:39:19.422215 54458 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0610 11:39:19.440674 54458 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0610 11:39:19.462390 54458 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0610 11:39:19.462459 54458 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0610 11:39:19.474354 54458 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0610 11:39:19.474420 54458 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0610 11:39:19.488132 54458 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0610 11:39:19.501552 54458 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0610 11:39:19.512256 54458 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0610 11:39:19.522850 54458 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0610 11:39:19.532682 54458 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0610 11:39:19.532754 54458 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0610 11:39:19.546416 54458 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0610 11:39:19.557858 54458 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0610 11:39:19.724671 54458 ssh_runner.go:195] Run: sudo systemctl restart crio
I0610 11:39:19.880919 54458 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0610 11:39:19.881016 54458 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0610 11:39:19.886726 54458 start.go:562] Will wait 60s for crictl version
I0610 11:39:19.886791 54458 ssh_runner.go:195] Run: which crictl
I0610 11:39:19.890667 54458 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0610 11:39:19.932714 54458 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0610 11:39:19.932783 54458 ssh_runner.go:195] Run: crio --version
I0610 11:39:19.961041 54458 ssh_runner.go:195] Run: crio --version
I0610 11:39:19.995228 54458 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0610 11:39:19.996361 54458 main.go:141] libmachine: (old-k8s-version-166693) Calling .GetIP
I0610 11:39:19.999923 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | domain old-k8s-version-166693 has defined MAC address 52:54:00:43:ea:f9 in network mk-old-k8s-version-166693
I0610 11:39:20.000556 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:43:ea:f9", ip: ""} in network mk-old-k8s-version-166693: {Iface:virbr3 ExpiryTime:2024-06-10 12:39:11 +0000 UTC Type:0 Mac:52:54:00:43:ea:f9 Iaid: IPaddr:192.168.72.34 Prefix:24 Hostname:old-k8s-version-166693 Clientid:01:52:54:00:43:ea:f9}
I0610 11:39:20.000590 54458 main.go:141] libmachine: (old-k8s-version-166693) DBG | domain old-k8s-version-166693 has defined IP address 192.168.72.34 and MAC address 52:54:00:43:ea:f9 in network mk-old-k8s-version-166693
I0610 11:39:20.000766 54458 ssh_runner.go:195] Run: grep 192.168.72.1 host.minikube.internal$ /etc/hosts
I0610 11:39:20.005775 54458 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.72.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0610 11:39:20.019968 54458 kubeadm.go:877] updating cluster {Name:old-k8s-version-166693 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19038/minikube-v1.33.1-1717668912-19038-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1717668449-19038@sha256:30d191eb345232f513c52f7ac036e7a34a8cc441d88353f92985384bcddf00d6 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-166693 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.34 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mo
untPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0610 11:39:20.020123 54458 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0610 11:39:20.020188 54458 ssh_runner.go:195] Run: sudo crictl images --output json
I0610 11:39:20.056225 54458 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0610 11:39:20.056306 54458 ssh_runner.go:195] Run: which lz4
I0610 11:39:20.061783 54458 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0610 11:39:20.067272 54458 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0610 11:39:20.067304 54458 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19046-3880/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0610 11:39:21.655441 54458 crio.go:462] duration metric: took 1.593699163s to copy over tarball
I0610 11:39:21.655518 54458 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0610 11:39:24.372117 54458 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.716570519s)
I0610 11:39:24.372141 54458 crio.go:469] duration metric: took 2.716667877s to extract the tarball
I0610 11:39:24.372150 54458 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0610 11:39:24.420800 54458 ssh_runner.go:195] Run: sudo crictl images --output json
I0610 11:39:24.474578 54458 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0610 11:39:24.474600 54458 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0610 11:39:24.474652 54458 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0610 11:39:24.474675 54458 image.go:134] retrieving image: registry.k8s.io/pause:3.2
I0610 11:39:24.474696 54458 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0610 11:39:24.474657 54458 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0610 11:39:24.474696 54458 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0610 11:39:24.474703 54458 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0610 11:39:24.474721 54458 image.go:134] retrieving image: registry.k8s.io/coredns:1.7.0
I0610 11:39:24.474723 54458 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0610 11:39:24.476201 54458 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0610 11:39:24.476214 54458 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0610 11:39:24.476237 54458 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0610 11:39:24.476253 54458 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0610 11:39:24.476273 54458 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0610 11:39:24.476256 54458 image.go:177] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0610 11:39:24.476517 54458 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0610 11:39:24.476937 54458 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0610 11:39:24.679029 54458 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0610 11:39:24.703751 54458 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0610 11:39:24.716518 54458 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0610 11:39:24.731996 54458 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0610 11:39:24.732040 54458 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0610 11:39:24.732100 54458 ssh_runner.go:195] Run: which crictl
I0610 11:39:24.734762 54458 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0610 11:39:24.734768 54458 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0610 11:39:24.740586 54458 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0610 11:39:24.747177 54458 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0610 11:39:24.826962 54458 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0610 11:39:24.827067 54458 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0610 11:39:24.827177 54458 ssh_runner.go:195] Run: which crictl
I0610 11:39:24.827327 54458 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0610 11:39:24.827522 54458 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0610 11:39:24.827551 54458 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0610 11:39:24.827602 54458 ssh_runner.go:195] Run: which crictl
I0610 11:39:24.945855 54458 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0610 11:39:24.945890 54458 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0610 11:39:24.945900 54458 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0610 11:39:24.945924 54458 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0610 11:39:24.945974 54458 ssh_runner.go:195] Run: which crictl
I0610 11:39:24.945991 54458 ssh_runner.go:195] Run: which crictl
I0610 11:39:24.946037 54458 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0610 11:39:24.946049 54458 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0610 11:39:24.946084 54458 ssh_runner.go:195] Run: which crictl
I0610 11:39:24.949105 54458 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0610 11:39:24.949137 54458 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/19046-3880/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0610 11:39:24.949196 54458 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0610 11:39:24.949234 54458 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0610 11:39:24.949261 54458 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0610 11:39:24.949294 54458 ssh_runner.go:195] Run: which crictl
I0610 11:39:24.954534 54458 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0610 11:39:24.954776 54458 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0610 11:39:24.959875 54458 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0610 11:39:25.077921 54458 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/19046-3880/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0610 11:39:25.078119 54458 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/19046-3880/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0610 11:39:25.078177 54458 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0610 11:39:25.108019 54458 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/19046-3880/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0610 11:39:25.119762 54458 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/19046-3880/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0610 11:39:25.119867 54458 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/19046-3880/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0610 11:39:25.137332 54458 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/19046-3880/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0610 11:39:25.282378 54458 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0610 11:39:25.422491 54458 cache_images.go:92] duration metric: took 947.868008ms to LoadCachedImages
W0610 11:39:25.422598 54458 out.go:239] X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/19046-3880/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0: no such file or directory
X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/19046-3880/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0: no such file or directory
I0610 11:39:25.422614 54458 kubeadm.go:928] updating node { 192.168.72.34 8443 v1.20.0 crio true true} ...
I0610 11:39:25.422741 54458 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-166693 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.72.34
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-166693 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0610 11:39:25.422827 54458 ssh_runner.go:195] Run: crio config
I0610 11:39:25.479534 54458 cni.go:84] Creating CNI manager for ""
I0610 11:39:25.479553 54458 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0610 11:39:25.479561 54458 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0610 11:39:25.479579 54458 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.72.34 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-166693 NodeName:old-k8s-version-166693 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.72.34"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.72.34 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Stati
cPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0610 11:39:25.479684 54458 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.72.34
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-166693"
kubeletExtraArgs:
node-ip: 192.168.72.34
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.72.34"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0610 11:39:25.479739 54458 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0610 11:39:25.489354 54458 binaries.go:44] Found k8s binaries, skipping transfer
I0610 11:39:25.489422 54458 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0610 11:39:25.498346 54458 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (429 bytes)
I0610 11:39:25.514614 54458 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0610 11:39:25.531276 54458 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2120 bytes)
I0610 11:39:25.547540 54458 ssh_runner.go:195] Run: grep 192.168.72.34 control-plane.minikube.internal$ /etc/hosts
I0610 11:39:25.551381 54458 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.72.34 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0610 11:39:25.563609 54458 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0610 11:39:25.680489 54458 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0610 11:39:25.697196 54458 certs.go:68] Setting up /home/jenkins/minikube-integration/19046-3880/.minikube/profiles/old-k8s-version-166693 for IP: 192.168.72.34
I0610 11:39:25.697220 54458 certs.go:194] generating shared ca certs ...
I0610 11:39:25.697241 54458 certs.go:226] acquiring lock for ca certs: {Name:mke8b68fecbd8b649419d142cdde25446085a9ae Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0610 11:39:25.697421 54458 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19046-3880/.minikube/ca.key
I0610 11:39:25.697478 54458 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19046-3880/.minikube/proxy-client-ca.key
I0610 11:39:25.697492 54458 certs.go:256] generating profile certs ...
I0610 11:39:25.697557 54458 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19046-3880/.minikube/profiles/old-k8s-version-166693/client.key
I0610 11:39:25.697577 54458 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19046-3880/.minikube/profiles/old-k8s-version-166693/client.crt with IP's: []
I0610 11:39:25.796706 54458 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19046-3880/.minikube/profiles/old-k8s-version-166693/client.crt ...
I0610 11:39:25.796740 54458 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19046-3880/.minikube/profiles/old-k8s-version-166693/client.crt: {Name:mk9f49c283570761dc0ac45c040716b87387ff64 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0610 11:39:25.796973 54458 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19046-3880/.minikube/profiles/old-k8s-version-166693/client.key ...
I0610 11:39:25.796995 54458 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19046-3880/.minikube/profiles/old-k8s-version-166693/client.key: {Name:mk196ce44b078353267aa91f95d26828f0700052 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0610 11:39:25.797124 54458 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19046-3880/.minikube/profiles/old-k8s-version-166693/apiserver.key.1a4331fb
I0610 11:39:25.797145 54458 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19046-3880/.minikube/profiles/old-k8s-version-166693/apiserver.crt.1a4331fb with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.72.34]
I0610 11:39:25.943212 54458 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19046-3880/.minikube/profiles/old-k8s-version-166693/apiserver.crt.1a4331fb ...
I0610 11:39:25.943244 54458 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19046-3880/.minikube/profiles/old-k8s-version-166693/apiserver.crt.1a4331fb: {Name:mkbf093ffb79ac01bda18aa3c62c667bd8b9a373 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0610 11:39:25.943423 54458 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19046-3880/.minikube/profiles/old-k8s-version-166693/apiserver.key.1a4331fb ...
I0610 11:39:25.943440 54458 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19046-3880/.minikube/profiles/old-k8s-version-166693/apiserver.key.1a4331fb: {Name:mk33db107fe1f46ff58e0537986121d3f4d9588f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0610 11:39:25.943547 54458 certs.go:381] copying /home/jenkins/minikube-integration/19046-3880/.minikube/profiles/old-k8s-version-166693/apiserver.crt.1a4331fb -> /home/jenkins/minikube-integration/19046-3880/.minikube/profiles/old-k8s-version-166693/apiserver.crt
I0610 11:39:25.943638 54458 certs.go:385] copying /home/jenkins/minikube-integration/19046-3880/.minikube/profiles/old-k8s-version-166693/apiserver.key.1a4331fb -> /home/jenkins/minikube-integration/19046-3880/.minikube/profiles/old-k8s-version-166693/apiserver.key
I0610 11:39:25.943717 54458 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19046-3880/.minikube/profiles/old-k8s-version-166693/proxy-client.key
I0610 11:39:25.943740 54458 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19046-3880/.minikube/profiles/old-k8s-version-166693/proxy-client.crt with IP's: []
I0610 11:39:26.117325 54458 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19046-3880/.minikube/profiles/old-k8s-version-166693/proxy-client.crt ...
I0610 11:39:26.117360 54458 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19046-3880/.minikube/profiles/old-k8s-version-166693/proxy-client.crt: {Name:mk0a9c0731b39960ae000ed266bdecb2cdc31891 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0610 11:39:26.117532 54458 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19046-3880/.minikube/profiles/old-k8s-version-166693/proxy-client.key ...
I0610 11:39:26.117549 54458 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19046-3880/.minikube/profiles/old-k8s-version-166693/proxy-client.key: {Name:mk7c2a4f28435ac6a6746e66232db80b4ea3037f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0610 11:39:26.117785 54458 certs.go:484] found cert: /home/jenkins/minikube-integration/19046-3880/.minikube/certs/10758.pem (1338 bytes)
W0610 11:39:26.117835 54458 certs.go:480] ignoring /home/jenkins/minikube-integration/19046-3880/.minikube/certs/10758_empty.pem, impossibly tiny 0 bytes
I0610 11:39:26.117846 54458 certs.go:484] found cert: /home/jenkins/minikube-integration/19046-3880/.minikube/certs/ca-key.pem (1679 bytes)
I0610 11:39:26.117878 54458 certs.go:484] found cert: /home/jenkins/minikube-integration/19046-3880/.minikube/certs/ca.pem (1082 bytes)
I0610 11:39:26.117942 54458 certs.go:484] found cert: /home/jenkins/minikube-integration/19046-3880/.minikube/certs/cert.pem (1123 bytes)
I0610 11:39:26.117976 54458 certs.go:484] found cert: /home/jenkins/minikube-integration/19046-3880/.minikube/certs/key.pem (1675 bytes)
I0610 11:39:26.118030 54458 certs.go:484] found cert: /home/jenkins/minikube-integration/19046-3880/.minikube/files/etc/ssl/certs/107582.pem (1708 bytes)
I0610 11:39:26.118628 54458 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19046-3880/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0610 11:39:26.143703 54458 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19046-3880/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0610 11:39:26.166305 54458 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19046-3880/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0610 11:39:26.189834 54458 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19046-3880/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0610 11:39:26.216798 54458 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19046-3880/.minikube/profiles/old-k8s-version-166693/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0610 11:39:26.245996 54458 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19046-3880/.minikube/profiles/old-k8s-version-166693/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0610 11:39:26.269970 54458 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19046-3880/.minikube/profiles/old-k8s-version-166693/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0610 11:39:26.296058 54458 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19046-3880/.minikube/profiles/old-k8s-version-166693/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0610 11:39:26.321663 54458 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19046-3880/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0610 11:39:26.347626 54458 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19046-3880/.minikube/certs/10758.pem --> /usr/share/ca-certificates/10758.pem (1338 bytes)
I0610 11:39:26.370998 54458 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19046-3880/.minikube/files/etc/ssl/certs/107582.pem --> /usr/share/ca-certificates/107582.pem (1708 bytes)
I0610 11:39:26.393984 54458 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0610 11:39:26.410034 54458 ssh_runner.go:195] Run: openssl version
I0610 11:39:26.416080 54458 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/10758.pem && ln -fs /usr/share/ca-certificates/10758.pem /etc/ssl/certs/10758.pem"
I0610 11:39:26.426884 54458 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/10758.pem
I0610 11:39:26.431574 54458 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jun 10 10:34 /usr/share/ca-certificates/10758.pem
I0610 11:39:26.431631 54458 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/10758.pem
I0610 11:39:26.437520 54458 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/10758.pem /etc/ssl/certs/51391683.0"
I0610 11:39:26.447672 54458 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/107582.pem && ln -fs /usr/share/ca-certificates/107582.pem /etc/ssl/certs/107582.pem"
I0610 11:39:26.457909 54458 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/107582.pem
I0610 11:39:26.462132 54458 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jun 10 10:34 /usr/share/ca-certificates/107582.pem
I0610 11:39:26.462182 54458 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/107582.pem
I0610 11:39:26.467589 54458 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/107582.pem /etc/ssl/certs/3ec20f2e.0"
I0610 11:39:26.478036 54458 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0610 11:39:26.488354 54458 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0610 11:39:26.492684 54458 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jun 10 10:22 /usr/share/ca-certificates/minikubeCA.pem
I0610 11:39:26.492748 54458 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0610 11:39:26.498436 54458 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0610 11:39:26.511686 54458 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0610 11:39:26.516263 54458 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0610 11:39:26.516323 54458 kubeadm.go:391] StartCluster: {Name:old-k8s-version-166693 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19038/minikube-v1.33.1-1717668912-19038-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1717668449-19038@sha256:30d191eb345232f513c52f7ac036e7a34a8cc441d88353f92985384bcddf00d6 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-166693 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.34 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0610 11:39:26.516417 54458 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0610 11:39:26.516470 54458 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0610 11:39:26.572349 54458 cri.go:89] found id: ""
I0610 11:39:26.572422 54458 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0610 11:39:26.591993 54458 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0610 11:39:26.609282 54458 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0610 11:39:26.619362 54458 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0610 11:39:26.619386 54458 kubeadm.go:156] found existing configuration files:
I0610 11:39:26.619434 54458 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0610 11:39:26.628268 54458 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0610 11:39:26.628336 54458 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0610 11:39:26.637543 54458 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0610 11:39:26.646660 54458 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0610 11:39:26.646723 54458 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0610 11:39:26.655929 54458 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0610 11:39:26.665778 54458 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0610 11:39:26.665849 54458 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0610 11:39:26.678576 54458 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0610 11:39:26.690523 54458 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0610 11:39:26.690579 54458 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0610 11:39:26.700471 54458 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0610 11:39:26.964185 54458 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0610 11:41:24.625234 54458 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0610 11:41:24.625355 54458 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
I0610 11:41:24.626776 54458 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0610 11:41:24.626834 54458 kubeadm.go:309] [preflight] Running pre-flight checks
I0610 11:41:24.626926 54458 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0610 11:41:24.627063 54458 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0610 11:41:24.627192 54458 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0610 11:41:24.627302 54458 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0610 11:41:24.628967 54458 out.go:204] - Generating certificates and keys ...
I0610 11:41:24.629065 54458 kubeadm.go:309] [certs] Using existing ca certificate authority
I0610 11:41:24.629152 54458 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0610 11:41:24.629252 54458 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key
I0610 11:41:24.629352 54458 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key
I0610 11:41:24.629436 54458 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key
I0610 11:41:24.629518 54458 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key
I0610 11:41:24.629594 54458 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key
I0610 11:41:24.629748 54458 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-166693] and IPs [192.168.72.34 127.0.0.1 ::1]
I0610 11:41:24.629833 54458 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key
I0610 11:41:24.629990 54458 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-166693] and IPs [192.168.72.34 127.0.0.1 ::1]
I0610 11:41:24.630066 54458 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key
I0610 11:41:24.630115 54458 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key
I0610 11:41:24.630156 54458 kubeadm.go:309] [certs] Generating "sa" key and public key
I0610 11:41:24.630214 54458 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0610 11:41:24.630300 54458 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0610 11:41:24.630369 54458 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0610 11:41:24.630456 54458 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0610 11:41:24.630543 54458 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0610 11:41:24.630669 54458 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0610 11:41:24.630785 54458 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0610 11:41:24.630841 54458 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0610 11:41:24.630928 54458 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0610 11:41:24.632284 54458 out.go:204] - Booting up control plane ...
I0610 11:41:24.632394 54458 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0610 11:41:24.632498 54458 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0610 11:41:24.632588 54458 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0610 11:41:24.632700 54458 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0610 11:41:24.632927 54458 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0610 11:41:24.633021 54458 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0610 11:41:24.633130 54458 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0610 11:41:24.633300 54458 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0610 11:41:24.633402 54458 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0610 11:41:24.633598 54458 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0610 11:41:24.633701 54458 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0610 11:41:24.633932 54458 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0610 11:41:24.634022 54458 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0610 11:41:24.634207 54458 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0610 11:41:24.634279 54458 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0610 11:41:24.634430 54458 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0610 11:41:24.634441 54458 kubeadm.go:309]
I0610 11:41:24.634494 54458 kubeadm.go:309] Unfortunately, an error has occurred:
I0610 11:41:24.634529 54458 kubeadm.go:309] timed out waiting for the condition
I0610 11:41:24.634537 54458 kubeadm.go:309]
I0610 11:41:24.634596 54458 kubeadm.go:309] This error is likely caused by:
I0610 11:41:24.634639 54458 kubeadm.go:309] - The kubelet is not running
I0610 11:41:24.634760 54458 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0610 11:41:24.634772 54458 kubeadm.go:309]
I0610 11:41:24.634875 54458 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0610 11:41:24.634928 54458 kubeadm.go:309] - 'systemctl status kubelet'
I0610 11:41:24.634977 54458 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0610 11:41:24.634991 54458 kubeadm.go:309]
I0610 11:41:24.635159 54458 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0610 11:41:24.635278 54458 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0610 11:41:24.635290 54458 kubeadm.go:309]
I0610 11:41:24.635437 54458 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0610 11:41:24.635562 54458 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0610 11:41:24.635671 54458 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0610 11:41:24.635774 54458 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0610 11:41:24.635797 54458 kubeadm.go:309]
W0610 11:41:24.635890 54458 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-166693] and IPs [192.168.72.34 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-166693] and IPs [192.168.72.34 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-166693] and IPs [192.168.72.34 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-166693] and IPs [192.168.72.34 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0610 11:41:24.635934 54458 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0610 11:41:25.109914 54458 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0610 11:41:25.126482 54458 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0610 11:41:25.137771 54458 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0610 11:41:25.137796 54458 kubeadm.go:156] found existing configuration files:
I0610 11:41:25.137844 54458 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0610 11:41:25.146851 54458 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0610 11:41:25.146909 54458 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0610 11:41:25.156146 54458 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0610 11:41:25.164600 54458 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0610 11:41:25.164662 54458 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0610 11:41:25.173676 54458 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0610 11:41:25.182386 54458 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0610 11:41:25.182435 54458 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0610 11:41:25.191631 54458 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0610 11:41:25.200892 54458 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0610 11:41:25.200978 54458 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0610 11:41:25.210107 54458 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0610 11:41:25.430352 54458 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0610 11:43:21.578083 54458 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0610 11:43:21.578196 54458 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
I0610 11:43:21.579875 54458 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0610 11:43:21.579936 54458 kubeadm.go:309] [preflight] Running pre-flight checks
I0610 11:43:21.580027 54458 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0610 11:43:21.580111 54458 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0610 11:43:21.580225 54458 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0610 11:43:21.580305 54458 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0610 11:43:21.582111 54458 out.go:204] - Generating certificates and keys ...
I0610 11:43:21.582186 54458 kubeadm.go:309] [certs] Using existing ca certificate authority
I0610 11:43:21.582243 54458 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0610 11:43:21.582349 54458 kubeadm.go:309] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0610 11:43:21.582436 54458 kubeadm.go:309] [certs] Using existing front-proxy-ca certificate authority
I0610 11:43:21.582530 54458 kubeadm.go:309] [certs] Using existing front-proxy-client certificate and key on disk
I0610 11:43:21.582616 54458 kubeadm.go:309] [certs] Using existing etcd/ca certificate authority
I0610 11:43:21.582704 54458 kubeadm.go:309] [certs] Using existing etcd/server certificate and key on disk
I0610 11:43:21.582789 54458 kubeadm.go:309] [certs] Using existing etcd/peer certificate and key on disk
I0610 11:43:21.582892 54458 kubeadm.go:309] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0610 11:43:21.582993 54458 kubeadm.go:309] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0610 11:43:21.583048 54458 kubeadm.go:309] [certs] Using the existing "sa" key
I0610 11:43:21.583124 54458 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0610 11:43:21.583221 54458 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0610 11:43:21.583286 54458 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0610 11:43:21.583352 54458 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0610 11:43:21.583400 54458 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0610 11:43:21.583526 54458 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0610 11:43:21.583624 54458 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0610 11:43:21.583681 54458 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0610 11:43:21.583775 54458 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0610 11:43:21.585365 54458 out.go:204] - Booting up control plane ...
I0610 11:43:21.585466 54458 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0610 11:43:21.585553 54458 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0610 11:43:21.585629 54458 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0610 11:43:21.585725 54458 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0610 11:43:21.585918 54458 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0610 11:43:21.585967 54458 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0610 11:43:21.586043 54458 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0610 11:43:21.586248 54458 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0610 11:43:21.586346 54458 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0610 11:43:21.586561 54458 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0610 11:43:21.586621 54458 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0610 11:43:21.586809 54458 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0610 11:43:21.586903 54458 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0610 11:43:21.587107 54458 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0610 11:43:21.587169 54458 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0610 11:43:21.587329 54458 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0610 11:43:21.587336 54458 kubeadm.go:309]
I0610 11:43:21.587369 54458 kubeadm.go:309] Unfortunately, an error has occurred:
I0610 11:43:21.587409 54458 kubeadm.go:309] timed out waiting for the condition
I0610 11:43:21.587423 54458 kubeadm.go:309]
I0610 11:43:21.587474 54458 kubeadm.go:309] This error is likely caused by:
I0610 11:43:21.587504 54458 kubeadm.go:309] - The kubelet is not running
I0610 11:43:21.587594 54458 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0610 11:43:21.587602 54458 kubeadm.go:309]
I0610 11:43:21.587707 54458 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0610 11:43:21.587763 54458 kubeadm.go:309] - 'systemctl status kubelet'
I0610 11:43:21.587810 54458 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0610 11:43:21.587821 54458 kubeadm.go:309]
I0610 11:43:21.587904 54458 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0610 11:43:21.587972 54458 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0610 11:43:21.587981 54458 kubeadm.go:309]
I0610 11:43:21.588126 54458 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0610 11:43:21.588238 54458 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0610 11:43:21.588341 54458 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0610 11:43:21.588419 54458 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0610 11:43:21.588442 54458 kubeadm.go:309]
I0610 11:43:21.588497 54458 kubeadm.go:393] duration metric: took 3m55.072180081s to StartCluster
I0610 11:43:21.588544 54458 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0610 11:43:21.588598 54458 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0610 11:43:21.630767 54458 cri.go:89] found id: ""
I0610 11:43:21.630799 54458 logs.go:276] 0 containers: []
W0610 11:43:21.630810 54458 logs.go:278] No container was found matching "kube-apiserver"
I0610 11:43:21.630817 54458 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0610 11:43:21.630889 54458 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0610 11:43:21.669373 54458 cri.go:89] found id: ""
I0610 11:43:21.669402 54458 logs.go:276] 0 containers: []
W0610 11:43:21.669410 54458 logs.go:278] No container was found matching "etcd"
I0610 11:43:21.669423 54458 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0610 11:43:21.669472 54458 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0610 11:43:21.701513 54458 cri.go:89] found id: ""
I0610 11:43:21.701545 54458 logs.go:276] 0 containers: []
W0610 11:43:21.701556 54458 logs.go:278] No container was found matching "coredns"
I0610 11:43:21.701562 54458 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0610 11:43:21.701631 54458 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0610 11:43:21.734867 54458 cri.go:89] found id: ""
I0610 11:43:21.734902 54458 logs.go:276] 0 containers: []
W0610 11:43:21.734910 54458 logs.go:278] No container was found matching "kube-scheduler"
I0610 11:43:21.734916 54458 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0610 11:43:21.734972 54458 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0610 11:43:21.770768 54458 cri.go:89] found id: ""
I0610 11:43:21.770798 54458 logs.go:276] 0 containers: []
W0610 11:43:21.770806 54458 logs.go:278] No container was found matching "kube-proxy"
I0610 11:43:21.770812 54458 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0610 11:43:21.770861 54458 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0610 11:43:21.803556 54458 cri.go:89] found id: ""
I0610 11:43:21.803578 54458 logs.go:276] 0 containers: []
W0610 11:43:21.803586 54458 logs.go:278] No container was found matching "kube-controller-manager"
I0610 11:43:21.803594 54458 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0610 11:43:21.803658 54458 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0610 11:43:21.836121 54458 cri.go:89] found id: ""
I0610 11:43:21.836162 54458 logs.go:276] 0 containers: []
W0610 11:43:21.836171 54458 logs.go:278] No container was found matching "kindnet"
I0610 11:43:21.836192 54458 logs.go:123] Gathering logs for kubelet ...
I0610 11:43:21.836206 54458 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0610 11:43:21.885236 54458 logs.go:123] Gathering logs for dmesg ...
I0610 11:43:21.885272 54458 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0610 11:43:21.898167 54458 logs.go:123] Gathering logs for describe nodes ...
I0610 11:43:21.898197 54458 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0610 11:43:22.006483 54458 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0610 11:43:22.006510 54458 logs.go:123] Gathering logs for CRI-O ...
I0610 11:43:22.006527 54458 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0610 11:43:22.095983 54458 logs.go:123] Gathering logs for container status ...
I0610 11:43:22.096022 54458 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0610 11:43:22.142642 54458 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0610 11:43:22.142699 54458 out.go:239] *
*
W0610 11:43:22.142772 54458 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0610 11:43:22.142804 54458 out.go:239] *
*
W0610 11:43:22.144023 54458 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0610 11:43:22.147617 54458 out.go:177]
W0610 11:43:22.149005 54458 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0610 11:43:22.149072 54458 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0610 11:43:22.149099 54458 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0610 11:43:22.150533 54458 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-166693 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-166693 -n old-k8s-version-166693
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-166693 -n old-k8s-version-166693: exit status 6 (232.32396ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0610 11:43:22.420735 56895 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-166693" does not appear in /home/jenkins/minikube-integration/19046-3880/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-166693" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (265.47s)