=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-835962 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-835962 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m50.399342579s)
-- stdout --
* [old-k8s-version-835962] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=19409
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19409-3774/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19409-3774/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-835962" primary control-plane node in "old-k8s-version-835962" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0812 11:32:23.476968 53678 out.go:291] Setting OutFile to fd 1 ...
I0812 11:32:23.477165 53678 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0812 11:32:23.477194 53678 out.go:304] Setting ErrFile to fd 2...
I0812 11:32:23.477210 53678 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0812 11:32:23.477546 53678 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19409-3774/.minikube/bin
I0812 11:32:23.478266 53678 out.go:298] Setting JSON to false
I0812 11:32:23.479602 53678 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":4484,"bootTime":1723457859,"procs":218,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1066-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0812 11:32:23.479818 53678 start.go:139] virtualization: kvm guest
I0812 11:32:23.482269 53678 out.go:177] * [old-k8s-version-835962] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
I0812 11:32:23.483871 53678 notify.go:220] Checking for updates...
I0812 11:32:23.483949 53678 out.go:177] - MINIKUBE_LOCATION=19409
I0812 11:32:23.485302 53678 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0812 11:32:23.487076 53678 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19409-3774/kubeconfig
I0812 11:32:23.488726 53678 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19409-3774/.minikube
I0812 11:32:23.490166 53678 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0812 11:32:23.491555 53678 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0812 11:32:23.493577 53678 config.go:182] Loaded profile config "cert-expiration-002803": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3
I0812 11:32:23.493785 53678 config.go:182] Loaded profile config "kubernetes-upgrade-535697": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.0-rc.0
I0812 11:32:23.493965 53678 config.go:182] Loaded profile config "pause-693259": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3
I0812 11:32:23.494132 53678 driver.go:392] Setting default libvirt URI to qemu:///system
I0812 11:32:23.541218 53678 out.go:177] * Using the kvm2 driver based on user configuration
I0812 11:32:23.542999 53678 start.go:297] selected driver: kvm2
I0812 11:32:23.543018 53678 start.go:901] validating driver "kvm2" against <nil>
I0812 11:32:23.543030 53678 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0812 11:32:23.543971 53678 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0812 11:32:23.544079 53678 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19409-3774/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0812 11:32:23.564702 53678 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.1
I0812 11:32:23.564766 53678 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0812 11:32:23.565116 53678 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0812 11:32:23.565160 53678 cni.go:84] Creating CNI manager for ""
I0812 11:32:23.565182 53678 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0812 11:32:23.565199 53678 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0812 11:32:23.565279 53678 start.go:340] cluster config:
{Name:old-k8s-version-835962 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-835962 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0812 11:32:23.565456 53678 iso.go:125] acquiring lock: {Name:mk817f4bb6a5031e68978029203802957205757f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0812 11:32:23.568267 53678 out.go:177] * Starting "old-k8s-version-835962" primary control-plane node in "old-k8s-version-835962" cluster
I0812 11:32:23.569494 53678 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0812 11:32:23.569546 53678 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19409-3774/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0812 11:32:23.569602 53678 cache.go:56] Caching tarball of preloaded images
I0812 11:32:23.569706 53678 preload.go:172] Found /home/jenkins/minikube-integration/19409-3774/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0812 11:32:23.569721 53678 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0812 11:32:23.569829 53678 profile.go:143] Saving config to /home/jenkins/minikube-integration/19409-3774/.minikube/profiles/old-k8s-version-835962/config.json ...
I0812 11:32:23.569852 53678 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19409-3774/.minikube/profiles/old-k8s-version-835962/config.json: {Name:mkc20043fac2507ed87b9be888012b85672e4de0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0812 11:32:23.570014 53678 start.go:360] acquireMachinesLock for old-k8s-version-835962: {Name:mkf1f3ff7da562a087a1e344d13e67c3c8140973 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0812 11:32:45.449714 53678 start.go:364] duration metric: took 21.879673117s to acquireMachinesLock for "old-k8s-version-835962"
I0812 11:32:45.449808 53678 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-835962 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19355/minikube-v1.33.1-1722420371-19355-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-835962 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0812 11:32:45.449932 53678 start.go:125] createHost starting for "" (driver="kvm2")
I0812 11:32:45.452210 53678 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0812 11:32:45.452439 53678 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0812 11:32:45.452497 53678 main.go:141] libmachine: Launching plugin server for driver kvm2
I0812 11:32:45.473965 53678 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42275
I0812 11:32:45.474500 53678 main.go:141] libmachine: () Calling .GetVersion
I0812 11:32:45.475057 53678 main.go:141] libmachine: Using API Version 1
I0812 11:32:45.475077 53678 main.go:141] libmachine: () Calling .SetConfigRaw
I0812 11:32:45.475481 53678 main.go:141] libmachine: () Calling .GetMachineName
I0812 11:32:45.475691 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetMachineName
I0812 11:32:45.475867 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .DriverName
I0812 11:32:45.476070 53678 start.go:159] libmachine.API.Create for "old-k8s-version-835962" (driver="kvm2")
I0812 11:32:45.476101 53678 client.go:168] LocalClient.Create starting
I0812 11:32:45.476137 53678 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19409-3774/.minikube/certs/ca.pem
I0812 11:32:45.476176 53678 main.go:141] libmachine: Decoding PEM data...
I0812 11:32:45.476197 53678 main.go:141] libmachine: Parsing certificate...
I0812 11:32:45.476264 53678 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19409-3774/.minikube/certs/cert.pem
I0812 11:32:45.476293 53678 main.go:141] libmachine: Decoding PEM data...
I0812 11:32:45.476318 53678 main.go:141] libmachine: Parsing certificate...
I0812 11:32:45.476342 53678 main.go:141] libmachine: Running pre-create checks...
I0812 11:32:45.476356 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .PreCreateCheck
I0812 11:32:45.476698 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetConfigRaw
I0812 11:32:45.477107 53678 main.go:141] libmachine: Creating machine...
I0812 11:32:45.477121 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .Create
I0812 11:32:45.477245 53678 main.go:141] libmachine: (old-k8s-version-835962) Creating KVM machine...
I0812 11:32:45.478390 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | found existing default KVM network
I0812 11:32:45.479999 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | I0812 11:32:45.479839 53918 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0001177e0}
I0812 11:32:45.480019 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | created network xml:
I0812 11:32:45.480028 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | <network>
I0812 11:32:45.480041 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | <name>mk-old-k8s-version-835962</name>
I0812 11:32:45.480288 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | <dns enable='no'/>
I0812 11:32:45.480300 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG |
I0812 11:32:45.480315 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | <ip address='192.168.39.1' netmask='255.255.255.0'>
I0812 11:32:45.480348 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | <dhcp>
I0812 11:32:45.480368 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | <range start='192.168.39.2' end='192.168.39.253'/>
I0812 11:32:45.480377 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | </dhcp>
I0812 11:32:45.480389 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | </ip>
I0812 11:32:45.480395 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG |
I0812 11:32:45.480402 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | </network>
I0812 11:32:45.480413 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG |
I0812 11:32:45.485802 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | trying to create private KVM network mk-old-k8s-version-835962 192.168.39.0/24...
I0812 11:32:45.560711 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | private KVM network mk-old-k8s-version-835962 192.168.39.0/24 created
I0812 11:32:45.560746 53678 main.go:141] libmachine: (old-k8s-version-835962) Setting up store path in /home/jenkins/minikube-integration/19409-3774/.minikube/machines/old-k8s-version-835962 ...
I0812 11:32:45.560762 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | I0812 11:32:45.560718 53918 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19409-3774/.minikube
I0812 11:32:45.560784 53678 main.go:141] libmachine: (old-k8s-version-835962) Building disk image from file:///home/jenkins/minikube-integration/19409-3774/.minikube/cache/iso/amd64/minikube-v1.33.1-1722420371-19355-amd64.iso
I0812 11:32:45.560897 53678 main.go:141] libmachine: (old-k8s-version-835962) Downloading /home/jenkins/minikube-integration/19409-3774/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19409-3774/.minikube/cache/iso/amd64/minikube-v1.33.1-1722420371-19355-amd64.iso...
I0812 11:32:45.796742 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | I0812 11:32:45.796628 53918 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19409-3774/.minikube/machines/old-k8s-version-835962/id_rsa...
I0812 11:32:45.901836 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | I0812 11:32:45.901686 53918 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19409-3774/.minikube/machines/old-k8s-version-835962/old-k8s-version-835962.rawdisk...
I0812 11:32:45.901869 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | Writing magic tar header
I0812 11:32:45.901889 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | Writing SSH key tar header
I0812 11:32:45.901902 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | I0812 11:32:45.901838 53918 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19409-3774/.minikube/machines/old-k8s-version-835962 ...
I0812 11:32:45.901996 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19409-3774/.minikube/machines/old-k8s-version-835962
I0812 11:32:45.902024 53678 main.go:141] libmachine: (old-k8s-version-835962) Setting executable bit set on /home/jenkins/minikube-integration/19409-3774/.minikube/machines/old-k8s-version-835962 (perms=drwx------)
I0812 11:32:45.902037 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19409-3774/.minikube/machines
I0812 11:32:45.902049 53678 main.go:141] libmachine: (old-k8s-version-835962) Setting executable bit set on /home/jenkins/minikube-integration/19409-3774/.minikube/machines (perms=drwxr-xr-x)
I0812 11:32:45.902065 53678 main.go:141] libmachine: (old-k8s-version-835962) Setting executable bit set on /home/jenkins/minikube-integration/19409-3774/.minikube (perms=drwxr-xr-x)
I0812 11:32:45.902075 53678 main.go:141] libmachine: (old-k8s-version-835962) Setting executable bit set on /home/jenkins/minikube-integration/19409-3774 (perms=drwxrwxr-x)
I0812 11:32:45.902096 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19409-3774/.minikube
I0812 11:32:45.902116 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19409-3774
I0812 11:32:45.902127 53678 main.go:141] libmachine: (old-k8s-version-835962) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0812 11:32:45.902148 53678 main.go:141] libmachine: (old-k8s-version-835962) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0812 11:32:45.902159 53678 main.go:141] libmachine: (old-k8s-version-835962) Creating domain...
I0812 11:32:45.902171 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0812 11:32:45.902179 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | Checking permissions on dir: /home/jenkins
I0812 11:32:45.902191 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | Checking permissions on dir: /home
I0812 11:32:45.902224 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | Skipping /home - not owner
I0812 11:32:45.903348 53678 main.go:141] libmachine: (old-k8s-version-835962) define libvirt domain using xml:
I0812 11:32:45.903366 53678 main.go:141] libmachine: (old-k8s-version-835962) <domain type='kvm'>
I0812 11:32:45.903402 53678 main.go:141] libmachine: (old-k8s-version-835962) <name>old-k8s-version-835962</name>
I0812 11:32:45.903420 53678 main.go:141] libmachine: (old-k8s-version-835962) <memory unit='MiB'>2200</memory>
I0812 11:32:45.903426 53678 main.go:141] libmachine: (old-k8s-version-835962) <vcpu>2</vcpu>
I0812 11:32:45.903433 53678 main.go:141] libmachine: (old-k8s-version-835962) <features>
I0812 11:32:45.903438 53678 main.go:141] libmachine: (old-k8s-version-835962) <acpi/>
I0812 11:32:45.903444 53678 main.go:141] libmachine: (old-k8s-version-835962) <apic/>
I0812 11:32:45.903450 53678 main.go:141] libmachine: (old-k8s-version-835962) <pae/>
I0812 11:32:45.903457 53678 main.go:141] libmachine: (old-k8s-version-835962)
I0812 11:32:45.903463 53678 main.go:141] libmachine: (old-k8s-version-835962) </features>
I0812 11:32:45.903467 53678 main.go:141] libmachine: (old-k8s-version-835962) <cpu mode='host-passthrough'>
I0812 11:32:45.903473 53678 main.go:141] libmachine: (old-k8s-version-835962)
I0812 11:32:45.903480 53678 main.go:141] libmachine: (old-k8s-version-835962) </cpu>
I0812 11:32:45.903485 53678 main.go:141] libmachine: (old-k8s-version-835962) <os>
I0812 11:32:45.903494 53678 main.go:141] libmachine: (old-k8s-version-835962) <type>hvm</type>
I0812 11:32:45.903499 53678 main.go:141] libmachine: (old-k8s-version-835962) <boot dev='cdrom'/>
I0812 11:32:45.903506 53678 main.go:141] libmachine: (old-k8s-version-835962) <boot dev='hd'/>
I0812 11:32:45.903522 53678 main.go:141] libmachine: (old-k8s-version-835962) <bootmenu enable='no'/>
I0812 11:32:45.903547 53678 main.go:141] libmachine: (old-k8s-version-835962) </os>
I0812 11:32:45.903558 53678 main.go:141] libmachine: (old-k8s-version-835962) <devices>
I0812 11:32:45.903567 53678 main.go:141] libmachine: (old-k8s-version-835962) <disk type='file' device='cdrom'>
I0812 11:32:45.903602 53678 main.go:141] libmachine: (old-k8s-version-835962) <source file='/home/jenkins/minikube-integration/19409-3774/.minikube/machines/old-k8s-version-835962/boot2docker.iso'/>
I0812 11:32:45.903629 53678 main.go:141] libmachine: (old-k8s-version-835962) <target dev='hdc' bus='scsi'/>
I0812 11:32:45.903662 53678 main.go:141] libmachine: (old-k8s-version-835962) <readonly/>
I0812 11:32:45.903679 53678 main.go:141] libmachine: (old-k8s-version-835962) </disk>
I0812 11:32:45.903693 53678 main.go:141] libmachine: (old-k8s-version-835962) <disk type='file' device='disk'>
I0812 11:32:45.903706 53678 main.go:141] libmachine: (old-k8s-version-835962) <driver name='qemu' type='raw' cache='default' io='threads' />
I0812 11:32:45.903721 53678 main.go:141] libmachine: (old-k8s-version-835962) <source file='/home/jenkins/minikube-integration/19409-3774/.minikube/machines/old-k8s-version-835962/old-k8s-version-835962.rawdisk'/>
I0812 11:32:45.903731 53678 main.go:141] libmachine: (old-k8s-version-835962) <target dev='hda' bus='virtio'/>
I0812 11:32:45.903740 53678 main.go:141] libmachine: (old-k8s-version-835962) </disk>
I0812 11:32:45.903754 53678 main.go:141] libmachine: (old-k8s-version-835962) <interface type='network'>
I0812 11:32:45.903774 53678 main.go:141] libmachine: (old-k8s-version-835962) <source network='mk-old-k8s-version-835962'/>
I0812 11:32:45.903793 53678 main.go:141] libmachine: (old-k8s-version-835962) <model type='virtio'/>
I0812 11:32:45.903827 53678 main.go:141] libmachine: (old-k8s-version-835962) </interface>
I0812 11:32:45.903839 53678 main.go:141] libmachine: (old-k8s-version-835962) <interface type='network'>
I0812 11:32:45.903848 53678 main.go:141] libmachine: (old-k8s-version-835962) <source network='default'/>
I0812 11:32:45.903859 53678 main.go:141] libmachine: (old-k8s-version-835962) <model type='virtio'/>
I0812 11:32:45.903871 53678 main.go:141] libmachine: (old-k8s-version-835962) </interface>
I0812 11:32:45.903882 53678 main.go:141] libmachine: (old-k8s-version-835962) <serial type='pty'>
I0812 11:32:45.903891 53678 main.go:141] libmachine: (old-k8s-version-835962) <target port='0'/>
I0812 11:32:45.903899 53678 main.go:141] libmachine: (old-k8s-version-835962) </serial>
I0812 11:32:45.903910 53678 main.go:141] libmachine: (old-k8s-version-835962) <console type='pty'>
I0812 11:32:45.903919 53678 main.go:141] libmachine: (old-k8s-version-835962) <target type='serial' port='0'/>
I0812 11:32:45.903930 53678 main.go:141] libmachine: (old-k8s-version-835962) </console>
I0812 11:32:45.903940 53678 main.go:141] libmachine: (old-k8s-version-835962) <rng model='virtio'>
I0812 11:32:45.903951 53678 main.go:141] libmachine: (old-k8s-version-835962) <backend model='random'>/dev/random</backend>
I0812 11:32:45.903963 53678 main.go:141] libmachine: (old-k8s-version-835962) </rng>
I0812 11:32:45.903975 53678 main.go:141] libmachine: (old-k8s-version-835962)
I0812 11:32:45.903987 53678 main.go:141] libmachine: (old-k8s-version-835962)
I0812 11:32:45.903997 53678 main.go:141] libmachine: (old-k8s-version-835962) </devices>
I0812 11:32:45.904008 53678 main.go:141] libmachine: (old-k8s-version-835962) </domain>
I0812 11:32:45.904018 53678 main.go:141] libmachine: (old-k8s-version-835962)
I0812 11:32:45.908612 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has defined MAC address 52:54:00:09:e0:7d in network default
I0812 11:32:45.909333 53678 main.go:141] libmachine: (old-k8s-version-835962) Ensuring networks are active...
I0812 11:32:45.909358 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has defined MAC address 52:54:00:a2:4c:33 in network mk-old-k8s-version-835962
I0812 11:32:45.910129 53678 main.go:141] libmachine: (old-k8s-version-835962) Ensuring network default is active
I0812 11:32:45.910588 53678 main.go:141] libmachine: (old-k8s-version-835962) Ensuring network mk-old-k8s-version-835962 is active
I0812 11:32:45.911276 53678 main.go:141] libmachine: (old-k8s-version-835962) Getting domain xml...
I0812 11:32:45.912074 53678 main.go:141] libmachine: (old-k8s-version-835962) Creating domain...
I0812 11:32:47.294792 53678 main.go:141] libmachine: (old-k8s-version-835962) Waiting to get IP...
I0812 11:32:47.295835 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has defined MAC address 52:54:00:a2:4c:33 in network mk-old-k8s-version-835962
I0812 11:32:47.296407 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | unable to find current IP address of domain old-k8s-version-835962 in network mk-old-k8s-version-835962
I0812 11:32:47.296435 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | I0812 11:32:47.296377 53918 retry.go:31] will retry after 217.847142ms: waiting for machine to come up
I0812 11:32:47.517738 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has defined MAC address 52:54:00:a2:4c:33 in network mk-old-k8s-version-835962
I0812 11:32:47.518304 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | unable to find current IP address of domain old-k8s-version-835962 in network mk-old-k8s-version-835962
I0812 11:32:47.518329 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | I0812 11:32:47.518275 53918 retry.go:31] will retry after 374.79379ms: waiting for machine to come up
I0812 11:32:47.895181 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has defined MAC address 52:54:00:a2:4c:33 in network mk-old-k8s-version-835962
I0812 11:32:47.895849 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | unable to find current IP address of domain old-k8s-version-835962 in network mk-old-k8s-version-835962
I0812 11:32:47.895877 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | I0812 11:32:47.895808 53918 retry.go:31] will retry after 400.015324ms: waiting for machine to come up
I0812 11:32:48.297447 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has defined MAC address 52:54:00:a2:4c:33 in network mk-old-k8s-version-835962
I0812 11:32:48.298065 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | unable to find current IP address of domain old-k8s-version-835962 in network mk-old-k8s-version-835962
I0812 11:32:48.298095 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | I0812 11:32:48.297987 53918 retry.go:31] will retry after 477.597887ms: waiting for machine to come up
I0812 11:32:48.777998 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has defined MAC address 52:54:00:a2:4c:33 in network mk-old-k8s-version-835962
I0812 11:32:48.778555 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | unable to find current IP address of domain old-k8s-version-835962 in network mk-old-k8s-version-835962
I0812 11:32:48.778605 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | I0812 11:32:48.778514 53918 retry.go:31] will retry after 582.249287ms: waiting for machine to come up
I0812 11:32:49.362353 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has defined MAC address 52:54:00:a2:4c:33 in network mk-old-k8s-version-835962
I0812 11:32:49.362901 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | unable to find current IP address of domain old-k8s-version-835962 in network mk-old-k8s-version-835962
I0812 11:32:49.362927 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | I0812 11:32:49.362859 53918 retry.go:31] will retry after 944.34775ms: waiting for machine to come up
I0812 11:32:50.309021 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has defined MAC address 52:54:00:a2:4c:33 in network mk-old-k8s-version-835962
I0812 11:32:50.309554 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | unable to find current IP address of domain old-k8s-version-835962 in network mk-old-k8s-version-835962
I0812 11:32:50.309590 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | I0812 11:32:50.309500 53918 retry.go:31] will retry after 916.767259ms: waiting for machine to come up
I0812 11:32:51.228285 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has defined MAC address 52:54:00:a2:4c:33 in network mk-old-k8s-version-835962
I0812 11:32:51.228836 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | unable to find current IP address of domain old-k8s-version-835962 in network mk-old-k8s-version-835962
I0812 11:32:51.228878 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | I0812 11:32:51.228790 53918 retry.go:31] will retry after 1.311335141s: waiting for machine to come up
I0812 11:32:52.542190 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has defined MAC address 52:54:00:a2:4c:33 in network mk-old-k8s-version-835962
I0812 11:32:52.542752 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | unable to find current IP address of domain old-k8s-version-835962 in network mk-old-k8s-version-835962
I0812 11:32:52.542782 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | I0812 11:32:52.542695 53918 retry.go:31] will retry after 1.708102138s: waiting for machine to come up
I0812 11:32:54.252261 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has defined MAC address 52:54:00:a2:4c:33 in network mk-old-k8s-version-835962
I0812 11:32:54.252765 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | unable to find current IP address of domain old-k8s-version-835962 in network mk-old-k8s-version-835962
I0812 11:32:54.252794 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | I0812 11:32:54.252702 53918 retry.go:31] will retry after 1.520033568s: waiting for machine to come up
I0812 11:32:55.775029 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has defined MAC address 52:54:00:a2:4c:33 in network mk-old-k8s-version-835962
I0812 11:32:55.775692 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | unable to find current IP address of domain old-k8s-version-835962 in network mk-old-k8s-version-835962
I0812 11:32:55.775715 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | I0812 11:32:55.775625 53918 retry.go:31] will retry after 2.401234683s: waiting for machine to come up
I0812 11:32:58.179859 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has defined MAC address 52:54:00:a2:4c:33 in network mk-old-k8s-version-835962
I0812 11:32:58.180332 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | unable to find current IP address of domain old-k8s-version-835962 in network mk-old-k8s-version-835962
I0812 11:32:58.180360 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | I0812 11:32:58.180291 53918 retry.go:31] will retry after 3.458085684s: waiting for machine to come up
I0812 11:33:01.640188 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has defined MAC address 52:54:00:a2:4c:33 in network mk-old-k8s-version-835962
I0812 11:33:01.640674 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | unable to find current IP address of domain old-k8s-version-835962 in network mk-old-k8s-version-835962
I0812 11:33:01.640703 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | I0812 11:33:01.640633 53918 retry.go:31] will retry after 3.33946049s: waiting for machine to come up
I0812 11:33:04.982685 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has defined MAC address 52:54:00:a2:4c:33 in network mk-old-k8s-version-835962
I0812 11:33:04.983285 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | unable to find current IP address of domain old-k8s-version-835962 in network mk-old-k8s-version-835962
I0812 11:33:04.983315 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | I0812 11:33:04.983235 53918 retry.go:31] will retry after 3.477684582s: waiting for machine to come up
I0812 11:33:08.462292 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has defined MAC address 52:54:00:a2:4c:33 in network mk-old-k8s-version-835962
I0812 11:33:08.462884 53678 main.go:141] libmachine: (old-k8s-version-835962) Found IP for machine: 192.168.39.17
I0812 11:33:08.462906 53678 main.go:141] libmachine: (old-k8s-version-835962) Reserving static IP address...
I0812 11:33:08.462916 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has current primary IP address 192.168.39.17 and MAC address 52:54:00:a2:4c:33 in network mk-old-k8s-version-835962
I0812 11:33:08.463252 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-835962", mac: "52:54:00:a2:4c:33", ip: "192.168.39.17"} in network mk-old-k8s-version-835962
I0812 11:33:08.546394 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | Getting to WaitForSSH function...
I0812 11:33:08.546434 53678 main.go:141] libmachine: (old-k8s-version-835962) Reserved static IP address: 192.168.39.17
I0812 11:33:08.546449 53678 main.go:141] libmachine: (old-k8s-version-835962) Waiting for SSH to be available...
I0812 11:33:08.549424 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has defined MAC address 52:54:00:a2:4c:33 in network mk-old-k8s-version-835962
I0812 11:33:08.549796 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a2:4c:33", ip: ""} in network mk-old-k8s-version-835962: {Iface:virbr4 ExpiryTime:2024-08-12 12:33:00 +0000 UTC Type:0 Mac:52:54:00:a2:4c:33 Iaid: IPaddr:192.168.39.17 Prefix:24 Hostname:minikube Clientid:01:52:54:00:a2:4c:33}
I0812 11:33:08.549817 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has defined IP address 192.168.39.17 and MAC address 52:54:00:a2:4c:33 in network mk-old-k8s-version-835962
I0812 11:33:08.550028 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | Using SSH client type: external
I0812 11:33:08.550053 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | Using SSH private key: /home/jenkins/minikube-integration/19409-3774/.minikube/machines/old-k8s-version-835962/id_rsa (-rw-------)
I0812 11:33:08.550080 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.17 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19409-3774/.minikube/machines/old-k8s-version-835962/id_rsa -p 22] /usr/bin/ssh <nil>}
I0812 11:33:08.550099 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | About to run SSH command:
I0812 11:33:08.550118 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | exit 0
I0812 11:33:08.680656 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | SSH cmd err, output: <nil>:
I0812 11:33:08.680946 53678 main.go:141] libmachine: (old-k8s-version-835962) KVM machine creation complete!
I0812 11:33:08.681437 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetConfigRaw
I0812 11:33:08.681960 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .DriverName
I0812 11:33:08.682299 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .DriverName
I0812 11:33:08.682530 53678 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0812 11:33:08.682576 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetState
I0812 11:33:08.683949 53678 main.go:141] libmachine: Detecting operating system of created instance...
I0812 11:33:08.683961 53678 main.go:141] libmachine: Waiting for SSH to be available...
I0812 11:33:08.683966 53678 main.go:141] libmachine: Getting to WaitForSSH function...
I0812 11:33:08.683972 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetSSHHostname
I0812 11:33:08.686652 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has defined MAC address 52:54:00:a2:4c:33 in network mk-old-k8s-version-835962
I0812 11:33:08.687086 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a2:4c:33", ip: ""} in network mk-old-k8s-version-835962: {Iface:virbr4 ExpiryTime:2024-08-12 12:33:00 +0000 UTC Type:0 Mac:52:54:00:a2:4c:33 Iaid: IPaddr:192.168.39.17 Prefix:24 Hostname:old-k8s-version-835962 Clientid:01:52:54:00:a2:4c:33}
I0812 11:33:08.687113 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has defined IP address 192.168.39.17 and MAC address 52:54:00:a2:4c:33 in network mk-old-k8s-version-835962
I0812 11:33:08.687306 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetSSHPort
I0812 11:33:08.687480 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetSSHKeyPath
I0812 11:33:08.687626 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetSSHKeyPath
I0812 11:33:08.687751 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetSSHUsername
I0812 11:33:08.687906 53678 main.go:141] libmachine: Using SSH client type: native
I0812 11:33:08.688166 53678 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.39.17 22 <nil> <nil>}
I0812 11:33:08.688189 53678 main.go:141] libmachine: About to run SSH command:
exit 0
I0812 11:33:08.804228 53678 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0812 11:33:08.804261 53678 main.go:141] libmachine: Detecting the provisioner...
I0812 11:33:08.804273 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetSSHHostname
I0812 11:33:08.807171 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has defined MAC address 52:54:00:a2:4c:33 in network mk-old-k8s-version-835962
I0812 11:33:08.807534 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a2:4c:33", ip: ""} in network mk-old-k8s-version-835962: {Iface:virbr4 ExpiryTime:2024-08-12 12:33:00 +0000 UTC Type:0 Mac:52:54:00:a2:4c:33 Iaid: IPaddr:192.168.39.17 Prefix:24 Hostname:old-k8s-version-835962 Clientid:01:52:54:00:a2:4c:33}
I0812 11:33:08.807575 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has defined IP address 192.168.39.17 and MAC address 52:54:00:a2:4c:33 in network mk-old-k8s-version-835962
I0812 11:33:08.807750 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetSSHPort
I0812 11:33:08.807975 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetSSHKeyPath
I0812 11:33:08.808163 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetSSHKeyPath
I0812 11:33:08.808296 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetSSHUsername
I0812 11:33:08.808535 53678 main.go:141] libmachine: Using SSH client type: native
I0812 11:33:08.808707 53678 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.39.17 22 <nil> <nil>}
I0812 11:33:08.808727 53678 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0812 11:33:08.929734 53678 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0812 11:33:08.929799 53678 main.go:141] libmachine: found compatible host: buildroot
I0812 11:33:08.929805 53678 main.go:141] libmachine: Provisioning with buildroot...
I0812 11:33:08.929813 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetMachineName
I0812 11:33:08.930055 53678 buildroot.go:166] provisioning hostname "old-k8s-version-835962"
I0812 11:33:08.930080 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetMachineName
I0812 11:33:08.930300 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetSSHHostname
I0812 11:33:08.933358 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has defined MAC address 52:54:00:a2:4c:33 in network mk-old-k8s-version-835962
I0812 11:33:08.933794 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a2:4c:33", ip: ""} in network mk-old-k8s-version-835962: {Iface:virbr4 ExpiryTime:2024-08-12 12:33:00 +0000 UTC Type:0 Mac:52:54:00:a2:4c:33 Iaid: IPaddr:192.168.39.17 Prefix:24 Hostname:old-k8s-version-835962 Clientid:01:52:54:00:a2:4c:33}
I0812 11:33:08.933823 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has defined IP address 192.168.39.17 and MAC address 52:54:00:a2:4c:33 in network mk-old-k8s-version-835962
I0812 11:33:08.934126 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetSSHPort
I0812 11:33:08.934311 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetSSHKeyPath
I0812 11:33:08.934484 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetSSHKeyPath
I0812 11:33:08.934625 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetSSHUsername
I0812 11:33:08.934834 53678 main.go:141] libmachine: Using SSH client type: native
I0812 11:33:08.935006 53678 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.39.17 22 <nil> <nil>}
I0812 11:33:08.935019 53678 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-835962 && echo "old-k8s-version-835962" | sudo tee /etc/hostname
I0812 11:33:09.063863 53678 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-835962
I0812 11:33:09.063896 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetSSHHostname
I0812 11:33:09.066993 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has defined MAC address 52:54:00:a2:4c:33 in network mk-old-k8s-version-835962
I0812 11:33:09.067369 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a2:4c:33", ip: ""} in network mk-old-k8s-version-835962: {Iface:virbr4 ExpiryTime:2024-08-12 12:33:00 +0000 UTC Type:0 Mac:52:54:00:a2:4c:33 Iaid: IPaddr:192.168.39.17 Prefix:24 Hostname:old-k8s-version-835962 Clientid:01:52:54:00:a2:4c:33}
I0812 11:33:09.067401 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has defined IP address 192.168.39.17 and MAC address 52:54:00:a2:4c:33 in network mk-old-k8s-version-835962
I0812 11:33:09.067553 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetSSHPort
I0812 11:33:09.067784 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetSSHKeyPath
I0812 11:33:09.067948 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetSSHKeyPath
I0812 11:33:09.068076 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetSSHUsername
I0812 11:33:09.068241 53678 main.go:141] libmachine: Using SSH client type: native
I0812 11:33:09.068413 53678 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.39.17 22 <nil> <nil>}
I0812 11:33:09.068431 53678 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-835962' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-835962/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-835962' | sudo tee -a /etc/hosts;
fi
fi
I0812 11:33:09.193453 53678 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0812 11:33:09.193480 53678 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19409-3774/.minikube CaCertPath:/home/jenkins/minikube-integration/19409-3774/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19409-3774/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19409-3774/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19409-3774/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19409-3774/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19409-3774/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19409-3774/.minikube}
I0812 11:33:09.193527 53678 buildroot.go:174] setting up certificates
I0812 11:33:09.193539 53678 provision.go:84] configureAuth start
I0812 11:33:09.193554 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetMachineName
I0812 11:33:09.193843 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetIP
I0812 11:33:09.196542 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has defined MAC address 52:54:00:a2:4c:33 in network mk-old-k8s-version-835962
I0812 11:33:09.196890 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a2:4c:33", ip: ""} in network mk-old-k8s-version-835962: {Iface:virbr4 ExpiryTime:2024-08-12 12:33:00 +0000 UTC Type:0 Mac:52:54:00:a2:4c:33 Iaid: IPaddr:192.168.39.17 Prefix:24 Hostname:old-k8s-version-835962 Clientid:01:52:54:00:a2:4c:33}
I0812 11:33:09.196919 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has defined IP address 192.168.39.17 and MAC address 52:54:00:a2:4c:33 in network mk-old-k8s-version-835962
I0812 11:33:09.197061 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetSSHHostname
I0812 11:33:09.199504 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has defined MAC address 52:54:00:a2:4c:33 in network mk-old-k8s-version-835962
I0812 11:33:09.199878 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a2:4c:33", ip: ""} in network mk-old-k8s-version-835962: {Iface:virbr4 ExpiryTime:2024-08-12 12:33:00 +0000 UTC Type:0 Mac:52:54:00:a2:4c:33 Iaid: IPaddr:192.168.39.17 Prefix:24 Hostname:old-k8s-version-835962 Clientid:01:52:54:00:a2:4c:33}
I0812 11:33:09.199917 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has defined IP address 192.168.39.17 and MAC address 52:54:00:a2:4c:33 in network mk-old-k8s-version-835962
I0812 11:33:09.200082 53678 provision.go:143] copyHostCerts
I0812 11:33:09.200155 53678 exec_runner.go:144] found /home/jenkins/minikube-integration/19409-3774/.minikube/ca.pem, removing ...
I0812 11:33:09.200168 53678 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19409-3774/.minikube/ca.pem
I0812 11:33:09.200231 53678 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19409-3774/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19409-3774/.minikube/ca.pem (1082 bytes)
I0812 11:33:09.200390 53678 exec_runner.go:144] found /home/jenkins/minikube-integration/19409-3774/.minikube/cert.pem, removing ...
I0812 11:33:09.200403 53678 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19409-3774/.minikube/cert.pem
I0812 11:33:09.200456 53678 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19409-3774/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19409-3774/.minikube/cert.pem (1123 bytes)
I0812 11:33:09.200563 53678 exec_runner.go:144] found /home/jenkins/minikube-integration/19409-3774/.minikube/key.pem, removing ...
I0812 11:33:09.200573 53678 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19409-3774/.minikube/key.pem
I0812 11:33:09.200602 53678 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19409-3774/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19409-3774/.minikube/key.pem (1679 bytes)
I0812 11:33:09.200688 53678 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19409-3774/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19409-3774/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19409-3774/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-835962 san=[127.0.0.1 192.168.39.17 localhost minikube old-k8s-version-835962]
I0812 11:33:09.330433 53678 provision.go:177] copyRemoteCerts
I0812 11:33:09.330499 53678 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0812 11:33:09.330522 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetSSHHostname
I0812 11:33:09.334132 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has defined MAC address 52:54:00:a2:4c:33 in network mk-old-k8s-version-835962
I0812 11:33:09.334508 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a2:4c:33", ip: ""} in network mk-old-k8s-version-835962: {Iface:virbr4 ExpiryTime:2024-08-12 12:33:00 +0000 UTC Type:0 Mac:52:54:00:a2:4c:33 Iaid: IPaddr:192.168.39.17 Prefix:24 Hostname:old-k8s-version-835962 Clientid:01:52:54:00:a2:4c:33}
I0812 11:33:09.334548 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has defined IP address 192.168.39.17 and MAC address 52:54:00:a2:4c:33 in network mk-old-k8s-version-835962
I0812 11:33:09.334791 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetSSHPort
I0812 11:33:09.335005 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetSSHKeyPath
I0812 11:33:09.335202 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetSSHUsername
I0812 11:33:09.335379 53678 sshutil.go:53] new ssh client: &{IP:192.168.39.17 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19409-3774/.minikube/machines/old-k8s-version-835962/id_rsa Username:docker}
I0812 11:33:09.423570 53678 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19409-3774/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0812 11:33:09.449500 53678 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19409-3774/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0812 11:33:09.474111 53678 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19409-3774/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0812 11:33:09.499343 53678 provision.go:87] duration metric: took 305.791018ms to configureAuth
I0812 11:33:09.499372 53678 buildroot.go:189] setting minikube options for container-runtime
I0812 11:33:09.499594 53678 config.go:182] Loaded profile config "old-k8s-version-835962": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0812 11:33:09.499678 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetSSHHostname
I0812 11:33:09.502542 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has defined MAC address 52:54:00:a2:4c:33 in network mk-old-k8s-version-835962
I0812 11:33:09.502907 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a2:4c:33", ip: ""} in network mk-old-k8s-version-835962: {Iface:virbr4 ExpiryTime:2024-08-12 12:33:00 +0000 UTC Type:0 Mac:52:54:00:a2:4c:33 Iaid: IPaddr:192.168.39.17 Prefix:24 Hostname:old-k8s-version-835962 Clientid:01:52:54:00:a2:4c:33}
I0812 11:33:09.502935 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has defined IP address 192.168.39.17 and MAC address 52:54:00:a2:4c:33 in network mk-old-k8s-version-835962
I0812 11:33:09.503177 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetSSHPort
I0812 11:33:09.503391 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetSSHKeyPath
I0812 11:33:09.503558 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetSSHKeyPath
I0812 11:33:09.503711 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetSSHUsername
I0812 11:33:09.503884 53678 main.go:141] libmachine: Using SSH client type: native
I0812 11:33:09.504123 53678 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.39.17 22 <nil> <nil>}
I0812 11:33:09.504139 53678 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0812 11:33:09.772322 53678 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0812 11:33:09.772349 53678 main.go:141] libmachine: Checking connection to Docker...
I0812 11:33:09.772361 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetURL
I0812 11:33:09.773967 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | Using libvirt version 6000000
I0812 11:33:09.776498 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has defined MAC address 52:54:00:a2:4c:33 in network mk-old-k8s-version-835962
I0812 11:33:09.777047 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a2:4c:33", ip: ""} in network mk-old-k8s-version-835962: {Iface:virbr4 ExpiryTime:2024-08-12 12:33:00 +0000 UTC Type:0 Mac:52:54:00:a2:4c:33 Iaid: IPaddr:192.168.39.17 Prefix:24 Hostname:old-k8s-version-835962 Clientid:01:52:54:00:a2:4c:33}
I0812 11:33:09.777080 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has defined IP address 192.168.39.17 and MAC address 52:54:00:a2:4c:33 in network mk-old-k8s-version-835962
I0812 11:33:09.777285 53678 main.go:141] libmachine: Docker is up and running!
I0812 11:33:09.777299 53678 main.go:141] libmachine: Reticulating splines...
I0812 11:33:09.777306 53678 client.go:171] duration metric: took 24.301196677s to LocalClient.Create
I0812 11:33:09.777326 53678 start.go:167] duration metric: took 24.301259213s to libmachine.API.Create "old-k8s-version-835962"
I0812 11:33:09.777335 53678 start.go:293] postStartSetup for "old-k8s-version-835962" (driver="kvm2")
I0812 11:33:09.777344 53678 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0812 11:33:09.777357 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .DriverName
I0812 11:33:09.777680 53678 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0812 11:33:09.777703 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetSSHHostname
I0812 11:33:09.780033 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has defined MAC address 52:54:00:a2:4c:33 in network mk-old-k8s-version-835962
I0812 11:33:09.780354 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a2:4c:33", ip: ""} in network mk-old-k8s-version-835962: {Iface:virbr4 ExpiryTime:2024-08-12 12:33:00 +0000 UTC Type:0 Mac:52:54:00:a2:4c:33 Iaid: IPaddr:192.168.39.17 Prefix:24 Hostname:old-k8s-version-835962 Clientid:01:52:54:00:a2:4c:33}
I0812 11:33:09.780381 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has defined IP address 192.168.39.17 and MAC address 52:54:00:a2:4c:33 in network mk-old-k8s-version-835962
I0812 11:33:09.780534 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetSSHPort
I0812 11:33:09.780733 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetSSHKeyPath
I0812 11:33:09.780914 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetSSHUsername
I0812 11:33:09.781070 53678 sshutil.go:53] new ssh client: &{IP:192.168.39.17 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19409-3774/.minikube/machines/old-k8s-version-835962/id_rsa Username:docker}
I0812 11:33:09.867387 53678 ssh_runner.go:195] Run: cat /etc/os-release
I0812 11:33:09.871946 53678 info.go:137] Remote host: Buildroot 2023.02.9
I0812 11:33:09.871973 53678 filesync.go:126] Scanning /home/jenkins/minikube-integration/19409-3774/.minikube/addons for local assets ...
I0812 11:33:09.872032 53678 filesync.go:126] Scanning /home/jenkins/minikube-integration/19409-3774/.minikube/files for local assets ...
I0812 11:33:09.872102 53678 filesync.go:149] local asset: /home/jenkins/minikube-integration/19409-3774/.minikube/files/etc/ssl/certs/109272.pem -> 109272.pem in /etc/ssl/certs
I0812 11:33:09.872190 53678 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0812 11:33:09.882436 53678 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19409-3774/.minikube/files/etc/ssl/certs/109272.pem --> /etc/ssl/certs/109272.pem (1708 bytes)
I0812 11:33:09.905264 53678 start.go:296] duration metric: took 127.914997ms for postStartSetup
I0812 11:33:09.905318 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetConfigRaw
I0812 11:33:09.905928 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetIP
I0812 11:33:09.909138 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has defined MAC address 52:54:00:a2:4c:33 in network mk-old-k8s-version-835962
I0812 11:33:09.909624 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a2:4c:33", ip: ""} in network mk-old-k8s-version-835962: {Iface:virbr4 ExpiryTime:2024-08-12 12:33:00 +0000 UTC Type:0 Mac:52:54:00:a2:4c:33 Iaid: IPaddr:192.168.39.17 Prefix:24 Hostname:old-k8s-version-835962 Clientid:01:52:54:00:a2:4c:33}
I0812 11:33:09.909656 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has defined IP address 192.168.39.17 and MAC address 52:54:00:a2:4c:33 in network mk-old-k8s-version-835962
I0812 11:33:09.909865 53678 profile.go:143] Saving config to /home/jenkins/minikube-integration/19409-3774/.minikube/profiles/old-k8s-version-835962/config.json ...
I0812 11:33:09.910065 53678 start.go:128] duration metric: took 24.460124343s to createHost
I0812 11:33:09.910091 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetSSHHostname
I0812 11:33:09.912913 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has defined MAC address 52:54:00:a2:4c:33 in network mk-old-k8s-version-835962
I0812 11:33:09.913299 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a2:4c:33", ip: ""} in network mk-old-k8s-version-835962: {Iface:virbr4 ExpiryTime:2024-08-12 12:33:00 +0000 UTC Type:0 Mac:52:54:00:a2:4c:33 Iaid: IPaddr:192.168.39.17 Prefix:24 Hostname:old-k8s-version-835962 Clientid:01:52:54:00:a2:4c:33}
I0812 11:33:09.913320 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has defined IP address 192.168.39.17 and MAC address 52:54:00:a2:4c:33 in network mk-old-k8s-version-835962
I0812 11:33:09.913667 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetSSHPort
I0812 11:33:09.913913 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetSSHKeyPath
I0812 11:33:09.914095 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetSSHKeyPath
I0812 11:33:09.914240 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetSSHUsername
I0812 11:33:09.914441 53678 main.go:141] libmachine: Using SSH client type: native
I0812 11:33:09.914643 53678 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.39.17 22 <nil> <nil>}
I0812 11:33:09.914663 53678 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0812 11:33:10.029361 53678 main.go:141] libmachine: SSH cmd err, output: <nil>: 1723462390.003180301
I0812 11:33:10.029386 53678 fix.go:216] guest clock: 1723462390.003180301
I0812 11:33:10.029398 53678 fix.go:229] Guest: 2024-08-12 11:33:10.003180301 +0000 UTC Remote: 2024-08-12 11:33:09.910076897 +0000 UTC m=+46.489095159 (delta=93.103404ms)
I0812 11:33:10.029424 53678 fix.go:200] guest clock delta is within tolerance: 93.103404ms
I0812 11:33:10.029430 53678 start.go:83] releasing machines lock for "old-k8s-version-835962", held for 24.579657708s
I0812 11:33:10.029461 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .DriverName
I0812 11:33:10.029762 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetIP
I0812 11:33:10.032576 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has defined MAC address 52:54:00:a2:4c:33 in network mk-old-k8s-version-835962
I0812 11:33:10.032906 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a2:4c:33", ip: ""} in network mk-old-k8s-version-835962: {Iface:virbr4 ExpiryTime:2024-08-12 12:33:00 +0000 UTC Type:0 Mac:52:54:00:a2:4c:33 Iaid: IPaddr:192.168.39.17 Prefix:24 Hostname:old-k8s-version-835962 Clientid:01:52:54:00:a2:4c:33}
I0812 11:33:10.032934 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has defined IP address 192.168.39.17 and MAC address 52:54:00:a2:4c:33 in network mk-old-k8s-version-835962
I0812 11:33:10.033075 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .DriverName
I0812 11:33:10.033583 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .DriverName
I0812 11:33:10.033771 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .DriverName
I0812 11:33:10.033869 53678 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0812 11:33:10.033911 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetSSHHostname
I0812 11:33:10.033992 53678 ssh_runner.go:195] Run: cat /version.json
I0812 11:33:10.034020 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetSSHHostname
I0812 11:33:10.036821 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has defined MAC address 52:54:00:a2:4c:33 in network mk-old-k8s-version-835962
I0812 11:33:10.037122 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has defined MAC address 52:54:00:a2:4c:33 in network mk-old-k8s-version-835962
I0812 11:33:10.037239 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a2:4c:33", ip: ""} in network mk-old-k8s-version-835962: {Iface:virbr4 ExpiryTime:2024-08-12 12:33:00 +0000 UTC Type:0 Mac:52:54:00:a2:4c:33 Iaid: IPaddr:192.168.39.17 Prefix:24 Hostname:old-k8s-version-835962 Clientid:01:52:54:00:a2:4c:33}
I0812 11:33:10.037264 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has defined IP address 192.168.39.17 and MAC address 52:54:00:a2:4c:33 in network mk-old-k8s-version-835962
I0812 11:33:10.037391 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetSSHPort
I0812 11:33:10.037570 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetSSHKeyPath
I0812 11:33:10.037653 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a2:4c:33", ip: ""} in network mk-old-k8s-version-835962: {Iface:virbr4 ExpiryTime:2024-08-12 12:33:00 +0000 UTC Type:0 Mac:52:54:00:a2:4c:33 Iaid: IPaddr:192.168.39.17 Prefix:24 Hostname:old-k8s-version-835962 Clientid:01:52:54:00:a2:4c:33}
I0812 11:33:10.037682 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has defined IP address 192.168.39.17 and MAC address 52:54:00:a2:4c:33 in network mk-old-k8s-version-835962
I0812 11:33:10.037735 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetSSHUsername
I0812 11:33:10.037824 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetSSHPort
I0812 11:33:10.037885 53678 sshutil.go:53] new ssh client: &{IP:192.168.39.17 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19409-3774/.minikube/machines/old-k8s-version-835962/id_rsa Username:docker}
I0812 11:33:10.037979 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetSSHKeyPath
I0812 11:33:10.038134 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetSSHUsername
I0812 11:33:10.038278 53678 sshutil.go:53] new ssh client: &{IP:192.168.39.17 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19409-3774/.minikube/machines/old-k8s-version-835962/id_rsa Username:docker}
I0812 11:33:10.150936 53678 ssh_runner.go:195] Run: systemctl --version
I0812 11:33:10.156961 53678 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0812 11:33:10.323907 53678 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0812 11:33:10.330608 53678 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0812 11:33:10.330698 53678 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0812 11:33:10.349357 53678 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0812 11:33:10.349381 53678 start.go:495] detecting cgroup driver to use...
I0812 11:33:10.349488 53678 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0812 11:33:10.367092 53678 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0812 11:33:10.382709 53678 docker.go:217] disabling cri-docker service (if available) ...
I0812 11:33:10.382794 53678 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0812 11:33:10.396614 53678 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0812 11:33:10.412843 53678 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0812 11:33:10.531462 53678 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0812 11:33:10.710303 53678 docker.go:233] disabling docker service ...
I0812 11:33:10.710369 53678 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0812 11:33:10.725607 53678 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0812 11:33:10.739790 53678 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0812 11:33:10.902361 53678 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0812 11:33:11.054283 53678 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0812 11:33:11.069523 53678 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0812 11:33:11.090520 53678 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0812 11:33:11.090592 53678 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0812 11:33:11.102704 53678 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0812 11:33:11.102785 53678 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0812 11:33:11.114882 53678 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0812 11:33:11.126901 53678 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0812 11:33:11.138805 53678 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0812 11:33:11.150922 53678 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0812 11:33:11.161934 53678 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0812 11:33:11.162001 53678 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0812 11:33:11.177179 53678 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0812 11:33:11.188212 53678 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0812 11:33:11.312655 53678 ssh_runner.go:195] Run: sudo systemctl restart crio
I0812 11:33:11.461455 53678 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0812 11:33:11.461532 53678 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0812 11:33:11.466370 53678 start.go:563] Will wait 60s for crictl version
I0812 11:33:11.466431 53678 ssh_runner.go:195] Run: which crictl
I0812 11:33:11.470310 53678 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0812 11:33:11.510059 53678 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0812 11:33:11.510138 53678 ssh_runner.go:195] Run: crio --version
I0812 11:33:11.539024 53678 ssh_runner.go:195] Run: crio --version
I0812 11:33:11.571707 53678 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0812 11:33:11.573134 53678 main.go:141] libmachine: (old-k8s-version-835962) Calling .GetIP
I0812 11:33:11.576076 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has defined MAC address 52:54:00:a2:4c:33 in network mk-old-k8s-version-835962
I0812 11:33:11.576465 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a2:4c:33", ip: ""} in network mk-old-k8s-version-835962: {Iface:virbr4 ExpiryTime:2024-08-12 12:33:00 +0000 UTC Type:0 Mac:52:54:00:a2:4c:33 Iaid: IPaddr:192.168.39.17 Prefix:24 Hostname:old-k8s-version-835962 Clientid:01:52:54:00:a2:4c:33}
I0812 11:33:11.576497 53678 main.go:141] libmachine: (old-k8s-version-835962) DBG | domain old-k8s-version-835962 has defined IP address 192.168.39.17 and MAC address 52:54:00:a2:4c:33 in network mk-old-k8s-version-835962
I0812 11:33:11.576724 53678 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I0812 11:33:11.581256 53678 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0812 11:33:11.594307 53678 kubeadm.go:883] updating cluster {Name:old-k8s-version-835962 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19355/minikube-v1.33.1-1722420371-19355-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-835962 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.17 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mo
untPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0812 11:33:11.594434 53678 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0812 11:33:11.594473 53678 ssh_runner.go:195] Run: sudo crictl images --output json
I0812 11:33:11.629047 53678 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0812 11:33:11.629125 53678 ssh_runner.go:195] Run: which lz4
I0812 11:33:11.632972 53678 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0812 11:33:11.636994 53678 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0812 11:33:11.637020 53678 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19409-3774/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0812 11:33:13.125015 53678 crio.go:462] duration metric: took 1.49207782s to copy over tarball
I0812 11:33:13.125084 53678 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0812 11:33:15.805119 53678 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.679995983s)
I0812 11:33:15.805150 53678 crio.go:469] duration metric: took 2.680104664s to extract the tarball
I0812 11:33:15.805157 53678 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0812 11:33:15.866446 53678 ssh_runner.go:195] Run: sudo crictl images --output json
I0812 11:33:15.920986 53678 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0812 11:33:15.921015 53678 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0812 11:33:15.921088 53678 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0812 11:33:15.921091 53678 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0812 11:33:15.921092 53678 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0812 11:33:15.921146 53678 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0812 11:33:15.921213 53678 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0812 11:33:15.921263 53678 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0812 11:33:15.921413 53678 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0812 11:33:15.921213 53678 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0812 11:33:15.928188 53678 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0812 11:33:15.928252 53678 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0812 11:33:15.928269 53678 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0812 11:33:15.928412 53678 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0812 11:33:15.928463 53678 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0812 11:33:15.928599 53678 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0812 11:33:15.929191 53678 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0812 11:33:15.929216 53678 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0812 11:33:16.169365 53678 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0812 11:33:16.193374 53678 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0812 11:33:16.193923 53678 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0812 11:33:16.207318 53678 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0812 11:33:16.208120 53678 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0812 11:33:16.212497 53678 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0812 11:33:16.231119 53678 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0812 11:33:16.234820 53678 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0812 11:33:16.234859 53678 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0812 11:33:16.234900 53678 ssh_runner.go:195] Run: which crictl
I0812 11:33:16.379104 53678 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0812 11:33:16.379135 53678 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0812 11:33:16.379154 53678 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0812 11:33:16.379167 53678 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0812 11:33:16.379217 53678 ssh_runner.go:195] Run: which crictl
I0812 11:33:16.379234 53678 ssh_runner.go:195] Run: which crictl
I0812 11:33:16.396136 53678 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0812 11:33:16.396184 53678 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0812 11:33:16.396231 53678 ssh_runner.go:195] Run: which crictl
I0812 11:33:16.421026 53678 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0812 11:33:16.421082 53678 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0812 11:33:16.421082 53678 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0812 11:33:16.421123 53678 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0812 11:33:16.421129 53678 ssh_runner.go:195] Run: which crictl
I0812 11:33:16.421185 53678 ssh_runner.go:195] Run: which crictl
I0812 11:33:16.429763 53678 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0812 11:33:16.429812 53678 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0812 11:33:16.429818 53678 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0812 11:33:16.429856 53678 ssh_runner.go:195] Run: which crictl
I0812 11:33:16.429885 53678 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0812 11:33:16.429935 53678 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0812 11:33:16.429953 53678 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0812 11:33:16.429959 53678 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0812 11:33:16.429990 53678 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0812 11:33:16.582736 53678 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0812 11:33:16.582858 53678 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0812 11:33:16.582969 53678 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0812 11:33:16.583813 53678 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0812 11:33:16.583910 53678 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0812 11:33:16.583945 53678 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0812 11:33:16.583971 53678 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0812 11:33:16.747571 53678 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0812 11:33:16.747625 53678 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0812 11:33:16.749249 53678 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0812 11:33:16.762133 53678 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0812 11:33:16.762165 53678 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0812 11:33:16.762165 53678 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0812 11:33:16.762228 53678 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0812 11:33:16.762239 53678 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0812 11:33:16.868647 53678 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0812 11:33:16.874235 53678 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19409-3774/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0812 11:33:17.016859 53678 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19409-3774/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0812 11:33:17.016953 53678 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19409-3774/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0812 11:33:17.016989 53678 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19409-3774/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0812 11:33:17.017030 53678 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19409-3774/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0812 11:33:17.017069 53678 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19409-3774/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0812 11:33:17.017136 53678 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19409-3774/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0812 11:33:17.017176 53678 cache_images.go:92] duration metric: took 1.096145392s to LoadCachedImages
W0812 11:33:17.017252 53678 out.go:239] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19409-3774/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19409-3774/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0: no such file or directory
I0812 11:33:17.017268 53678 kubeadm.go:934] updating node { 192.168.39.17 8443 v1.20.0 crio true true} ...
I0812 11:33:17.017393 53678 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-835962 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.39.17
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-835962 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0812 11:33:17.017479 53678 ssh_runner.go:195] Run: crio config
I0812 11:33:17.074824 53678 cni.go:84] Creating CNI manager for ""
I0812 11:33:17.074853 53678 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0812 11:33:17.074861 53678 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0812 11:33:17.074877 53678 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.17 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-835962 NodeName:old-k8s-version-835962 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.17"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.17 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Stati
cPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0812 11:33:17.074993 53678 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.39.17
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-835962"
kubeletExtraArgs:
node-ip: 192.168.39.17
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.39.17"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0812 11:33:17.075059 53678 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0812 11:33:17.085613 53678 binaries.go:44] Found k8s binaries, skipping transfer
I0812 11:33:17.085688 53678 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0812 11:33:17.096067 53678 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (429 bytes)
I0812 11:33:17.114463 53678 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0812 11:33:17.132481 53678 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2120 bytes)
I0812 11:33:17.159686 53678 ssh_runner.go:195] Run: grep 192.168.39.17 control-plane.minikube.internal$ /etc/hosts
I0812 11:33:17.163904 53678 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.17 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0812 11:33:17.176722 53678 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0812 11:33:17.338622 53678 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0812 11:33:17.359231 53678 certs.go:68] Setting up /home/jenkins/minikube-integration/19409-3774/.minikube/profiles/old-k8s-version-835962 for IP: 192.168.39.17
I0812 11:33:17.359257 53678 certs.go:194] generating shared ca certs ...
I0812 11:33:17.359275 53678 certs.go:226] acquiring lock for ca certs: {Name:mkab0b83a49d5695bc804bf960b468b7a47f73f3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0812 11:33:17.359434 53678 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19409-3774/.minikube/ca.key
I0812 11:33:17.359474 53678 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19409-3774/.minikube/proxy-client-ca.key
I0812 11:33:17.359484 53678 certs.go:256] generating profile certs ...
I0812 11:33:17.359532 53678 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19409-3774/.minikube/profiles/old-k8s-version-835962/client.key
I0812 11:33:17.359562 53678 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19409-3774/.minikube/profiles/old-k8s-version-835962/client.crt with IP's: []
I0812 11:33:17.461288 53678 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19409-3774/.minikube/profiles/old-k8s-version-835962/client.crt ...
I0812 11:33:17.461317 53678 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19409-3774/.minikube/profiles/old-k8s-version-835962/client.crt: {Name:mk7c767e28aed6c3ec51f89f05a5a4f8051f51ec Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0812 11:33:17.461521 53678 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19409-3774/.minikube/profiles/old-k8s-version-835962/client.key ...
I0812 11:33:17.461541 53678 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19409-3774/.minikube/profiles/old-k8s-version-835962/client.key: {Name:mkea22e76edcdd9f40bf140ff3f2499f5d02fd88 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0812 11:33:17.477149 53678 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19409-3774/.minikube/profiles/old-k8s-version-835962/apiserver.key.9ec5808d
I0812 11:33:17.477194 53678 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19409-3774/.minikube/profiles/old-k8s-version-835962/apiserver.crt.9ec5808d with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.17]
I0812 11:33:17.665985 53678 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19409-3774/.minikube/profiles/old-k8s-version-835962/apiserver.crt.9ec5808d ...
I0812 11:33:17.666018 53678 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19409-3774/.minikube/profiles/old-k8s-version-835962/apiserver.crt.9ec5808d: {Name:mkd5ab470e4e3f307b527b6dac3fd15b379a0206 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0812 11:33:17.666232 53678 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19409-3774/.minikube/profiles/old-k8s-version-835962/apiserver.key.9ec5808d ...
I0812 11:33:17.666251 53678 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19409-3774/.minikube/profiles/old-k8s-version-835962/apiserver.key.9ec5808d: {Name:mkd9eabdae2823706f514f12d546acdb1759da8d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0812 11:33:17.666337 53678 certs.go:381] copying /home/jenkins/minikube-integration/19409-3774/.minikube/profiles/old-k8s-version-835962/apiserver.crt.9ec5808d -> /home/jenkins/minikube-integration/19409-3774/.minikube/profiles/old-k8s-version-835962/apiserver.crt
I0812 11:33:17.666428 53678 certs.go:385] copying /home/jenkins/minikube-integration/19409-3774/.minikube/profiles/old-k8s-version-835962/apiserver.key.9ec5808d -> /home/jenkins/minikube-integration/19409-3774/.minikube/profiles/old-k8s-version-835962/apiserver.key
I0812 11:33:17.666490 53678 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19409-3774/.minikube/profiles/old-k8s-version-835962/proxy-client.key
I0812 11:33:17.666508 53678 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19409-3774/.minikube/profiles/old-k8s-version-835962/proxy-client.crt with IP's: []
I0812 11:33:17.777486 53678 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19409-3774/.minikube/profiles/old-k8s-version-835962/proxy-client.crt ...
I0812 11:33:17.777522 53678 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19409-3774/.minikube/profiles/old-k8s-version-835962/proxy-client.crt: {Name:mk2b9b97a39f8e84a55a6c218ee9f7cab445a752 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0812 11:33:17.777719 53678 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19409-3774/.minikube/profiles/old-k8s-version-835962/proxy-client.key ...
I0812 11:33:17.777738 53678 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19409-3774/.minikube/profiles/old-k8s-version-835962/proxy-client.key: {Name:mka786e8b61f68902e5399ea00176dbfe6573b89 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0812 11:33:17.777961 53678 certs.go:484] found cert: /home/jenkins/minikube-integration/19409-3774/.minikube/certs/10927.pem (1338 bytes)
W0812 11:33:17.778018 53678 certs.go:480] ignoring /home/jenkins/minikube-integration/19409-3774/.minikube/certs/10927_empty.pem, impossibly tiny 0 bytes
I0812 11:33:17.778032 53678 certs.go:484] found cert: /home/jenkins/minikube-integration/19409-3774/.minikube/certs/ca-key.pem (1679 bytes)
I0812 11:33:17.778063 53678 certs.go:484] found cert: /home/jenkins/minikube-integration/19409-3774/.minikube/certs/ca.pem (1082 bytes)
I0812 11:33:17.778093 53678 certs.go:484] found cert: /home/jenkins/minikube-integration/19409-3774/.minikube/certs/cert.pem (1123 bytes)
I0812 11:33:17.778121 53678 certs.go:484] found cert: /home/jenkins/minikube-integration/19409-3774/.minikube/certs/key.pem (1679 bytes)
I0812 11:33:17.778172 53678 certs.go:484] found cert: /home/jenkins/minikube-integration/19409-3774/.minikube/files/etc/ssl/certs/109272.pem (1708 bytes)
I0812 11:33:17.778960 53678 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19409-3774/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0812 11:33:17.809368 53678 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19409-3774/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0812 11:33:17.836902 53678 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19409-3774/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0812 11:33:17.861057 53678 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19409-3774/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0812 11:33:17.887329 53678 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19409-3774/.minikube/profiles/old-k8s-version-835962/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0812 11:33:17.911113 53678 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19409-3774/.minikube/profiles/old-k8s-version-835962/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0812 11:33:17.937216 53678 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19409-3774/.minikube/profiles/old-k8s-version-835962/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0812 11:33:17.962084 53678 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19409-3774/.minikube/profiles/old-k8s-version-835962/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0812 11:33:18.012834 53678 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19409-3774/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0812 11:33:18.038440 53678 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19409-3774/.minikube/certs/10927.pem --> /usr/share/ca-certificates/10927.pem (1338 bytes)
I0812 11:33:18.061993 53678 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19409-3774/.minikube/files/etc/ssl/certs/109272.pem --> /usr/share/ca-certificates/109272.pem (1708 bytes)
I0812 11:33:18.087419 53678 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0812 11:33:18.104387 53678 ssh_runner.go:195] Run: openssl version
I0812 11:33:18.110095 53678 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/109272.pem && ln -fs /usr/share/ca-certificates/109272.pem /etc/ssl/certs/109272.pem"
I0812 11:33:18.120980 53678 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/109272.pem
I0812 11:33:18.125212 53678 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug 12 10:33 /usr/share/ca-certificates/109272.pem
I0812 11:33:18.125298 53678 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/109272.pem
I0812 11:33:18.131242 53678 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/109272.pem /etc/ssl/certs/3ec20f2e.0"
I0812 11:33:18.143143 53678 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0812 11:33:18.154634 53678 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0812 11:33:18.159882 53678 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug 12 10:21 /usr/share/ca-certificates/minikubeCA.pem
I0812 11:33:18.159983 53678 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0812 11:33:18.166526 53678 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0812 11:33:18.181072 53678 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/10927.pem && ln -fs /usr/share/ca-certificates/10927.pem /etc/ssl/certs/10927.pem"
I0812 11:33:18.194535 53678 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/10927.pem
I0812 11:33:18.199442 53678 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug 12 10:33 /usr/share/ca-certificates/10927.pem
I0812 11:33:18.199499 53678 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/10927.pem
I0812 11:33:18.205439 53678 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/10927.pem /etc/ssl/certs/51391683.0"
I0812 11:33:18.216957 53678 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0812 11:33:18.221321 53678 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0812 11:33:18.221381 53678 kubeadm.go:392] StartCluster: {Name:old-k8s-version-835962 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19355/minikube-v1.33.1-1722420371-19355-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723026928-19389@sha256:7715fe0c5dce35b4eb757765cbbe02d40cd8b5effa0639735e42ad89f4f51ef0 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-835962 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.17 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0812 11:33:18.221473 53678 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0812 11:33:18.221527 53678 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0812 11:33:18.262243 53678 cri.go:89] found id: ""
I0812 11:33:18.262305 53678 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0812 11:33:18.275126 53678 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0812 11:33:18.297640 53678 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0812 11:33:18.311955 53678 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0812 11:33:18.311980 53678 kubeadm.go:157] found existing configuration files:
I0812 11:33:18.312042 53678 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0812 11:33:18.324699 53678 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0812 11:33:18.324760 53678 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0812 11:33:18.341134 53678 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0812 11:33:18.357575 53678 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0812 11:33:18.357633 53678 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0812 11:33:18.376613 53678 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0812 11:33:18.394013 53678 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0812 11:33:18.394086 53678 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0812 11:33:18.409596 53678 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0812 11:33:18.418610 53678 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0812 11:33:18.418671 53678 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0812 11:33:18.428355 53678 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0812 11:33:18.702524 53678 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0812 11:35:16.223053 53678 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0812 11:35:16.223255 53678 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0812 11:35:16.223474 53678 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0812 11:35:16.223568 53678 kubeadm.go:310] [preflight] Running pre-flight checks
I0812 11:35:16.223739 53678 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0812 11:35:16.223965 53678 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0812 11:35:16.224171 53678 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0812 11:35:16.224314 53678 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0812 11:35:16.226142 53678 out.go:204] - Generating certificates and keys ...
I0812 11:35:16.226264 53678 kubeadm.go:310] [certs] Using existing ca certificate authority
I0812 11:35:16.226349 53678 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0812 11:35:16.226446 53678 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0812 11:35:16.226527 53678 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0812 11:35:16.226634 53678 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0812 11:35:16.226742 53678 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0812 11:35:16.226843 53678 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0812 11:35:16.227060 53678 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-835962] and IPs [192.168.39.17 127.0.0.1 ::1]
I0812 11:35:16.227140 53678 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0812 11:35:16.227323 53678 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-835962] and IPs [192.168.39.17 127.0.0.1 ::1]
I0812 11:35:16.227415 53678 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0812 11:35:16.227506 53678 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0812 11:35:16.227578 53678 kubeadm.go:310] [certs] Generating "sa" key and public key
I0812 11:35:16.227663 53678 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0812 11:35:16.227738 53678 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0812 11:35:16.227819 53678 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0812 11:35:16.227919 53678 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0812 11:35:16.228002 53678 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0812 11:35:16.228154 53678 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0812 11:35:16.228281 53678 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0812 11:35:16.228334 53678 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0812 11:35:16.228430 53678 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0812 11:35:16.230315 53678 out.go:204] - Booting up control plane ...
I0812 11:35:16.230445 53678 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0812 11:35:16.230604 53678 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0812 11:35:16.230725 53678 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0812 11:35:16.230856 53678 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0812 11:35:16.231085 53678 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0812 11:35:16.231161 53678 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0812 11:35:16.231257 53678 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0812 11:35:16.231498 53678 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0812 11:35:16.231594 53678 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0812 11:35:16.231835 53678 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0812 11:35:16.231933 53678 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0812 11:35:16.232185 53678 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0812 11:35:16.232278 53678 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0812 11:35:16.232522 53678 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0812 11:35:16.232622 53678 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0812 11:35:16.232897 53678 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0812 11:35:16.232907 53678 kubeadm.go:310]
I0812 11:35:16.232971 53678 kubeadm.go:310] Unfortunately, an error has occurred:
I0812 11:35:16.233029 53678 kubeadm.go:310] timed out waiting for the condition
I0812 11:35:16.233039 53678 kubeadm.go:310]
I0812 11:35:16.233084 53678 kubeadm.go:310] This error is likely caused by:
I0812 11:35:16.233131 53678 kubeadm.go:310] - The kubelet is not running
I0812 11:35:16.233275 53678 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0812 11:35:16.233284 53678 kubeadm.go:310]
I0812 11:35:16.233420 53678 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0812 11:35:16.233470 53678 kubeadm.go:310] - 'systemctl status kubelet'
I0812 11:35:16.233516 53678 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0812 11:35:16.233525 53678 kubeadm.go:310]
I0812 11:35:16.233694 53678 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0812 11:35:16.233808 53678 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0812 11:35:16.233818 53678 kubeadm.go:310]
I0812 11:35:16.233956 53678 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0812 11:35:16.234078 53678 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0812 11:35:16.234183 53678 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0812 11:35:16.234282 53678 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
W0812 11:35:16.234426 53678 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-835962] and IPs [192.168.39.17 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-835962] and IPs [192.168.39.17 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-835962] and IPs [192.168.39.17 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-835962] and IPs [192.168.39.17 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0812 11:35:16.234481 53678 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0812 11:35:16.234785 53678 kubeadm.go:310]
I0812 11:35:16.951787 53678 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0812 11:35:16.967774 53678 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0812 11:35:16.979499 53678 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0812 11:35:16.979518 53678 kubeadm.go:157] found existing configuration files:
I0812 11:35:16.979561 53678 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0812 11:35:16.990664 53678 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0812 11:35:16.990739 53678 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0812 11:35:17.001470 53678 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0812 11:35:17.014204 53678 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0812 11:35:17.014277 53678 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0812 11:35:17.025357 53678 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0812 11:35:17.035247 53678 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0812 11:35:17.035319 53678 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0812 11:35:17.045527 53678 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0812 11:35:17.057136 53678 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0812 11:35:17.057205 53678 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0812 11:35:17.069297 53678 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0812 11:35:17.317597 53678 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0812 11:37:13.191720 53678 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0812 11:37:13.191839 53678 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0812 11:37:13.193285 53678 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0812 11:37:13.193350 53678 kubeadm.go:310] [preflight] Running pre-flight checks
I0812 11:37:13.193430 53678 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0812 11:37:13.193538 53678 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0812 11:37:13.193673 53678 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0812 11:37:13.193773 53678 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0812 11:37:13.195586 53678 out.go:204] - Generating certificates and keys ...
I0812 11:37:13.195656 53678 kubeadm.go:310] [certs] Using existing ca certificate authority
I0812 11:37:13.195727 53678 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0812 11:37:13.195818 53678 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0812 11:37:13.195874 53678 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0812 11:37:13.195932 53678 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0812 11:37:13.195977 53678 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0812 11:37:13.196033 53678 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0812 11:37:13.196119 53678 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0812 11:37:13.196227 53678 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0812 11:37:13.196338 53678 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0812 11:37:13.196374 53678 kubeadm.go:310] [certs] Using the existing "sa" key
I0812 11:37:13.196424 53678 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0812 11:37:13.196467 53678 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0812 11:37:13.196512 53678 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0812 11:37:13.196577 53678 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0812 11:37:13.196623 53678 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0812 11:37:13.196725 53678 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0812 11:37:13.196819 53678 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0812 11:37:13.196909 53678 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0812 11:37:13.197003 53678 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0812 11:37:13.198728 53678 out.go:204] - Booting up control plane ...
I0812 11:37:13.198837 53678 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0812 11:37:13.198922 53678 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0812 11:37:13.198998 53678 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0812 11:37:13.199106 53678 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0812 11:37:13.199264 53678 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0812 11:37:13.199342 53678 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0812 11:37:13.199412 53678 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0812 11:37:13.199583 53678 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0812 11:37:13.199662 53678 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0812 11:37:13.199896 53678 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0812 11:37:13.200008 53678 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0812 11:37:13.200192 53678 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0812 11:37:13.200264 53678 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0812 11:37:13.200489 53678 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0812 11:37:13.200595 53678 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0812 11:37:13.200832 53678 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0812 11:37:13.200848 53678 kubeadm.go:310]
I0812 11:37:13.200897 53678 kubeadm.go:310] Unfortunately, an error has occurred:
I0812 11:37:13.200935 53678 kubeadm.go:310] timed out waiting for the condition
I0812 11:37:13.200943 53678 kubeadm.go:310]
I0812 11:37:13.200971 53678 kubeadm.go:310] This error is likely caused by:
I0812 11:37:13.201005 53678 kubeadm.go:310] - The kubelet is not running
I0812 11:37:13.201093 53678 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0812 11:37:13.201100 53678 kubeadm.go:310]
I0812 11:37:13.201183 53678 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0812 11:37:13.201244 53678 kubeadm.go:310] - 'systemctl status kubelet'
I0812 11:37:13.201301 53678 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0812 11:37:13.201311 53678 kubeadm.go:310]
I0812 11:37:13.201447 53678 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0812 11:37:13.201567 53678 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0812 11:37:13.201577 53678 kubeadm.go:310]
I0812 11:37:13.201719 53678 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0812 11:37:13.201840 53678 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0812 11:37:13.201912 53678 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0812 11:37:13.201995 53678 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0812 11:37:13.202002 53678 kubeadm.go:310]
I0812 11:37:13.202054 53678 kubeadm.go:394] duration metric: took 3m54.98067673s to StartCluster
I0812 11:37:13.202086 53678 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0812 11:37:13.202134 53678 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0812 11:37:13.245876 53678 cri.go:89] found id: ""
I0812 11:37:13.245909 53678 logs.go:276] 0 containers: []
W0812 11:37:13.245919 53678 logs.go:278] No container was found matching "kube-apiserver"
I0812 11:37:13.245927 53678 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0812 11:37:13.245988 53678 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0812 11:37:13.280782 53678 cri.go:89] found id: ""
I0812 11:37:13.280808 53678 logs.go:276] 0 containers: []
W0812 11:37:13.280819 53678 logs.go:278] No container was found matching "etcd"
I0812 11:37:13.280827 53678 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0812 11:37:13.280908 53678 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0812 11:37:13.313557 53678 cri.go:89] found id: ""
I0812 11:37:13.313618 53678 logs.go:276] 0 containers: []
W0812 11:37:13.313631 53678 logs.go:278] No container was found matching "coredns"
I0812 11:37:13.313639 53678 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0812 11:37:13.313694 53678 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0812 11:37:13.356944 53678 cri.go:89] found id: ""
I0812 11:37:13.356968 53678 logs.go:276] 0 containers: []
W0812 11:37:13.356975 53678 logs.go:278] No container was found matching "kube-scheduler"
I0812 11:37:13.356982 53678 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0812 11:37:13.357042 53678 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0812 11:37:13.412345 53678 cri.go:89] found id: ""
I0812 11:37:13.412380 53678 logs.go:276] 0 containers: []
W0812 11:37:13.412393 53678 logs.go:278] No container was found matching "kube-proxy"
I0812 11:37:13.412401 53678 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0812 11:37:13.412467 53678 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0812 11:37:13.446403 53678 cri.go:89] found id: ""
I0812 11:37:13.446429 53678 logs.go:276] 0 containers: []
W0812 11:37:13.446439 53678 logs.go:278] No container was found matching "kube-controller-manager"
I0812 11:37:13.446446 53678 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0812 11:37:13.446505 53678 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0812 11:37:13.479938 53678 cri.go:89] found id: ""
I0812 11:37:13.479967 53678 logs.go:276] 0 containers: []
W0812 11:37:13.479978 53678 logs.go:278] No container was found matching "kindnet"
I0812 11:37:13.479990 53678 logs.go:123] Gathering logs for kubelet ...
I0812 11:37:13.480004 53678 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0812 11:37:13.531296 53678 logs.go:123] Gathering logs for dmesg ...
I0812 11:37:13.531338 53678 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0812 11:37:13.545042 53678 logs.go:123] Gathering logs for describe nodes ...
I0812 11:37:13.545069 53678 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0812 11:37:13.654622 53678 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0812 11:37:13.654643 53678 logs.go:123] Gathering logs for CRI-O ...
I0812 11:37:13.654655 53678 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0812 11:37:13.756345 53678 logs.go:123] Gathering logs for container status ...
I0812 11:37:13.756373 53678 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0812 11:37:13.800759 53678 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0812 11:37:13.800813 53678 out.go:239] *
*
W0812 11:37:13.800884 53678 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0812 11:37:13.800916 53678 out.go:239] *
*
W0812 11:37:13.802092 53678 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0812 11:37:13.805169 53678 out.go:177]
W0812 11:37:13.806616 53678 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0812 11:37:13.806660 53678 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0812 11:37:13.806681 53678 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0812 11:37:13.808381 53678 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-835962 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-835962 -n old-k8s-version-835962
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-835962 -n old-k8s-version-835962: exit status 6 (264.711929ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0812 11:37:14.107306 56353 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-835962" does not appear in /home/jenkins/minikube-integration/19409-3774/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-835962" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (290.72s)