=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-490984 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-490984 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m42.784926199s)
-- stdout --
* [old-k8s-version-490984] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=19355
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19355-5397/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19355-5397/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-490984" primary control-plane node in "old-k8s-version-490984" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0802 18:37:50.039183 54981 out.go:291] Setting OutFile to fd 1 ...
I0802 18:37:50.039325 54981 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0802 18:37:50.039337 54981 out.go:304] Setting ErrFile to fd 2...
I0802 18:37:50.039345 54981 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0802 18:37:50.039555 54981 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19355-5397/.minikube/bin
I0802 18:37:50.040108 54981 out.go:298] Setting JSON to false
I0802 18:37:50.040989 54981 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":4814,"bootTime":1722619056,"procs":205,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1065-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0802 18:37:50.041057 54981 start.go:139] virtualization: kvm guest
I0802 18:37:50.043339 54981 out.go:177] * [old-k8s-version-490984] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
I0802 18:37:50.044618 54981 out.go:177] - MINIKUBE_LOCATION=19355
I0802 18:37:50.044670 54981 notify.go:220] Checking for updates...
I0802 18:37:50.046948 54981 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0802 18:37:50.048196 54981 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19355-5397/kubeconfig
I0802 18:37:50.049633 54981 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19355-5397/.minikube
I0802 18:37:50.050926 54981 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0802 18:37:50.052152 54981 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0802 18:37:50.053759 54981 config.go:182] Loaded profile config "cert-expiration-139745": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3
I0802 18:37:50.053908 54981 config.go:182] Loaded profile config "cert-options-643429": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3
I0802 18:37:50.054020 54981 config.go:182] Loaded profile config "kubernetes-upgrade-132946": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0802 18:37:50.054122 54981 driver.go:392] Setting default libvirt URI to qemu:///system
I0802 18:37:50.087307 54981 out.go:177] * Using the kvm2 driver based on user configuration
I0802 18:37:50.088522 54981 start.go:297] selected driver: kvm2
I0802 18:37:50.088537 54981 start.go:901] validating driver "kvm2" against <nil>
I0802 18:37:50.088551 54981 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0802 18:37:50.089577 54981 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0802 18:37:50.089681 54981 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19355-5397/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0802 18:37:50.104771 54981 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.1
I0802 18:37:50.104826 54981 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0802 18:37:50.105059 54981 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0802 18:37:50.105117 54981 cni.go:84] Creating CNI manager for ""
I0802 18:37:50.105129 54981 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0802 18:37:50.105135 54981 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0802 18:37:50.105193 54981 start.go:340] cluster config:
{Name:old-k8s-version-490984 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-490984 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0802 18:37:50.105288 54981 iso.go:125] acquiring lock: {Name:mkf5b6fddf709f8fd31f61df8eb110af3677ce98 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0802 18:37:50.107064 54981 out.go:177] * Starting "old-k8s-version-490984" primary control-plane node in "old-k8s-version-490984" cluster
I0802 18:37:50.108478 54981 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0802 18:37:50.108518 54981 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19355-5397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0802 18:37:50.108527 54981 cache.go:56] Caching tarball of preloaded images
I0802 18:37:50.108618 54981 preload.go:172] Found /home/jenkins/minikube-integration/19355-5397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0802 18:37:50.108630 54981 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0802 18:37:50.108717 54981 profile.go:143] Saving config to /home/jenkins/minikube-integration/19355-5397/.minikube/profiles/old-k8s-version-490984/config.json ...
I0802 18:37:50.108734 54981 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19355-5397/.minikube/profiles/old-k8s-version-490984/config.json: {Name:mk60b2005907a376ae67f054ea6420729179d52d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0802 18:37:50.108853 54981 start.go:360] acquireMachinesLock for old-k8s-version-490984: {Name:mk16e1d881c947a412c8f092032e8ae7d93261d4 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0802 18:38:03.911711 54981 start.go:364] duration metric: took 13.802813948s to acquireMachinesLock for "old-k8s-version-490984"
I0802 18:38:03.911791 54981 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-490984 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19355/minikube-v1.33.1-1722420371-19355-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-490984 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0802 18:38:03.911937 54981 start.go:125] createHost starting for "" (driver="kvm2")
I0802 18:38:03.913911 54981 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0802 18:38:03.914105 54981 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0802 18:38:03.914158 54981 main.go:141] libmachine: Launching plugin server for driver kvm2
I0802 18:38:03.930482 54981 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35749
I0802 18:38:03.930888 54981 main.go:141] libmachine: () Calling .GetVersion
I0802 18:38:03.931457 54981 main.go:141] libmachine: Using API Version 1
I0802 18:38:03.931480 54981 main.go:141] libmachine: () Calling .SetConfigRaw
I0802 18:38:03.931847 54981 main.go:141] libmachine: () Calling .GetMachineName
I0802 18:38:03.932041 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetMachineName
I0802 18:38:03.932180 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .DriverName
I0802 18:38:03.932339 54981 start.go:159] libmachine.API.Create for "old-k8s-version-490984" (driver="kvm2")
I0802 18:38:03.932374 54981 client.go:168] LocalClient.Create starting
I0802 18:38:03.932411 54981 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19355-5397/.minikube/certs/ca.pem
I0802 18:38:03.932462 54981 main.go:141] libmachine: Decoding PEM data...
I0802 18:38:03.932493 54981 main.go:141] libmachine: Parsing certificate...
I0802 18:38:03.932559 54981 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19355-5397/.minikube/certs/cert.pem
I0802 18:38:03.932583 54981 main.go:141] libmachine: Decoding PEM data...
I0802 18:38:03.932602 54981 main.go:141] libmachine: Parsing certificate...
I0802 18:38:03.932627 54981 main.go:141] libmachine: Running pre-create checks...
I0802 18:38:03.932646 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .PreCreateCheck
I0802 18:38:03.933000 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetConfigRaw
I0802 18:38:03.933430 54981 main.go:141] libmachine: Creating machine...
I0802 18:38:03.933447 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .Create
I0802 18:38:03.933574 54981 main.go:141] libmachine: (old-k8s-version-490984) Creating KVM machine...
I0802 18:38:03.934980 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | found existing default KVM network
I0802 18:38:03.936638 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | I0802 18:38:03.936473 55091 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr3 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:10:85:f6} reservation:<nil>}
I0802 18:38:03.938085 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | I0802 18:38:03.937980 55091 network.go:206] using free private subnet 192.168.50.0/24: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0002a2970}
I0802 18:38:03.938119 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | created network xml:
I0802 18:38:03.938141 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | <network>
I0802 18:38:03.938150 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | <name>mk-old-k8s-version-490984</name>
I0802 18:38:03.938163 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | <dns enable='no'/>
I0802 18:38:03.938173 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG |
I0802 18:38:03.938201 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | <ip address='192.168.50.1' netmask='255.255.255.0'>
I0802 18:38:03.938221 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | <dhcp>
I0802 18:38:03.938251 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | <range start='192.168.50.2' end='192.168.50.253'/>
I0802 18:38:03.938262 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | </dhcp>
I0802 18:38:03.938274 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | </ip>
I0802 18:38:03.938311 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG |
I0802 18:38:03.938327 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | </network>
I0802 18:38:03.938340 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG |
I0802 18:38:03.944042 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | trying to create private KVM network mk-old-k8s-version-490984 192.168.50.0/24...
I0802 18:38:04.018978 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | private KVM network mk-old-k8s-version-490984 192.168.50.0/24 created
I0802 18:38:04.019014 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | I0802 18:38:04.018957 55091 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19355-5397/.minikube
I0802 18:38:04.019061 54981 main.go:141] libmachine: (old-k8s-version-490984) Setting up store path in /home/jenkins/minikube-integration/19355-5397/.minikube/machines/old-k8s-version-490984 ...
I0802 18:38:04.019091 54981 main.go:141] libmachine: (old-k8s-version-490984) Building disk image from file:///home/jenkins/minikube-integration/19355-5397/.minikube/cache/iso/amd64/minikube-v1.33.1-1722420371-19355-amd64.iso
I0802 18:38:04.019141 54981 main.go:141] libmachine: (old-k8s-version-490984) Downloading /home/jenkins/minikube-integration/19355-5397/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19355-5397/.minikube/cache/iso/amd64/minikube-v1.33.1-1722420371-19355-amd64.iso...
I0802 18:38:04.252738 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | I0802 18:38:04.252648 55091 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19355-5397/.minikube/machines/old-k8s-version-490984/id_rsa...
I0802 18:38:04.667478 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | I0802 18:38:04.667352 55091 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19355-5397/.minikube/machines/old-k8s-version-490984/old-k8s-version-490984.rawdisk...
I0802 18:38:04.667506 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | Writing magic tar header
I0802 18:38:04.667518 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | Writing SSH key tar header
I0802 18:38:04.667569 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | I0802 18:38:04.667510 55091 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19355-5397/.minikube/machines/old-k8s-version-490984 ...
I0802 18:38:04.667637 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19355-5397/.minikube/machines/old-k8s-version-490984
I0802 18:38:04.667689 54981 main.go:141] libmachine: (old-k8s-version-490984) Setting executable bit set on /home/jenkins/minikube-integration/19355-5397/.minikube/machines/old-k8s-version-490984 (perms=drwx------)
I0802 18:38:04.667720 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19355-5397/.minikube/machines
I0802 18:38:04.667734 54981 main.go:141] libmachine: (old-k8s-version-490984) Setting executable bit set on /home/jenkins/minikube-integration/19355-5397/.minikube/machines (perms=drwxr-xr-x)
I0802 18:38:04.667745 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19355-5397/.minikube
I0802 18:38:04.667761 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19355-5397
I0802 18:38:04.667774 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0802 18:38:04.667789 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | Checking permissions on dir: /home/jenkins
I0802 18:38:04.667801 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | Checking permissions on dir: /home
I0802 18:38:04.667812 54981 main.go:141] libmachine: (old-k8s-version-490984) Setting executable bit set on /home/jenkins/minikube-integration/19355-5397/.minikube (perms=drwxr-xr-x)
I0802 18:38:04.667821 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | Skipping /home - not owner
I0802 18:38:04.667836 54981 main.go:141] libmachine: (old-k8s-version-490984) Setting executable bit set on /home/jenkins/minikube-integration/19355-5397 (perms=drwxrwxr-x)
I0802 18:38:04.667850 54981 main.go:141] libmachine: (old-k8s-version-490984) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0802 18:38:04.667867 54981 main.go:141] libmachine: (old-k8s-version-490984) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0802 18:38:04.667879 54981 main.go:141] libmachine: (old-k8s-version-490984) Creating domain...
I0802 18:38:04.669023 54981 main.go:141] libmachine: (old-k8s-version-490984) define libvirt domain using xml:
I0802 18:38:04.669047 54981 main.go:141] libmachine: (old-k8s-version-490984) <domain type='kvm'>
I0802 18:38:04.669054 54981 main.go:141] libmachine: (old-k8s-version-490984) <name>old-k8s-version-490984</name>
I0802 18:38:04.669060 54981 main.go:141] libmachine: (old-k8s-version-490984) <memory unit='MiB'>2200</memory>
I0802 18:38:04.669069 54981 main.go:141] libmachine: (old-k8s-version-490984) <vcpu>2</vcpu>
I0802 18:38:04.669076 54981 main.go:141] libmachine: (old-k8s-version-490984) <features>
I0802 18:38:04.669090 54981 main.go:141] libmachine: (old-k8s-version-490984) <acpi/>
I0802 18:38:04.669097 54981 main.go:141] libmachine: (old-k8s-version-490984) <apic/>
I0802 18:38:04.669117 54981 main.go:141] libmachine: (old-k8s-version-490984) <pae/>
I0802 18:38:04.669129 54981 main.go:141] libmachine: (old-k8s-version-490984)
I0802 18:38:04.669198 54981 main.go:141] libmachine: (old-k8s-version-490984) </features>
I0802 18:38:04.669228 54981 main.go:141] libmachine: (old-k8s-version-490984) <cpu mode='host-passthrough'>
I0802 18:38:04.669239 54981 main.go:141] libmachine: (old-k8s-version-490984)
I0802 18:38:04.669248 54981 main.go:141] libmachine: (old-k8s-version-490984) </cpu>
I0802 18:38:04.669260 54981 main.go:141] libmachine: (old-k8s-version-490984) <os>
I0802 18:38:04.669271 54981 main.go:141] libmachine: (old-k8s-version-490984) <type>hvm</type>
I0802 18:38:04.669283 54981 main.go:141] libmachine: (old-k8s-version-490984) <boot dev='cdrom'/>
I0802 18:38:04.669293 54981 main.go:141] libmachine: (old-k8s-version-490984) <boot dev='hd'/>
I0802 18:38:04.669313 54981 main.go:141] libmachine: (old-k8s-version-490984) <bootmenu enable='no'/>
I0802 18:38:04.669328 54981 main.go:141] libmachine: (old-k8s-version-490984) </os>
I0802 18:38:04.669345 54981 main.go:141] libmachine: (old-k8s-version-490984) <devices>
I0802 18:38:04.669362 54981 main.go:141] libmachine: (old-k8s-version-490984) <disk type='file' device='cdrom'>
I0802 18:38:04.669379 54981 main.go:141] libmachine: (old-k8s-version-490984) <source file='/home/jenkins/minikube-integration/19355-5397/.minikube/machines/old-k8s-version-490984/boot2docker.iso'/>
I0802 18:38:04.669390 54981 main.go:141] libmachine: (old-k8s-version-490984) <target dev='hdc' bus='scsi'/>
I0802 18:38:04.669402 54981 main.go:141] libmachine: (old-k8s-version-490984) <readonly/>
I0802 18:38:04.669410 54981 main.go:141] libmachine: (old-k8s-version-490984) </disk>
I0802 18:38:04.669443 54981 main.go:141] libmachine: (old-k8s-version-490984) <disk type='file' device='disk'>
I0802 18:38:04.669462 54981 main.go:141] libmachine: (old-k8s-version-490984) <driver name='qemu' type='raw' cache='default' io='threads' />
I0802 18:38:04.669479 54981 main.go:141] libmachine: (old-k8s-version-490984) <source file='/home/jenkins/minikube-integration/19355-5397/.minikube/machines/old-k8s-version-490984/old-k8s-version-490984.rawdisk'/>
I0802 18:38:04.669496 54981 main.go:141] libmachine: (old-k8s-version-490984) <target dev='hda' bus='virtio'/>
I0802 18:38:04.669504 54981 main.go:141] libmachine: (old-k8s-version-490984) </disk>
I0802 18:38:04.669509 54981 main.go:141] libmachine: (old-k8s-version-490984) <interface type='network'>
I0802 18:38:04.669517 54981 main.go:141] libmachine: (old-k8s-version-490984) <source network='mk-old-k8s-version-490984'/>
I0802 18:38:04.669522 54981 main.go:141] libmachine: (old-k8s-version-490984) <model type='virtio'/>
I0802 18:38:04.669528 54981 main.go:141] libmachine: (old-k8s-version-490984) </interface>
I0802 18:38:04.669539 54981 main.go:141] libmachine: (old-k8s-version-490984) <interface type='network'>
I0802 18:38:04.669551 54981 main.go:141] libmachine: (old-k8s-version-490984) <source network='default'/>
I0802 18:38:04.669562 54981 main.go:141] libmachine: (old-k8s-version-490984) <model type='virtio'/>
I0802 18:38:04.669571 54981 main.go:141] libmachine: (old-k8s-version-490984) </interface>
I0802 18:38:04.669581 54981 main.go:141] libmachine: (old-k8s-version-490984) <serial type='pty'>
I0802 18:38:04.669590 54981 main.go:141] libmachine: (old-k8s-version-490984) <target port='0'/>
I0802 18:38:04.669599 54981 main.go:141] libmachine: (old-k8s-version-490984) </serial>
I0802 18:38:04.669637 54981 main.go:141] libmachine: (old-k8s-version-490984) <console type='pty'>
I0802 18:38:04.669657 54981 main.go:141] libmachine: (old-k8s-version-490984) <target type='serial' port='0'/>
I0802 18:38:04.669682 54981 main.go:141] libmachine: (old-k8s-version-490984) </console>
I0802 18:38:04.669693 54981 main.go:141] libmachine: (old-k8s-version-490984) <rng model='virtio'>
I0802 18:38:04.669704 54981 main.go:141] libmachine: (old-k8s-version-490984) <backend model='random'>/dev/random</backend>
I0802 18:38:04.669715 54981 main.go:141] libmachine: (old-k8s-version-490984) </rng>
I0802 18:38:04.669724 54981 main.go:141] libmachine: (old-k8s-version-490984)
I0802 18:38:04.669738 54981 main.go:141] libmachine: (old-k8s-version-490984)
I0802 18:38:04.669749 54981 main.go:141] libmachine: (old-k8s-version-490984) </devices>
I0802 18:38:04.669758 54981 main.go:141] libmachine: (old-k8s-version-490984) </domain>
I0802 18:38:04.669768 54981 main.go:141] libmachine: (old-k8s-version-490984)
I0802 18:38:04.673662 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has defined MAC address 52:54:00:82:58:38 in network default
I0802 18:38:04.674202 54981 main.go:141] libmachine: (old-k8s-version-490984) Ensuring networks are active...
I0802 18:38:04.674220 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has defined MAC address 52:54:00:e1:cb:7a in network mk-old-k8s-version-490984
I0802 18:38:04.674978 54981 main.go:141] libmachine: (old-k8s-version-490984) Ensuring network default is active
I0802 18:38:04.675318 54981 main.go:141] libmachine: (old-k8s-version-490984) Ensuring network mk-old-k8s-version-490984 is active
I0802 18:38:04.675882 54981 main.go:141] libmachine: (old-k8s-version-490984) Getting domain xml...
I0802 18:38:04.676619 54981 main.go:141] libmachine: (old-k8s-version-490984) Creating domain...
I0802 18:38:06.102686 54981 main.go:141] libmachine: (old-k8s-version-490984) Waiting to get IP...
I0802 18:38:06.103944 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has defined MAC address 52:54:00:e1:cb:7a in network mk-old-k8s-version-490984
I0802 18:38:06.104529 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | unable to find current IP address of domain old-k8s-version-490984 in network mk-old-k8s-version-490984
I0802 18:38:06.104557 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | I0802 18:38:06.104494 55091 retry.go:31] will retry after 200.743574ms: waiting for machine to come up
I0802 18:38:06.307247 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has defined MAC address 52:54:00:e1:cb:7a in network mk-old-k8s-version-490984
I0802 18:38:06.307789 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | unable to find current IP address of domain old-k8s-version-490984 in network mk-old-k8s-version-490984
I0802 18:38:06.307819 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | I0802 18:38:06.307738 55091 retry.go:31] will retry after 286.61482ms: waiting for machine to come up
I0802 18:38:06.596392 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has defined MAC address 52:54:00:e1:cb:7a in network mk-old-k8s-version-490984
I0802 18:38:06.596999 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | unable to find current IP address of domain old-k8s-version-490984 in network mk-old-k8s-version-490984
I0802 18:38:06.597031 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | I0802 18:38:06.596945 55091 retry.go:31] will retry after 481.775764ms: waiting for machine to come up
I0802 18:38:07.080880 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has defined MAC address 52:54:00:e1:cb:7a in network mk-old-k8s-version-490984
I0802 18:38:07.081432 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | unable to find current IP address of domain old-k8s-version-490984 in network mk-old-k8s-version-490984
I0802 18:38:07.081459 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | I0802 18:38:07.081382 55091 retry.go:31] will retry after 412.019681ms: waiting for machine to come up
I0802 18:38:07.494918 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has defined MAC address 52:54:00:e1:cb:7a in network mk-old-k8s-version-490984
I0802 18:38:07.495616 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | unable to find current IP address of domain old-k8s-version-490984 in network mk-old-k8s-version-490984
I0802 18:38:07.495650 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | I0802 18:38:07.495540 55091 retry.go:31] will retry after 489.690456ms: waiting for machine to come up
I0802 18:38:07.987540 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has defined MAC address 52:54:00:e1:cb:7a in network mk-old-k8s-version-490984
I0802 18:38:07.988129 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | unable to find current IP address of domain old-k8s-version-490984 in network mk-old-k8s-version-490984
I0802 18:38:07.988158 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | I0802 18:38:07.988074 55091 retry.go:31] will retry after 942.202461ms: waiting for machine to come up
I0802 18:38:08.931779 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has defined MAC address 52:54:00:e1:cb:7a in network mk-old-k8s-version-490984
I0802 18:38:08.932302 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | unable to find current IP address of domain old-k8s-version-490984 in network mk-old-k8s-version-490984
I0802 18:38:08.932355 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | I0802 18:38:08.932252 55091 retry.go:31] will retry after 753.22966ms: waiting for machine to come up
I0802 18:38:09.686608 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has defined MAC address 52:54:00:e1:cb:7a in network mk-old-k8s-version-490984
I0802 18:38:09.687131 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | unable to find current IP address of domain old-k8s-version-490984 in network mk-old-k8s-version-490984
I0802 18:38:09.687162 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | I0802 18:38:09.687054 55091 retry.go:31] will retry after 1.05305244s: waiting for machine to come up
I0802 18:38:10.742397 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has defined MAC address 52:54:00:e1:cb:7a in network mk-old-k8s-version-490984
I0802 18:38:10.742910 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | unable to find current IP address of domain old-k8s-version-490984 in network mk-old-k8s-version-490984
I0802 18:38:10.742938 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | I0802 18:38:10.742856 55091 retry.go:31] will retry after 1.721802312s: waiting for machine to come up
I0802 18:38:12.466890 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has defined MAC address 52:54:00:e1:cb:7a in network mk-old-k8s-version-490984
I0802 18:38:12.467411 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | unable to find current IP address of domain old-k8s-version-490984 in network mk-old-k8s-version-490984
I0802 18:38:12.467433 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | I0802 18:38:12.467345 55091 retry.go:31] will retry after 1.772623648s: waiting for machine to come up
I0802 18:38:14.241209 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has defined MAC address 52:54:00:e1:cb:7a in network mk-old-k8s-version-490984
I0802 18:38:14.241794 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | unable to find current IP address of domain old-k8s-version-490984 in network mk-old-k8s-version-490984
I0802 18:38:14.241815 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | I0802 18:38:14.241729 55091 retry.go:31] will retry after 2.14047955s: waiting for machine to come up
I0802 18:38:16.384395 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has defined MAC address 52:54:00:e1:cb:7a in network mk-old-k8s-version-490984
I0802 18:38:16.384982 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | unable to find current IP address of domain old-k8s-version-490984 in network mk-old-k8s-version-490984
I0802 18:38:16.385012 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | I0802 18:38:16.384919 55091 retry.go:31] will retry after 2.73530416s: waiting for machine to come up
I0802 18:38:19.121850 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has defined MAC address 52:54:00:e1:cb:7a in network mk-old-k8s-version-490984
I0802 18:38:19.122353 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | unable to find current IP address of domain old-k8s-version-490984 in network mk-old-k8s-version-490984
I0802 18:38:19.122378 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | I0802 18:38:19.122301 55091 retry.go:31] will retry after 4.005567122s: waiting for machine to come up
I0802 18:38:23.310821 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has defined MAC address 52:54:00:e1:cb:7a in network mk-old-k8s-version-490984
I0802 18:38:23.311199 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | unable to find current IP address of domain old-k8s-version-490984 in network mk-old-k8s-version-490984
I0802 18:38:23.311228 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | I0802 18:38:23.311161 55091 retry.go:31] will retry after 5.111276832s: waiting for machine to come up
I0802 18:38:28.427548 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has defined MAC address 52:54:00:e1:cb:7a in network mk-old-k8s-version-490984
I0802 18:38:28.428243 54981 main.go:141] libmachine: (old-k8s-version-490984) Found IP for machine: 192.168.50.104
I0802 18:38:28.428270 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has current primary IP address 192.168.50.104 and MAC address 52:54:00:e1:cb:7a in network mk-old-k8s-version-490984
I0802 18:38:28.428278 54981 main.go:141] libmachine: (old-k8s-version-490984) Reserving static IP address...
I0802 18:38:28.428722 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-490984", mac: "52:54:00:e1:cb:7a", ip: "192.168.50.104"} in network mk-old-k8s-version-490984
I0802 18:38:28.504964 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | Getting to WaitForSSH function...
I0802 18:38:28.504993 54981 main.go:141] libmachine: (old-k8s-version-490984) Reserved static IP address: 192.168.50.104
I0802 18:38:28.505005 54981 main.go:141] libmachine: (old-k8s-version-490984) Waiting for SSH to be available...
I0802 18:38:28.507648 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has defined MAC address 52:54:00:e1:cb:7a in network mk-old-k8s-version-490984
I0802 18:38:28.508032 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:cb:7a", ip: ""} in network mk-old-k8s-version-490984: {Iface:virbr2 ExpiryTime:2024-08-02 19:38:18 +0000 UTC Type:0 Mac:52:54:00:e1:cb:7a Iaid: IPaddr:192.168.50.104 Prefix:24 Hostname:minikube Clientid:01:52:54:00:e1:cb:7a}
I0802 18:38:28.508065 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has defined IP address 192.168.50.104 and MAC address 52:54:00:e1:cb:7a in network mk-old-k8s-version-490984
I0802 18:38:28.508258 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | Using SSH client type: external
I0802 18:38:28.508286 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | Using SSH private key: /home/jenkins/minikube-integration/19355-5397/.minikube/machines/old-k8s-version-490984/id_rsa (-rw-------)
I0802 18:38:28.508335 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.50.104 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19355-5397/.minikube/machines/old-k8s-version-490984/id_rsa -p 22] /usr/bin/ssh <nil>}
I0802 18:38:28.508354 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | About to run SSH command:
I0802 18:38:28.508367 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | exit 0
I0802 18:38:28.626970 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | SSH cmd err, output: <nil>:
I0802 18:38:28.627278 54981 main.go:141] libmachine: (old-k8s-version-490984) KVM machine creation complete!
I0802 18:38:28.627519 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetConfigRaw
I0802 18:38:28.628065 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .DriverName
I0802 18:38:28.628250 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .DriverName
I0802 18:38:28.628441 54981 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0802 18:38:28.628460 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetState
I0802 18:38:28.629583 54981 main.go:141] libmachine: Detecting operating system of created instance...
I0802 18:38:28.629599 54981 main.go:141] libmachine: Waiting for SSH to be available...
I0802 18:38:28.629607 54981 main.go:141] libmachine: Getting to WaitForSSH function...
I0802 18:38:28.629614 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetSSHHostname
I0802 18:38:28.632367 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has defined MAC address 52:54:00:e1:cb:7a in network mk-old-k8s-version-490984
I0802 18:38:28.632689 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:cb:7a", ip: ""} in network mk-old-k8s-version-490984: {Iface:virbr2 ExpiryTime:2024-08-02 19:38:18 +0000 UTC Type:0 Mac:52:54:00:e1:cb:7a Iaid: IPaddr:192.168.50.104 Prefix:24 Hostname:old-k8s-version-490984 Clientid:01:52:54:00:e1:cb:7a}
I0802 18:38:28.632709 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has defined IP address 192.168.50.104 and MAC address 52:54:00:e1:cb:7a in network mk-old-k8s-version-490984
I0802 18:38:28.632850 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetSSHPort
I0802 18:38:28.633045 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetSSHKeyPath
I0802 18:38:28.633196 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetSSHKeyPath
I0802 18:38:28.633341 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetSSHUsername
I0802 18:38:28.633518 54981 main.go:141] libmachine: Using SSH client type: native
I0802 18:38:28.633726 54981 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.50.104 22 <nil> <nil>}
I0802 18:38:28.633739 54981 main.go:141] libmachine: About to run SSH command:
exit 0
I0802 18:38:28.730337 54981 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0802 18:38:28.730362 54981 main.go:141] libmachine: Detecting the provisioner...
I0802 18:38:28.730370 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetSSHHostname
I0802 18:38:28.733107 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has defined MAC address 52:54:00:e1:cb:7a in network mk-old-k8s-version-490984
I0802 18:38:28.733447 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:cb:7a", ip: ""} in network mk-old-k8s-version-490984: {Iface:virbr2 ExpiryTime:2024-08-02 19:38:18 +0000 UTC Type:0 Mac:52:54:00:e1:cb:7a Iaid: IPaddr:192.168.50.104 Prefix:24 Hostname:old-k8s-version-490984 Clientid:01:52:54:00:e1:cb:7a}
I0802 18:38:28.733489 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has defined IP address 192.168.50.104 and MAC address 52:54:00:e1:cb:7a in network mk-old-k8s-version-490984
I0802 18:38:28.733612 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetSSHPort
I0802 18:38:28.733847 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetSSHKeyPath
I0802 18:38:28.734010 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetSSHKeyPath
I0802 18:38:28.734170 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetSSHUsername
I0802 18:38:28.734325 54981 main.go:141] libmachine: Using SSH client type: native
I0802 18:38:28.734507 54981 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.50.104 22 <nil> <nil>}
I0802 18:38:28.734521 54981 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0802 18:38:28.835553 54981 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0802 18:38:28.835660 54981 main.go:141] libmachine: found compatible host: buildroot
I0802 18:38:28.835670 54981 main.go:141] libmachine: Provisioning with buildroot...
I0802 18:38:28.835681 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetMachineName
I0802 18:38:28.835948 54981 buildroot.go:166] provisioning hostname "old-k8s-version-490984"
I0802 18:38:28.835979 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetMachineName
I0802 18:38:28.836151 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetSSHHostname
I0802 18:38:28.838738 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has defined MAC address 52:54:00:e1:cb:7a in network mk-old-k8s-version-490984
I0802 18:38:28.839076 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:cb:7a", ip: ""} in network mk-old-k8s-version-490984: {Iface:virbr2 ExpiryTime:2024-08-02 19:38:18 +0000 UTC Type:0 Mac:52:54:00:e1:cb:7a Iaid: IPaddr:192.168.50.104 Prefix:24 Hostname:old-k8s-version-490984 Clientid:01:52:54:00:e1:cb:7a}
I0802 18:38:28.839094 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has defined IP address 192.168.50.104 and MAC address 52:54:00:e1:cb:7a in network mk-old-k8s-version-490984
I0802 18:38:28.839269 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetSSHPort
I0802 18:38:28.839446 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetSSHKeyPath
I0802 18:38:28.839679 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetSSHKeyPath
I0802 18:38:28.839850 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetSSHUsername
I0802 18:38:28.840039 54981 main.go:141] libmachine: Using SSH client type: native
I0802 18:38:28.840237 54981 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.50.104 22 <nil> <nil>}
I0802 18:38:28.840257 54981 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-490984 && echo "old-k8s-version-490984" | sudo tee /etc/hostname
I0802 18:38:28.948970 54981 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-490984
I0802 18:38:28.949004 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetSSHHostname
I0802 18:38:28.951665 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has defined MAC address 52:54:00:e1:cb:7a in network mk-old-k8s-version-490984
I0802 18:38:28.952057 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:cb:7a", ip: ""} in network mk-old-k8s-version-490984: {Iface:virbr2 ExpiryTime:2024-08-02 19:38:18 +0000 UTC Type:0 Mac:52:54:00:e1:cb:7a Iaid: IPaddr:192.168.50.104 Prefix:24 Hostname:old-k8s-version-490984 Clientid:01:52:54:00:e1:cb:7a}
I0802 18:38:28.952092 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has defined IP address 192.168.50.104 and MAC address 52:54:00:e1:cb:7a in network mk-old-k8s-version-490984
I0802 18:38:28.952154 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetSSHPort
I0802 18:38:28.952414 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetSSHKeyPath
I0802 18:38:28.952596 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetSSHKeyPath
I0802 18:38:28.952715 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetSSHUsername
I0802 18:38:28.952871 54981 main.go:141] libmachine: Using SSH client type: native
I0802 18:38:28.953039 54981 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.50.104 22 <nil> <nil>}
I0802 18:38:28.953057 54981 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-490984' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-490984/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-490984' | sudo tee -a /etc/hosts;
fi
fi
I0802 18:38:29.059542 54981 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0802 18:38:29.059602 54981 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19355-5397/.minikube CaCertPath:/home/jenkins/minikube-integration/19355-5397/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19355-5397/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19355-5397/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19355-5397/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19355-5397/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19355-5397/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19355-5397/.minikube}
I0802 18:38:29.059625 54981 buildroot.go:174] setting up certificates
I0802 18:38:29.059636 54981 provision.go:84] configureAuth start
I0802 18:38:29.059650 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetMachineName
I0802 18:38:29.059987 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetIP
I0802 18:38:29.062548 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has defined MAC address 52:54:00:e1:cb:7a in network mk-old-k8s-version-490984
I0802 18:38:29.062818 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:cb:7a", ip: ""} in network mk-old-k8s-version-490984: {Iface:virbr2 ExpiryTime:2024-08-02 19:38:18 +0000 UTC Type:0 Mac:52:54:00:e1:cb:7a Iaid: IPaddr:192.168.50.104 Prefix:24 Hostname:old-k8s-version-490984 Clientid:01:52:54:00:e1:cb:7a}
I0802 18:38:29.062863 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has defined IP address 192.168.50.104 and MAC address 52:54:00:e1:cb:7a in network mk-old-k8s-version-490984
I0802 18:38:29.062935 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetSSHHostname
I0802 18:38:29.065241 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has defined MAC address 52:54:00:e1:cb:7a in network mk-old-k8s-version-490984
I0802 18:38:29.065535 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:cb:7a", ip: ""} in network mk-old-k8s-version-490984: {Iface:virbr2 ExpiryTime:2024-08-02 19:38:18 +0000 UTC Type:0 Mac:52:54:00:e1:cb:7a Iaid: IPaddr:192.168.50.104 Prefix:24 Hostname:old-k8s-version-490984 Clientid:01:52:54:00:e1:cb:7a}
I0802 18:38:29.065560 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has defined IP address 192.168.50.104 and MAC address 52:54:00:e1:cb:7a in network mk-old-k8s-version-490984
I0802 18:38:29.065699 54981 provision.go:143] copyHostCerts
I0802 18:38:29.065756 54981 exec_runner.go:144] found /home/jenkins/minikube-integration/19355-5397/.minikube/key.pem, removing ...
I0802 18:38:29.065768 54981 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19355-5397/.minikube/key.pem
I0802 18:38:29.065836 54981 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19355-5397/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19355-5397/.minikube/key.pem (1679 bytes)
I0802 18:38:29.065953 54981 exec_runner.go:144] found /home/jenkins/minikube-integration/19355-5397/.minikube/ca.pem, removing ...
I0802 18:38:29.065964 54981 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19355-5397/.minikube/ca.pem
I0802 18:38:29.065999 54981 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19355-5397/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19355-5397/.minikube/ca.pem (1078 bytes)
I0802 18:38:29.066086 54981 exec_runner.go:144] found /home/jenkins/minikube-integration/19355-5397/.minikube/cert.pem, removing ...
I0802 18:38:29.066096 54981 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19355-5397/.minikube/cert.pem
I0802 18:38:29.066126 54981 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19355-5397/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19355-5397/.minikube/cert.pem (1123 bytes)
I0802 18:38:29.066199 54981 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19355-5397/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19355-5397/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19355-5397/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-490984 san=[127.0.0.1 192.168.50.104 localhost minikube old-k8s-version-490984]
I0802 18:38:29.108630 54981 provision.go:177] copyRemoteCerts
I0802 18:38:29.108702 54981 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0802 18:38:29.108735 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetSSHHostname
I0802 18:38:29.111543 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has defined MAC address 52:54:00:e1:cb:7a in network mk-old-k8s-version-490984
I0802 18:38:29.111882 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:cb:7a", ip: ""} in network mk-old-k8s-version-490984: {Iface:virbr2 ExpiryTime:2024-08-02 19:38:18 +0000 UTC Type:0 Mac:52:54:00:e1:cb:7a Iaid: IPaddr:192.168.50.104 Prefix:24 Hostname:old-k8s-version-490984 Clientid:01:52:54:00:e1:cb:7a}
I0802 18:38:29.111918 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has defined IP address 192.168.50.104 and MAC address 52:54:00:e1:cb:7a in network mk-old-k8s-version-490984
I0802 18:38:29.112046 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetSSHPort
I0802 18:38:29.112232 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetSSHKeyPath
I0802 18:38:29.112371 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetSSHUsername
I0802 18:38:29.112507 54981 sshutil.go:53] new ssh client: &{IP:192.168.50.104 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19355-5397/.minikube/machines/old-k8s-version-490984/id_rsa Username:docker}
I0802 18:38:29.192695 54981 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19355-5397/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0802 18:38:29.218435 54981 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19355-5397/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0802 18:38:29.242236 54981 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19355-5397/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0802 18:38:29.264787 54981 provision.go:87] duration metric: took 205.138681ms to configureAuth
I0802 18:38:29.264816 54981 buildroot.go:189] setting minikube options for container-runtime
I0802 18:38:29.264976 54981 config.go:182] Loaded profile config "old-k8s-version-490984": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0802 18:38:29.265058 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetSSHHostname
I0802 18:38:29.268190 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has defined MAC address 52:54:00:e1:cb:7a in network mk-old-k8s-version-490984
I0802 18:38:29.268611 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:cb:7a", ip: ""} in network mk-old-k8s-version-490984: {Iface:virbr2 ExpiryTime:2024-08-02 19:38:18 +0000 UTC Type:0 Mac:52:54:00:e1:cb:7a Iaid: IPaddr:192.168.50.104 Prefix:24 Hostname:old-k8s-version-490984 Clientid:01:52:54:00:e1:cb:7a}
I0802 18:38:29.268634 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has defined IP address 192.168.50.104 and MAC address 52:54:00:e1:cb:7a in network mk-old-k8s-version-490984
I0802 18:38:29.268848 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetSSHPort
I0802 18:38:29.269055 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetSSHKeyPath
I0802 18:38:29.269217 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetSSHKeyPath
I0802 18:38:29.269384 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetSSHUsername
I0802 18:38:29.269542 54981 main.go:141] libmachine: Using SSH client type: native
I0802 18:38:29.269691 54981 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.50.104 22 <nil> <nil>}
I0802 18:38:29.269707 54981 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0802 18:38:29.549718 54981 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0802 18:38:29.549748 54981 main.go:141] libmachine: Checking connection to Docker...
I0802 18:38:29.549760 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetURL
I0802 18:38:29.551060 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | Using libvirt version 6000000
I0802 18:38:29.553433 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has defined MAC address 52:54:00:e1:cb:7a in network mk-old-k8s-version-490984
I0802 18:38:29.553787 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:cb:7a", ip: ""} in network mk-old-k8s-version-490984: {Iface:virbr2 ExpiryTime:2024-08-02 19:38:18 +0000 UTC Type:0 Mac:52:54:00:e1:cb:7a Iaid: IPaddr:192.168.50.104 Prefix:24 Hostname:old-k8s-version-490984 Clientid:01:52:54:00:e1:cb:7a}
I0802 18:38:29.553814 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has defined IP address 192.168.50.104 and MAC address 52:54:00:e1:cb:7a in network mk-old-k8s-version-490984
I0802 18:38:29.553988 54981 main.go:141] libmachine: Docker is up and running!
I0802 18:38:29.554005 54981 main.go:141] libmachine: Reticulating splines...
I0802 18:38:29.554013 54981 client.go:171] duration metric: took 25.621627977s to LocalClient.Create
I0802 18:38:29.554037 54981 start.go:167] duration metric: took 25.621701227s to libmachine.API.Create "old-k8s-version-490984"
I0802 18:38:29.554049 54981 start.go:293] postStartSetup for "old-k8s-version-490984" (driver="kvm2")
I0802 18:38:29.554061 54981 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0802 18:38:29.554096 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .DriverName
I0802 18:38:29.554355 54981 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0802 18:38:29.554387 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetSSHHostname
I0802 18:38:29.556482 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has defined MAC address 52:54:00:e1:cb:7a in network mk-old-k8s-version-490984
I0802 18:38:29.556793 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:cb:7a", ip: ""} in network mk-old-k8s-version-490984: {Iface:virbr2 ExpiryTime:2024-08-02 19:38:18 +0000 UTC Type:0 Mac:52:54:00:e1:cb:7a Iaid: IPaddr:192.168.50.104 Prefix:24 Hostname:old-k8s-version-490984 Clientid:01:52:54:00:e1:cb:7a}
I0802 18:38:29.556821 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has defined IP address 192.168.50.104 and MAC address 52:54:00:e1:cb:7a in network mk-old-k8s-version-490984
I0802 18:38:29.557007 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetSSHPort
I0802 18:38:29.557197 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetSSHKeyPath
I0802 18:38:29.557357 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetSSHUsername
I0802 18:38:29.557513 54981 sshutil.go:53] new ssh client: &{IP:192.168.50.104 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19355-5397/.minikube/machines/old-k8s-version-490984/id_rsa Username:docker}
I0802 18:38:29.636984 54981 ssh_runner.go:195] Run: cat /etc/os-release
I0802 18:38:29.641086 54981 info.go:137] Remote host: Buildroot 2023.02.9
I0802 18:38:29.641107 54981 filesync.go:126] Scanning /home/jenkins/minikube-integration/19355-5397/.minikube/addons for local assets ...
I0802 18:38:29.641159 54981 filesync.go:126] Scanning /home/jenkins/minikube-integration/19355-5397/.minikube/files for local assets ...
I0802 18:38:29.641231 54981 filesync.go:149] local asset: /home/jenkins/minikube-integration/19355-5397/.minikube/files/etc/ssl/certs/125472.pem -> 125472.pem in /etc/ssl/certs
I0802 18:38:29.641318 54981 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0802 18:38:29.649629 54981 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19355-5397/.minikube/files/etc/ssl/certs/125472.pem --> /etc/ssl/certs/125472.pem (1708 bytes)
I0802 18:38:29.672098 54981 start.go:296] duration metric: took 118.034286ms for postStartSetup
I0802 18:38:29.672154 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetConfigRaw
I0802 18:38:29.672722 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetIP
I0802 18:38:29.675304 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has defined MAC address 52:54:00:e1:cb:7a in network mk-old-k8s-version-490984
I0802 18:38:29.675692 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:cb:7a", ip: ""} in network mk-old-k8s-version-490984: {Iface:virbr2 ExpiryTime:2024-08-02 19:38:18 +0000 UTC Type:0 Mac:52:54:00:e1:cb:7a Iaid: IPaddr:192.168.50.104 Prefix:24 Hostname:old-k8s-version-490984 Clientid:01:52:54:00:e1:cb:7a}
I0802 18:38:29.675723 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has defined IP address 192.168.50.104 and MAC address 52:54:00:e1:cb:7a in network mk-old-k8s-version-490984
I0802 18:38:29.675948 54981 profile.go:143] Saving config to /home/jenkins/minikube-integration/19355-5397/.minikube/profiles/old-k8s-version-490984/config.json ...
I0802 18:38:29.676181 54981 start.go:128] duration metric: took 25.764227127s to createHost
I0802 18:38:29.676210 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetSSHHostname
I0802 18:38:29.678090 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has defined MAC address 52:54:00:e1:cb:7a in network mk-old-k8s-version-490984
I0802 18:38:29.678435 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:cb:7a", ip: ""} in network mk-old-k8s-version-490984: {Iface:virbr2 ExpiryTime:2024-08-02 19:38:18 +0000 UTC Type:0 Mac:52:54:00:e1:cb:7a Iaid: IPaddr:192.168.50.104 Prefix:24 Hostname:old-k8s-version-490984 Clientid:01:52:54:00:e1:cb:7a}
I0802 18:38:29.678457 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has defined IP address 192.168.50.104 and MAC address 52:54:00:e1:cb:7a in network mk-old-k8s-version-490984
I0802 18:38:29.678619 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetSSHPort
I0802 18:38:29.678810 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetSSHKeyPath
I0802 18:38:29.679028 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetSSHKeyPath
I0802 18:38:29.679198 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetSSHUsername
I0802 18:38:29.679365 54981 main.go:141] libmachine: Using SSH client type: native
I0802 18:38:29.679574 54981 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.50.104 22 <nil> <nil>}
I0802 18:38:29.679587 54981 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0802 18:38:29.779792 54981 main.go:141] libmachine: SSH cmd err, output: <nil>: 1722623909.747301795
I0802 18:38:29.779832 54981 fix.go:216] guest clock: 1722623909.747301795
I0802 18:38:29.779844 54981 fix.go:229] Guest: 2024-08-02 18:38:29.747301795 +0000 UTC Remote: 2024-08-02 18:38:29.67619577 +0000 UTC m=+39.671259676 (delta=71.106025ms)
I0802 18:38:29.779871 54981 fix.go:200] guest clock delta is within tolerance: 71.106025ms
I0802 18:38:29.779879 54981 start.go:83] releasing machines lock for "old-k8s-version-490984", held for 25.868128343s
I0802 18:38:29.779913 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .DriverName
I0802 18:38:29.780177 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetIP
I0802 18:38:29.783065 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has defined MAC address 52:54:00:e1:cb:7a in network mk-old-k8s-version-490984
I0802 18:38:29.783494 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:cb:7a", ip: ""} in network mk-old-k8s-version-490984: {Iface:virbr2 ExpiryTime:2024-08-02 19:38:18 +0000 UTC Type:0 Mac:52:54:00:e1:cb:7a Iaid: IPaddr:192.168.50.104 Prefix:24 Hostname:old-k8s-version-490984 Clientid:01:52:54:00:e1:cb:7a}
I0802 18:38:29.783526 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has defined IP address 192.168.50.104 and MAC address 52:54:00:e1:cb:7a in network mk-old-k8s-version-490984
I0802 18:38:29.783657 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .DriverName
I0802 18:38:29.784296 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .DriverName
I0802 18:38:29.784489 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .DriverName
I0802 18:38:29.784589 54981 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0802 18:38:29.784635 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetSSHHostname
I0802 18:38:29.784722 54981 ssh_runner.go:195] Run: cat /version.json
I0802 18:38:29.784748 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetSSHHostname
I0802 18:38:29.787143 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has defined MAC address 52:54:00:e1:cb:7a in network mk-old-k8s-version-490984
I0802 18:38:29.787571 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:cb:7a", ip: ""} in network mk-old-k8s-version-490984: {Iface:virbr2 ExpiryTime:2024-08-02 19:38:18 +0000 UTC Type:0 Mac:52:54:00:e1:cb:7a Iaid: IPaddr:192.168.50.104 Prefix:24 Hostname:old-k8s-version-490984 Clientid:01:52:54:00:e1:cb:7a}
I0802 18:38:29.787606 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has defined IP address 192.168.50.104 and MAC address 52:54:00:e1:cb:7a in network mk-old-k8s-version-490984
I0802 18:38:29.787819 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetSSHPort
I0802 18:38:29.788004 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetSSHKeyPath
I0802 18:38:29.788004 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has defined MAC address 52:54:00:e1:cb:7a in network mk-old-k8s-version-490984
I0802 18:38:29.788173 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetSSHUsername
I0802 18:38:29.788330 54981 sshutil.go:53] new ssh client: &{IP:192.168.50.104 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19355-5397/.minikube/machines/old-k8s-version-490984/id_rsa Username:docker}
I0802 18:38:29.788347 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:cb:7a", ip: ""} in network mk-old-k8s-version-490984: {Iface:virbr2 ExpiryTime:2024-08-02 19:38:18 +0000 UTC Type:0 Mac:52:54:00:e1:cb:7a Iaid: IPaddr:192.168.50.104 Prefix:24 Hostname:old-k8s-version-490984 Clientid:01:52:54:00:e1:cb:7a}
I0802 18:38:29.788372 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has defined IP address 192.168.50.104 and MAC address 52:54:00:e1:cb:7a in network mk-old-k8s-version-490984
I0802 18:38:29.788522 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetSSHPort
I0802 18:38:29.788659 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetSSHKeyPath
I0802 18:38:29.788834 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetSSHUsername
I0802 18:38:29.788990 54981 sshutil.go:53] new ssh client: &{IP:192.168.50.104 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19355-5397/.minikube/machines/old-k8s-version-490984/id_rsa Username:docker}
I0802 18:38:29.900731 54981 ssh_runner.go:195] Run: systemctl --version
I0802 18:38:29.906486 54981 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0802 18:38:30.057519 54981 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0802 18:38:30.063539 54981 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0802 18:38:30.063622 54981 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0802 18:38:30.078575 54981 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0802 18:38:30.078609 54981 start.go:495] detecting cgroup driver to use...
I0802 18:38:30.078674 54981 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0802 18:38:30.095764 54981 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0802 18:38:30.111531 54981 docker.go:217] disabling cri-docker service (if available) ...
I0802 18:38:30.111575 54981 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0802 18:38:30.126798 54981 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0802 18:38:30.141307 54981 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0802 18:38:30.267611 54981 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0802 18:38:30.418494 54981 docker.go:233] disabling docker service ...
I0802 18:38:30.418570 54981 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0802 18:38:30.433962 54981 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0802 18:38:30.452382 54981 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0802 18:38:30.577261 54981 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0802 18:38:30.708783 54981 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0802 18:38:30.723206 54981 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0802 18:38:30.740963 54981 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0802 18:38:30.741034 54981 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0802 18:38:30.751036 54981 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0802 18:38:30.751141 54981 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0802 18:38:30.761038 54981 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0802 18:38:30.771159 54981 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0802 18:38:30.781727 54981 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0802 18:38:30.791998 54981 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0802 18:38:30.801648 54981 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0802 18:38:30.801707 54981 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0802 18:38:30.817710 54981 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0802 18:38:30.828644 54981 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0802 18:38:30.957522 54981 ssh_runner.go:195] Run: sudo systemctl restart crio
I0802 18:38:31.099407 54981 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0802 18:38:31.099489 54981 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0802 18:38:31.104718 54981 start.go:563] Will wait 60s for crictl version
I0802 18:38:31.104792 54981 ssh_runner.go:195] Run: which crictl
I0802 18:38:31.108487 54981 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0802 18:38:31.151632 54981 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0802 18:38:31.151735 54981 ssh_runner.go:195] Run: crio --version
I0802 18:38:31.180325 54981 ssh_runner.go:195] Run: crio --version
I0802 18:38:31.209395 54981 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0802 18:38:31.210819 54981 main.go:141] libmachine: (old-k8s-version-490984) Calling .GetIP
I0802 18:38:31.213991 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has defined MAC address 52:54:00:e1:cb:7a in network mk-old-k8s-version-490984
I0802 18:38:31.214400 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e1:cb:7a", ip: ""} in network mk-old-k8s-version-490984: {Iface:virbr2 ExpiryTime:2024-08-02 19:38:18 +0000 UTC Type:0 Mac:52:54:00:e1:cb:7a Iaid: IPaddr:192.168.50.104 Prefix:24 Hostname:old-k8s-version-490984 Clientid:01:52:54:00:e1:cb:7a}
I0802 18:38:31.214431 54981 main.go:141] libmachine: (old-k8s-version-490984) DBG | domain old-k8s-version-490984 has defined IP address 192.168.50.104 and MAC address 52:54:00:e1:cb:7a in network mk-old-k8s-version-490984
I0802 18:38:31.214687 54981 ssh_runner.go:195] Run: grep 192.168.50.1 host.minikube.internal$ /etc/hosts
I0802 18:38:31.218678 54981 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.50.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0802 18:38:31.230821 54981 kubeadm.go:883] updating cluster {Name:old-k8s-version-490984 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19355/minikube-v1.33.1-1722420371-19355-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-490984 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.104 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] M
ountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0802 18:38:31.230947 54981 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0802 18:38:31.230996 54981 ssh_runner.go:195] Run: sudo crictl images --output json
I0802 18:38:31.267435 54981 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0802 18:38:31.267517 54981 ssh_runner.go:195] Run: which lz4
I0802 18:38:31.272331 54981 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0802 18:38:31.277317 54981 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0802 18:38:31.277354 54981 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19355-5397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0802 18:38:32.761021 54981 crio.go:462] duration metric: took 1.488737357s to copy over tarball
I0802 18:38:32.761088 54981 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0802 18:38:35.280502 54981 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.519386928s)
I0802 18:38:35.280537 54981 crio.go:469] duration metric: took 2.519488566s to extract the tarball
I0802 18:38:35.280547 54981 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0802 18:38:35.322670 54981 ssh_runner.go:195] Run: sudo crictl images --output json
I0802 18:38:35.367761 54981 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0802 18:38:35.367790 54981 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0802 18:38:35.367866 54981 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0802 18:38:35.367889 54981 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0802 18:38:35.367941 54981 image.go:134] retrieving image: registry.k8s.io/pause:3.2
I0802 18:38:35.367950 54981 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0802 18:38:35.367991 54981 image.go:134] retrieving image: registry.k8s.io/coredns:1.7.0
I0802 18:38:35.367891 54981 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0802 18:38:35.367869 54981 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0802 18:38:35.368102 54981 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0802 18:38:35.369825 54981 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0802 18:38:35.370030 54981 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0802 18:38:35.370128 54981 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0802 18:38:35.370328 54981 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0802 18:38:35.370461 54981 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0802 18:38:35.370681 54981 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0802 18:38:35.370806 54981 image.go:177] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0802 18:38:35.370967 54981 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0802 18:38:35.605208 54981 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0802 18:38:35.632341 54981 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0802 18:38:35.637233 54981 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0802 18:38:35.642401 54981 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0802 18:38:35.647786 54981 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0802 18:38:35.647831 54981 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0802 18:38:35.647874 54981 ssh_runner.go:195] Run: which crictl
I0802 18:38:35.649829 54981 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0802 18:38:35.662003 54981 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0802 18:38:35.691063 54981 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0802 18:38:35.742909 54981 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0802 18:38:35.742961 54981 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0802 18:38:35.742963 54981 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0802 18:38:35.742994 54981 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0802 18:38:35.743018 54981 ssh_runner.go:195] Run: which crictl
I0802 18:38:35.743176 54981 ssh_runner.go:195] Run: which crictl
I0802 18:38:35.756101 54981 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0802 18:38:35.756152 54981 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0802 18:38:35.756157 54981 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0802 18:38:35.756192 54981 ssh_runner.go:195] Run: which crictl
I0802 18:38:35.801794 54981 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0802 18:38:35.801815 54981 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0802 18:38:35.801840 54981 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0802 18:38:35.801849 54981 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0802 18:38:35.801889 54981 ssh_runner.go:195] Run: which crictl
I0802 18:38:35.801893 54981 ssh_runner.go:195] Run: which crictl
I0802 18:38:35.801934 54981 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0802 18:38:35.801962 54981 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0802 18:38:35.802000 54981 ssh_runner.go:195] Run: which crictl
I0802 18:38:35.802005 54981 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0802 18:38:35.802000 54981 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0802 18:38:35.830911 54981 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0802 18:38:35.830956 54981 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19355-5397/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0802 18:38:35.830959 54981 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0802 18:38:35.831023 54981 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0802 18:38:35.926490 54981 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19355-5397/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0802 18:38:35.926576 54981 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0802 18:38:35.926593 54981 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19355-5397/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0802 18:38:35.926639 54981 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19355-5397/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0802 18:38:35.944087 54981 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19355-5397/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0802 18:38:35.944134 54981 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19355-5397/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0802 18:38:35.963198 54981 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19355-5397/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0802 18:38:36.253937 54981 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0802 18:38:36.396468 54981 cache_images.go:92] duration metric: took 1.028656858s to LoadCachedImages
W0802 18:38:36.396576 54981 out.go:239] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19355-5397/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19355-5397/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2: no such file or directory
I0802 18:38:36.396600 54981 kubeadm.go:934] updating node { 192.168.50.104 8443 v1.20.0 crio true true} ...
I0802 18:38:36.396708 54981 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-490984 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.50.104
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-490984 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0802 18:38:36.396790 54981 ssh_runner.go:195] Run: crio config
I0802 18:38:36.446634 54981 cni.go:84] Creating CNI manager for ""
I0802 18:38:36.446659 54981 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0802 18:38:36.446671 54981 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0802 18:38:36.446694 54981 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.50.104 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-490984 NodeName:old-k8s-version-490984 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.50.104"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.50.104 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0802 18:38:36.446867 54981 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.50.104
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-490984"
kubeletExtraArgs:
node-ip: 192.168.50.104
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.50.104"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0802 18:38:36.446939 54981 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0802 18:38:36.457063 54981 binaries.go:44] Found k8s binaries, skipping transfer
I0802 18:38:36.457151 54981 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0802 18:38:36.466741 54981 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0802 18:38:36.483482 54981 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0802 18:38:36.504586 54981 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0802 18:38:36.520921 54981 ssh_runner.go:195] Run: grep 192.168.50.104 control-plane.minikube.internal$ /etc/hosts
I0802 18:38:36.524505 54981 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.50.104 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0802 18:38:36.535830 54981 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0802 18:38:36.657010 54981 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0802 18:38:36.675436 54981 certs.go:68] Setting up /home/jenkins/minikube-integration/19355-5397/.minikube/profiles/old-k8s-version-490984 for IP: 192.168.50.104
I0802 18:38:36.675465 54981 certs.go:194] generating shared ca certs ...
I0802 18:38:36.675484 54981 certs.go:226] acquiring lock for ca certs: {Name:mk19e8091201ede09cfac599bd89999226caf146 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0802 18:38:36.675641 54981 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19355-5397/.minikube/ca.key
I0802 18:38:36.675690 54981 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19355-5397/.minikube/proxy-client-ca.key
I0802 18:38:36.675704 54981 certs.go:256] generating profile certs ...
I0802 18:38:36.675772 54981 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19355-5397/.minikube/profiles/old-k8s-version-490984/client.key
I0802 18:38:36.675805 54981 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19355-5397/.minikube/profiles/old-k8s-version-490984/client.crt with IP's: []
I0802 18:38:37.044297 54981 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19355-5397/.minikube/profiles/old-k8s-version-490984/client.crt ...
I0802 18:38:37.044330 54981 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19355-5397/.minikube/profiles/old-k8s-version-490984/client.crt: {Name:mk5dc7d2de3249458e397031198ef23511a1d9b8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0802 18:38:37.044494 54981 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19355-5397/.minikube/profiles/old-k8s-version-490984/client.key ...
I0802 18:38:37.044508 54981 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19355-5397/.minikube/profiles/old-k8s-version-490984/client.key: {Name:mkb85a8c84c756b197b473e7ba76dfdb4d9b92ec Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0802 18:38:37.044611 54981 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19355-5397/.minikube/profiles/old-k8s-version-490984/apiserver.key.64198073
I0802 18:38:37.044629 54981 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19355-5397/.minikube/profiles/old-k8s-version-490984/apiserver.crt.64198073 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.50.104]
I0802 18:38:37.152972 54981 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19355-5397/.minikube/profiles/old-k8s-version-490984/apiserver.crt.64198073 ...
I0802 18:38:37.153006 54981 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19355-5397/.minikube/profiles/old-k8s-version-490984/apiserver.crt.64198073: {Name:mka1e7fe9d19c271a3106cd7c97889a4de25691e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0802 18:38:37.153165 54981 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19355-5397/.minikube/profiles/old-k8s-version-490984/apiserver.key.64198073 ...
I0802 18:38:37.153177 54981 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19355-5397/.minikube/profiles/old-k8s-version-490984/apiserver.key.64198073: {Name:mke7b29d3989ff50b1b448b59673de4896c22b37 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0802 18:38:37.153253 54981 certs.go:381] copying /home/jenkins/minikube-integration/19355-5397/.minikube/profiles/old-k8s-version-490984/apiserver.crt.64198073 -> /home/jenkins/minikube-integration/19355-5397/.minikube/profiles/old-k8s-version-490984/apiserver.crt
I0802 18:38:37.153329 54981 certs.go:385] copying /home/jenkins/minikube-integration/19355-5397/.minikube/profiles/old-k8s-version-490984/apiserver.key.64198073 -> /home/jenkins/minikube-integration/19355-5397/.minikube/profiles/old-k8s-version-490984/apiserver.key
I0802 18:38:37.153380 54981 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19355-5397/.minikube/profiles/old-k8s-version-490984/proxy-client.key
I0802 18:38:37.153397 54981 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19355-5397/.minikube/profiles/old-k8s-version-490984/proxy-client.crt with IP's: []
I0802 18:38:37.302690 54981 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19355-5397/.minikube/profiles/old-k8s-version-490984/proxy-client.crt ...
I0802 18:38:37.302725 54981 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19355-5397/.minikube/profiles/old-k8s-version-490984/proxy-client.crt: {Name:mkb0727b5aee4e9820438678e5a28d60e1ce458c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0802 18:38:37.302896 54981 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19355-5397/.minikube/profiles/old-k8s-version-490984/proxy-client.key ...
I0802 18:38:37.302907 54981 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19355-5397/.minikube/profiles/old-k8s-version-490984/proxy-client.key: {Name:mk9af6ac7479e428038bc11a9ab8692cf7fcb38d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0802 18:38:37.303069 54981 certs.go:484] found cert: /home/jenkins/minikube-integration/19355-5397/.minikube/certs/12547.pem (1338 bytes)
W0802 18:38:37.303125 54981 certs.go:480] ignoring /home/jenkins/minikube-integration/19355-5397/.minikube/certs/12547_empty.pem, impossibly tiny 0 bytes
I0802 18:38:37.303139 54981 certs.go:484] found cert: /home/jenkins/minikube-integration/19355-5397/.minikube/certs/ca-key.pem (1679 bytes)
I0802 18:38:37.303171 54981 certs.go:484] found cert: /home/jenkins/minikube-integration/19355-5397/.minikube/certs/ca.pem (1078 bytes)
I0802 18:38:37.303197 54981 certs.go:484] found cert: /home/jenkins/minikube-integration/19355-5397/.minikube/certs/cert.pem (1123 bytes)
I0802 18:38:37.303218 54981 certs.go:484] found cert: /home/jenkins/minikube-integration/19355-5397/.minikube/certs/key.pem (1679 bytes)
I0802 18:38:37.303259 54981 certs.go:484] found cert: /home/jenkins/minikube-integration/19355-5397/.minikube/files/etc/ssl/certs/125472.pem (1708 bytes)
I0802 18:38:37.303829 54981 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19355-5397/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0802 18:38:37.331256 54981 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19355-5397/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0802 18:38:37.355643 54981 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19355-5397/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0802 18:38:37.380655 54981 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19355-5397/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0802 18:38:37.404392 54981 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19355-5397/.minikube/profiles/old-k8s-version-490984/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0802 18:38:37.430556 54981 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19355-5397/.minikube/profiles/old-k8s-version-490984/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0802 18:38:37.455859 54981 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19355-5397/.minikube/profiles/old-k8s-version-490984/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0802 18:38:37.487576 54981 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19355-5397/.minikube/profiles/old-k8s-version-490984/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0802 18:38:37.525749 54981 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19355-5397/.minikube/certs/12547.pem --> /usr/share/ca-certificates/12547.pem (1338 bytes)
I0802 18:38:37.550198 54981 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19355-5397/.minikube/files/etc/ssl/certs/125472.pem --> /usr/share/ca-certificates/125472.pem (1708 bytes)
I0802 18:38:37.573882 54981 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19355-5397/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0802 18:38:37.598068 54981 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0802 18:38:37.614475 54981 ssh_runner.go:195] Run: openssl version
I0802 18:38:37.620390 54981 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/125472.pem && ln -fs /usr/share/ca-certificates/125472.pem /etc/ssl/certs/125472.pem"
I0802 18:38:37.631191 54981 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/125472.pem
I0802 18:38:37.635832 54981 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug 2 17:40 /usr/share/ca-certificates/125472.pem
I0802 18:38:37.635890 54981 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/125472.pem
I0802 18:38:37.641938 54981 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/125472.pem /etc/ssl/certs/3ec20f2e.0"
I0802 18:38:37.653003 54981 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0802 18:38:37.668099 54981 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0802 18:38:37.673744 54981 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug 2 17:28 /usr/share/ca-certificates/minikubeCA.pem
I0802 18:38:37.673817 54981 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0802 18:38:37.681324 54981 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0802 18:38:37.693524 54981 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/12547.pem && ln -fs /usr/share/ca-certificates/12547.pem /etc/ssl/certs/12547.pem"
I0802 18:38:37.704428 54981 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/12547.pem
I0802 18:38:37.708882 54981 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug 2 17:40 /usr/share/ca-certificates/12547.pem
I0802 18:38:37.708937 54981 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/12547.pem
I0802 18:38:37.714499 54981 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/12547.pem /etc/ssl/certs/51391683.0"
I0802 18:38:37.726031 54981 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0802 18:38:37.730912 54981 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0802 18:38:37.730966 54981 kubeadm.go:392] StartCluster: {Name:old-k8s-version-490984 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19355/minikube-v1.33.1-1722420371-19355-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-490984 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.104 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0802 18:38:37.731033 54981 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0802 18:38:37.731078 54981 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0802 18:38:37.769768 54981 cri.go:89] found id: ""
I0802 18:38:37.769848 54981 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0802 18:38:37.780226 54981 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0802 18:38:37.789805 54981 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0802 18:38:37.799364 54981 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0802 18:38:37.799392 54981 kubeadm.go:157] found existing configuration files:
I0802 18:38:37.799448 54981 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0802 18:38:37.808416 54981 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0802 18:38:37.808487 54981 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0802 18:38:37.817763 54981 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0802 18:38:37.826548 54981 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0802 18:38:37.826600 54981 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0802 18:38:37.835817 54981 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0802 18:38:37.844825 54981 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0802 18:38:37.844889 54981 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0802 18:38:37.854758 54981 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0802 18:38:37.863777 54981 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0802 18:38:37.863833 54981 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0802 18:38:37.875731 54981 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0802 18:38:38.122300 54981 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0802 18:40:35.480519 54981 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0802 18:40:35.480609 54981 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0802 18:40:35.482324 54981 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0802 18:40:35.482392 54981 kubeadm.go:310] [preflight] Running pre-flight checks
I0802 18:40:35.482487 54981 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0802 18:40:35.482613 54981 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0802 18:40:35.482757 54981 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0802 18:40:35.482816 54981 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0802 18:40:35.484563 54981 out.go:204] - Generating certificates and keys ...
I0802 18:40:35.484644 54981 kubeadm.go:310] [certs] Using existing ca certificate authority
I0802 18:40:35.484722 54981 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0802 18:40:35.484812 54981 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0802 18:40:35.484892 54981 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0802 18:40:35.484973 54981 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0802 18:40:35.485040 54981 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0802 18:40:35.485115 54981 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0802 18:40:35.485306 54981 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-490984] and IPs [192.168.50.104 127.0.0.1 ::1]
I0802 18:40:35.485386 54981 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0802 18:40:35.485487 54981 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-490984] and IPs [192.168.50.104 127.0.0.1 ::1]
I0802 18:40:35.485569 54981 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0802 18:40:35.485659 54981 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0802 18:40:35.485716 54981 kubeadm.go:310] [certs] Generating "sa" key and public key
I0802 18:40:35.485804 54981 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0802 18:40:35.485888 54981 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0802 18:40:35.485958 54981 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0802 18:40:35.486036 54981 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0802 18:40:35.486120 54981 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0802 18:40:35.486270 54981 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0802 18:40:35.486389 54981 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0802 18:40:35.486451 54981 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0802 18:40:35.486544 54981 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0802 18:40:35.487990 54981 out.go:204] - Booting up control plane ...
I0802 18:40:35.488084 54981 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0802 18:40:35.488164 54981 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0802 18:40:35.488248 54981 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0802 18:40:35.488352 54981 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0802 18:40:35.488507 54981 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0802 18:40:35.488585 54981 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0802 18:40:35.488695 54981 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0802 18:40:35.488907 54981 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0802 18:40:35.489013 54981 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0802 18:40:35.489202 54981 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0802 18:40:35.489273 54981 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0802 18:40:35.489485 54981 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0802 18:40:35.489552 54981 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0802 18:40:35.489721 54981 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0802 18:40:35.489799 54981 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0802 18:40:35.489956 54981 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0802 18:40:35.489964 54981 kubeadm.go:310]
I0802 18:40:35.490017 54981 kubeadm.go:310] Unfortunately, an error has occurred:
I0802 18:40:35.490057 54981 kubeadm.go:310] timed out waiting for the condition
I0802 18:40:35.490063 54981 kubeadm.go:310]
I0802 18:40:35.490089 54981 kubeadm.go:310] This error is likely caused by:
I0802 18:40:35.490123 54981 kubeadm.go:310] - The kubelet is not running
I0802 18:40:35.490207 54981 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0802 18:40:35.490214 54981 kubeadm.go:310]
I0802 18:40:35.490308 54981 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0802 18:40:35.490365 54981 kubeadm.go:310] - 'systemctl status kubelet'
I0802 18:40:35.490395 54981 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0802 18:40:35.490401 54981 kubeadm.go:310]
I0802 18:40:35.490557 54981 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0802 18:40:35.490677 54981 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0802 18:40:35.490685 54981 kubeadm.go:310]
I0802 18:40:35.490770 54981 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0802 18:40:35.490848 54981 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0802 18:40:35.490942 54981 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0802 18:40:35.491019 54981 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0802 18:40:35.491045 54981 kubeadm.go:310]
W0802 18:40:35.491221 54981 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-490984] and IPs [192.168.50.104 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-490984] and IPs [192.168.50.104 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-490984] and IPs [192.168.50.104 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-490984] and IPs [192.168.50.104 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0802 18:40:35.491278 54981 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0802 18:40:35.947033 54981 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0802 18:40:35.961410 54981 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0802 18:40:35.971775 54981 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0802 18:40:35.971793 54981 kubeadm.go:157] found existing configuration files:
I0802 18:40:35.971850 54981 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0802 18:40:35.981158 54981 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0802 18:40:35.981226 54981 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0802 18:40:35.990032 54981 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0802 18:40:35.999133 54981 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0802 18:40:35.999199 54981 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0802 18:40:36.008540 54981 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0802 18:40:36.018714 54981 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0802 18:40:36.018772 54981 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0802 18:40:36.027614 54981 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0802 18:40:36.035926 54981 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0802 18:40:36.035972 54981 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0802 18:40:36.045428 54981 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0802 18:40:36.277791 54981 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0802 18:42:32.188356 54981 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0802 18:42:32.188504 54981 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0802 18:42:32.190562 54981 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0802 18:42:32.190633 54981 kubeadm.go:310] [preflight] Running pre-flight checks
I0802 18:42:32.190725 54981 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0802 18:42:32.190850 54981 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0802 18:42:32.190973 54981 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0802 18:42:32.191063 54981 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0802 18:42:32.192798 54981 out.go:204] - Generating certificates and keys ...
I0802 18:42:32.192910 54981 kubeadm.go:310] [certs] Using existing ca certificate authority
I0802 18:42:32.193000 54981 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0802 18:42:32.193110 54981 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0802 18:42:32.193182 54981 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0802 18:42:32.193240 54981 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0802 18:42:32.193285 54981 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0802 18:42:32.193339 54981 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0802 18:42:32.193390 54981 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0802 18:42:32.193451 54981 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0802 18:42:32.193541 54981 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0802 18:42:32.193589 54981 kubeadm.go:310] [certs] Using the existing "sa" key
I0802 18:42:32.193652 54981 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0802 18:42:32.193744 54981 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0802 18:42:32.193821 54981 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0802 18:42:32.193906 54981 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0802 18:42:32.193980 54981 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0802 18:42:32.194118 54981 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0802 18:42:32.194220 54981 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0802 18:42:32.194278 54981 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0802 18:42:32.194350 54981 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0802 18:42:32.195869 54981 out.go:204] - Booting up control plane ...
I0802 18:42:32.195966 54981 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0802 18:42:32.196031 54981 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0802 18:42:32.196086 54981 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0802 18:42:32.196166 54981 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0802 18:42:32.196348 54981 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0802 18:42:32.196403 54981 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0802 18:42:32.196483 54981 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0802 18:42:32.196710 54981 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0802 18:42:32.196774 54981 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0802 18:42:32.196940 54981 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0802 18:42:32.197036 54981 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0802 18:42:32.197196 54981 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0802 18:42:32.197288 54981 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0802 18:42:32.197506 54981 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0802 18:42:32.197582 54981 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0802 18:42:32.197748 54981 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0802 18:42:32.197756 54981 kubeadm.go:310]
I0802 18:42:32.197803 54981 kubeadm.go:310] Unfortunately, an error has occurred:
I0802 18:42:32.197862 54981 kubeadm.go:310] timed out waiting for the condition
I0802 18:42:32.197871 54981 kubeadm.go:310]
I0802 18:42:32.197920 54981 kubeadm.go:310] This error is likely caused by:
I0802 18:42:32.197970 54981 kubeadm.go:310] - The kubelet is not running
I0802 18:42:32.198105 54981 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0802 18:42:32.198113 54981 kubeadm.go:310]
I0802 18:42:32.198194 54981 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0802 18:42:32.198236 54981 kubeadm.go:310] - 'systemctl status kubelet'
I0802 18:42:32.198282 54981 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0802 18:42:32.198296 54981 kubeadm.go:310]
I0802 18:42:32.198422 54981 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0802 18:42:32.198519 54981 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0802 18:42:32.198530 54981 kubeadm.go:310]
I0802 18:42:32.198655 54981 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0802 18:42:32.198757 54981 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0802 18:42:32.198862 54981 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0802 18:42:32.198959 54981 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0802 18:42:32.198980 54981 kubeadm.go:310]
I0802 18:42:32.199054 54981 kubeadm.go:394] duration metric: took 3m54.468093451s to StartCluster
I0802 18:42:32.199124 54981 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0802 18:42:32.199313 54981 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0802 18:42:32.249802 54981 cri.go:89] found id: ""
I0802 18:42:32.249828 54981 logs.go:276] 0 containers: []
W0802 18:42:32.249841 54981 logs.go:278] No container was found matching "kube-apiserver"
I0802 18:42:32.249848 54981 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0802 18:42:32.249913 54981 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0802 18:42:32.283815 54981 cri.go:89] found id: ""
I0802 18:42:32.283839 54981 logs.go:276] 0 containers: []
W0802 18:42:32.283847 54981 logs.go:278] No container was found matching "etcd"
I0802 18:42:32.283853 54981 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0802 18:42:32.283901 54981 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0802 18:42:32.325006 54981 cri.go:89] found id: ""
I0802 18:42:32.325037 54981 logs.go:276] 0 containers: []
W0802 18:42:32.325047 54981 logs.go:278] No container was found matching "coredns"
I0802 18:42:32.325055 54981 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0802 18:42:32.325120 54981 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0802 18:42:32.375445 54981 cri.go:89] found id: ""
I0802 18:42:32.375477 54981 logs.go:276] 0 containers: []
W0802 18:42:32.375485 54981 logs.go:278] No container was found matching "kube-scheduler"
I0802 18:42:32.375493 54981 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0802 18:42:32.375557 54981 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0802 18:42:32.412814 54981 cri.go:89] found id: ""
I0802 18:42:32.412841 54981 logs.go:276] 0 containers: []
W0802 18:42:32.412852 54981 logs.go:278] No container was found matching "kube-proxy"
I0802 18:42:32.412858 54981 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0802 18:42:32.412927 54981 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0802 18:42:32.446257 54981 cri.go:89] found id: ""
I0802 18:42:32.446291 54981 logs.go:276] 0 containers: []
W0802 18:42:32.446302 54981 logs.go:278] No container was found matching "kube-controller-manager"
I0802 18:42:32.446311 54981 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0802 18:42:32.446376 54981 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0802 18:42:32.479307 54981 cri.go:89] found id: ""
I0802 18:42:32.479330 54981 logs.go:276] 0 containers: []
W0802 18:42:32.479340 54981 logs.go:278] No container was found matching "kindnet"
I0802 18:42:32.479352 54981 logs.go:123] Gathering logs for describe nodes ...
I0802 18:42:32.479368 54981 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0802 18:42:32.588402 54981 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0802 18:42:32.588428 54981 logs.go:123] Gathering logs for CRI-O ...
I0802 18:42:32.588447 54981 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0802 18:42:32.680153 54981 logs.go:123] Gathering logs for container status ...
I0802 18:42:32.680192 54981 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0802 18:42:32.714847 54981 logs.go:123] Gathering logs for kubelet ...
I0802 18:42:32.714875 54981 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0802 18:42:32.762589 54981 logs.go:123] Gathering logs for dmesg ...
I0802 18:42:32.762627 54981 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
W0802 18:42:32.775549 54981 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0802 18:42:32.775601 54981 out.go:239] *
*
W0802 18:42:32.775658 54981 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0802 18:42:32.775680 54981 out.go:239] *
*
W0802 18:42:32.776610 54981 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0802 18:42:32.779698 54981 out.go:177]
W0802 18:42:32.780802 54981 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0802 18:42:32.780847 54981 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0802 18:42:32.780868 54981 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0802 18:42:32.782234 54981 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-490984 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-490984 -n old-k8s-version-490984
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-490984 -n old-k8s-version-490984: exit status 6 (241.877183ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0802 18:42:33.053693 57799 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-490984" does not appear in /home/jenkins/minikube-integration/19355-5397/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-490984" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (283.08s)