=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-171598 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-171598 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m32.113303859s)
-- stdout --
* [old-k8s-version-171598] minikube v1.34.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=19696
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19696-7623/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19696-7623/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-171598" primary control-plane node in "old-k8s-version-171598" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0924 00:54:35.667001 58197 out.go:345] Setting OutFile to fd 1 ...
I0924 00:54:35.667173 58197 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0924 00:54:35.667183 58197 out.go:358] Setting ErrFile to fd 2...
I0924 00:54:35.667190 58197 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0924 00:54:35.667452 58197 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19696-7623/.minikube/bin
I0924 00:54:35.668309 58197 out.go:352] Setting JSON to false
I0924 00:54:35.669684 58197 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":5820,"bootTime":1727133456,"procs":220,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1069-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0924 00:54:35.669768 58197 start.go:139] virtualization: kvm guest
I0924 00:54:35.672456 58197 out.go:177] * [old-k8s-version-171598] minikube v1.34.0 on Ubuntu 20.04 (kvm/amd64)
I0924 00:54:35.674335 58197 notify.go:220] Checking for updates...
I0924 00:54:35.675002 58197 out.go:177] - MINIKUBE_LOCATION=19696
I0924 00:54:35.676627 58197 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0924 00:54:35.678285 58197 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19696-7623/kubeconfig
I0924 00:54:35.679698 58197 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19696-7623/.minikube
I0924 00:54:35.681112 58197 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0924 00:54:35.682433 58197 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0924 00:54:35.684541 58197 config.go:182] Loaded profile config "cert-expiration-811247": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1
I0924 00:54:35.684712 58197 config.go:182] Loaded profile config "kubernetes-upgrade-619300": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1
I0924 00:54:35.684877 58197 config.go:182] Loaded profile config "stopped-upgrade-075175": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.24.1
I0924 00:54:35.684991 58197 driver.go:394] Setting default libvirt URI to qemu:///system
I0924 00:54:35.733634 58197 out.go:177] * Using the kvm2 driver based on user configuration
I0924 00:54:35.735260 58197 start.go:297] selected driver: kvm2
I0924 00:54:35.735281 58197 start.go:901] validating driver "kvm2" against <nil>
I0924 00:54:35.735296 58197 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0924 00:54:35.736373 58197 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0924 00:54:35.736487 58197 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19696-7623/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0924 00:54:35.755975 58197 install.go:137] /home/jenkins/minikube-integration/19696-7623/.minikube/bin/docker-machine-driver-kvm2 version is 1.34.0
I0924 00:54:35.756036 58197 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0924 00:54:35.756379 58197 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0924 00:54:35.756425 58197 cni.go:84] Creating CNI manager for ""
I0924 00:54:35.756494 58197 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0924 00:54:35.756510 58197 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0924 00:54:35.756602 58197 start.go:340] cluster config:
{Name:old-k8s-version-171598 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-171598 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0924 00:54:35.756753 58197 iso.go:125] acquiring lock: {Name:mk8a983e49e920eac32e0f79c34143c3d478115e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0924 00:54:35.759240 58197 out.go:177] * Starting "old-k8s-version-171598" primary control-plane node in "old-k8s-version-171598" cluster
I0924 00:54:35.760765 58197 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0924 00:54:35.760837 58197 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19696-7623/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0924 00:54:35.760864 58197 cache.go:56] Caching tarball of preloaded images
I0924 00:54:35.760989 58197 preload.go:172] Found /home/jenkins/minikube-integration/19696-7623/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0924 00:54:35.761003 58197 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0924 00:54:35.761131 58197 profile.go:143] Saving config to /home/jenkins/minikube-integration/19696-7623/.minikube/profiles/old-k8s-version-171598/config.json ...
I0924 00:54:35.761153 58197 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19696-7623/.minikube/profiles/old-k8s-version-171598/config.json: {Name:mk3c3ad3d1ff46951caf36a7369b876fc77e57ad Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0924 00:54:35.761357 58197 start.go:360] acquireMachinesLock for old-k8s-version-171598: {Name:mkdd0eb053efc5a47fd01c8410d7f603dccb8d0c Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0924 00:54:40.265458 58197 start.go:364] duration metric: took 4.504052994s to acquireMachinesLock for "old-k8s-version-171598"
I0924 00:54:40.265525 58197 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-171598 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19696/minikube-v1.34.0-1727108440-19696-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-171598 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0924 00:54:40.265644 58197 start.go:125] createHost starting for "" (driver="kvm2")
I0924 00:54:40.566118 58197 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0924 00:54:40.566457 58197 main.go:141] libmachine: Found binary path at /home/jenkins/minikube-integration/19696-7623/.minikube/bin/docker-machine-driver-kvm2
I0924 00:54:40.566533 58197 main.go:141] libmachine: Launching plugin server for driver kvm2
I0924 00:54:40.582838 58197 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35153
I0924 00:54:40.583440 58197 main.go:141] libmachine: () Calling .GetVersion
I0924 00:54:40.584078 58197 main.go:141] libmachine: Using API Version 1
I0924 00:54:40.584100 58197 main.go:141] libmachine: () Calling .SetConfigRaw
I0924 00:54:40.584486 58197 main.go:141] libmachine: () Calling .GetMachineName
I0924 00:54:40.584709 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetMachineName
I0924 00:54:40.584838 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .DriverName
I0924 00:54:40.584972 58197 start.go:159] libmachine.API.Create for "old-k8s-version-171598" (driver="kvm2")
I0924 00:54:40.585009 58197 client.go:168] LocalClient.Create starting
I0924 00:54:40.585045 58197 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19696-7623/.minikube/certs/ca.pem
I0924 00:54:40.585084 58197 main.go:141] libmachine: Decoding PEM data...
I0924 00:54:40.585110 58197 main.go:141] libmachine: Parsing certificate...
I0924 00:54:40.585257 58197 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19696-7623/.minikube/certs/cert.pem
I0924 00:54:40.585305 58197 main.go:141] libmachine: Decoding PEM data...
I0924 00:54:40.585324 58197 main.go:141] libmachine: Parsing certificate...
I0924 00:54:40.585355 58197 main.go:141] libmachine: Running pre-create checks...
I0924 00:54:40.585366 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .PreCreateCheck
I0924 00:54:40.585738 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetConfigRaw
I0924 00:54:40.586129 58197 main.go:141] libmachine: Creating machine...
I0924 00:54:40.586142 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .Create
I0924 00:54:40.586296 58197 main.go:141] libmachine: (old-k8s-version-171598) Creating KVM machine...
I0924 00:54:40.587557 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | found existing default KVM network
I0924 00:54:40.589250 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | I0924 00:54:40.589050 58277 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:c7:37:12} reservation:<nil>}
I0924 00:54:40.591884 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | I0924 00:54:40.591746 58277 network.go:209] skipping subnet 192.168.50.0/24 that is reserved: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}
I0924 00:54:40.592965 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | I0924 00:54:40.592857 58277 network.go:211] skipping subnet 192.168.61.0/24 that is taken: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.61.1 IfaceMTU:1500 IfaceMAC:52:54:00:96:6f:04} reservation:<nil>}
I0924 00:54:40.594116 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | I0924 00:54:40.594024 58277 network.go:211] skipping subnet 192.168.72.0/24 that is taken: &{IP:192.168.72.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.72.0/24 Gateway:192.168.72.1 ClientMin:192.168.72.2 ClientMax:192.168.72.254 Broadcast:192.168.72.255 IsPrivate:true Interface:{IfaceName:virbr4 IfaceIPv4:192.168.72.1 IfaceMTU:1500 IfaceMAC:52:54:00:50:da:eb} reservation:<nil>}
I0924 00:54:40.595400 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | I0924 00:54:40.595295 58277 network.go:206] using free private subnet 192.168.83.0/24: &{IP:192.168.83.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.83.0/24 Gateway:192.168.83.1 ClientMin:192.168.83.2 ClientMax:192.168.83.254 Broadcast:192.168.83.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000113d00}
I0924 00:54:40.595430 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | created network xml:
I0924 00:54:40.595455 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | <network>
I0924 00:54:40.595474 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | <name>mk-old-k8s-version-171598</name>
I0924 00:54:40.595513 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | <dns enable='no'/>
I0924 00:54:40.595541 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG |
I0924 00:54:40.595558 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | <ip address='192.168.83.1' netmask='255.255.255.0'>
I0924 00:54:40.595573 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | <dhcp>
I0924 00:54:40.595586 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | <range start='192.168.83.2' end='192.168.83.253'/>
I0924 00:54:40.595596 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | </dhcp>
I0924 00:54:40.595605 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | </ip>
I0924 00:54:40.595611 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG |
I0924 00:54:40.595631 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | </network>
I0924 00:54:40.595642 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG |
I0924 00:54:40.967604 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | trying to create private KVM network mk-old-k8s-version-171598 192.168.83.0/24...
I0924 00:54:41.050218 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | private KVM network mk-old-k8s-version-171598 192.168.83.0/24 created
I0924 00:54:41.050253 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | I0924 00:54:41.050103 58277 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19696-7623/.minikube
I0924 00:54:41.050268 58197 main.go:141] libmachine: (old-k8s-version-171598) Setting up store path in /home/jenkins/minikube-integration/19696-7623/.minikube/machines/old-k8s-version-171598 ...
I0924 00:54:41.050313 58197 main.go:141] libmachine: (old-k8s-version-171598) Building disk image from file:///home/jenkins/minikube-integration/19696-7623/.minikube/cache/iso/amd64/minikube-v1.34.0-1727108440-19696-amd64.iso
I0924 00:54:41.050332 58197 main.go:141] libmachine: (old-k8s-version-171598) Downloading /home/jenkins/minikube-integration/19696-7623/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19696-7623/.minikube/cache/iso/amd64/minikube-v1.34.0-1727108440-19696-amd64.iso...
I0924 00:54:41.316516 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | I0924 00:54:41.316357 58277 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19696-7623/.minikube/machines/old-k8s-version-171598/id_rsa...
I0924 00:54:41.926895 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | I0924 00:54:41.926728 58277 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19696-7623/.minikube/machines/old-k8s-version-171598/old-k8s-version-171598.rawdisk...
I0924 00:54:41.926932 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | Writing magic tar header
I0924 00:54:41.926957 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | Writing SSH key tar header
I0924 00:54:41.927046 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | I0924 00:54:41.926936 58277 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19696-7623/.minikube/machines/old-k8s-version-171598 ...
I0924 00:54:41.953667 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19696-7623/.minikube/machines/old-k8s-version-171598
I0924 00:54:41.953727 58197 main.go:141] libmachine: (old-k8s-version-171598) Setting executable bit set on /home/jenkins/minikube-integration/19696-7623/.minikube/machines/old-k8s-version-171598 (perms=drwx------)
I0924 00:54:41.953741 58197 main.go:141] libmachine: (old-k8s-version-171598) Setting executable bit set on /home/jenkins/minikube-integration/19696-7623/.minikube/machines (perms=drwxr-xr-x)
I0924 00:54:41.953752 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19696-7623/.minikube/machines
I0924 00:54:41.953765 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19696-7623/.minikube
I0924 00:54:41.953775 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19696-7623
I0924 00:54:41.953785 58197 main.go:141] libmachine: (old-k8s-version-171598) Setting executable bit set on /home/jenkins/minikube-integration/19696-7623/.minikube (perms=drwxr-xr-x)
I0924 00:54:41.953801 58197 main.go:141] libmachine: (old-k8s-version-171598) Setting executable bit set on /home/jenkins/minikube-integration/19696-7623 (perms=drwxrwxr-x)
I0924 00:54:41.953810 58197 main.go:141] libmachine: (old-k8s-version-171598) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0924 00:54:41.953825 58197 main.go:141] libmachine: (old-k8s-version-171598) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0924 00:54:41.953837 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0924 00:54:41.953846 58197 main.go:141] libmachine: (old-k8s-version-171598) Creating domain...
I0924 00:54:41.953861 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | Checking permissions on dir: /home/jenkins
I0924 00:54:41.953875 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | Checking permissions on dir: /home
I0924 00:54:41.953888 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | Skipping /home - not owner
I0924 00:54:41.955206 58197 main.go:141] libmachine: (old-k8s-version-171598) define libvirt domain using xml:
I0924 00:54:41.955234 58197 main.go:141] libmachine: (old-k8s-version-171598) <domain type='kvm'>
I0924 00:54:41.955257 58197 main.go:141] libmachine: (old-k8s-version-171598) <name>old-k8s-version-171598</name>
I0924 00:54:41.955269 58197 main.go:141] libmachine: (old-k8s-version-171598) <memory unit='MiB'>2200</memory>
I0924 00:54:41.955278 58197 main.go:141] libmachine: (old-k8s-version-171598) <vcpu>2</vcpu>
I0924 00:54:41.955286 58197 main.go:141] libmachine: (old-k8s-version-171598) <features>
I0924 00:54:41.955313 58197 main.go:141] libmachine: (old-k8s-version-171598) <acpi/>
I0924 00:54:41.955325 58197 main.go:141] libmachine: (old-k8s-version-171598) <apic/>
I0924 00:54:41.955360 58197 main.go:141] libmachine: (old-k8s-version-171598) <pae/>
I0924 00:54:41.955384 58197 main.go:141] libmachine: (old-k8s-version-171598)
I0924 00:54:41.955393 58197 main.go:141] libmachine: (old-k8s-version-171598) </features>
I0924 00:54:41.955400 58197 main.go:141] libmachine: (old-k8s-version-171598) <cpu mode='host-passthrough'>
I0924 00:54:41.955408 58197 main.go:141] libmachine: (old-k8s-version-171598)
I0924 00:54:41.955417 58197 main.go:141] libmachine: (old-k8s-version-171598) </cpu>
I0924 00:54:41.955424 58197 main.go:141] libmachine: (old-k8s-version-171598) <os>
I0924 00:54:41.955431 58197 main.go:141] libmachine: (old-k8s-version-171598) <type>hvm</type>
I0924 00:54:41.955441 58197 main.go:141] libmachine: (old-k8s-version-171598) <boot dev='cdrom'/>
I0924 00:54:41.955459 58197 main.go:141] libmachine: (old-k8s-version-171598) <boot dev='hd'/>
I0924 00:54:41.955470 58197 main.go:141] libmachine: (old-k8s-version-171598) <bootmenu enable='no'/>
I0924 00:54:41.955477 58197 main.go:141] libmachine: (old-k8s-version-171598) </os>
I0924 00:54:41.955484 58197 main.go:141] libmachine: (old-k8s-version-171598) <devices>
I0924 00:54:41.955494 58197 main.go:141] libmachine: (old-k8s-version-171598) <disk type='file' device='cdrom'>
I0924 00:54:41.955506 58197 main.go:141] libmachine: (old-k8s-version-171598) <source file='/home/jenkins/minikube-integration/19696-7623/.minikube/machines/old-k8s-version-171598/boot2docker.iso'/>
I0924 00:54:41.955522 58197 main.go:141] libmachine: (old-k8s-version-171598) <target dev='hdc' bus='scsi'/>
I0924 00:54:41.955534 58197 main.go:141] libmachine: (old-k8s-version-171598) <readonly/>
I0924 00:54:41.955540 58197 main.go:141] libmachine: (old-k8s-version-171598) </disk>
I0924 00:54:41.955549 58197 main.go:141] libmachine: (old-k8s-version-171598) <disk type='file' device='disk'>
I0924 00:54:41.955557 58197 main.go:141] libmachine: (old-k8s-version-171598) <driver name='qemu' type='raw' cache='default' io='threads' />
I0924 00:54:41.955571 58197 main.go:141] libmachine: (old-k8s-version-171598) <source file='/home/jenkins/minikube-integration/19696-7623/.minikube/machines/old-k8s-version-171598/old-k8s-version-171598.rawdisk'/>
I0924 00:54:41.955581 58197 main.go:141] libmachine: (old-k8s-version-171598) <target dev='hda' bus='virtio'/>
I0924 00:54:41.955589 58197 main.go:141] libmachine: (old-k8s-version-171598) </disk>
I0924 00:54:41.955599 58197 main.go:141] libmachine: (old-k8s-version-171598) <interface type='network'>
I0924 00:54:41.955628 58197 main.go:141] libmachine: (old-k8s-version-171598) <source network='mk-old-k8s-version-171598'/>
I0924 00:54:41.955658 58197 main.go:141] libmachine: (old-k8s-version-171598) <model type='virtio'/>
I0924 00:54:41.955674 58197 main.go:141] libmachine: (old-k8s-version-171598) </interface>
I0924 00:54:41.955696 58197 main.go:141] libmachine: (old-k8s-version-171598) <interface type='network'>
I0924 00:54:41.955705 58197 main.go:141] libmachine: (old-k8s-version-171598) <source network='default'/>
I0924 00:54:41.955711 58197 main.go:141] libmachine: (old-k8s-version-171598) <model type='virtio'/>
I0924 00:54:41.955724 58197 main.go:141] libmachine: (old-k8s-version-171598) </interface>
I0924 00:54:41.955731 58197 main.go:141] libmachine: (old-k8s-version-171598) <serial type='pty'>
I0924 00:54:41.955738 58197 main.go:141] libmachine: (old-k8s-version-171598) <target port='0'/>
I0924 00:54:41.955743 58197 main.go:141] libmachine: (old-k8s-version-171598) </serial>
I0924 00:54:41.955773 58197 main.go:141] libmachine: (old-k8s-version-171598) <console type='pty'>
I0924 00:54:41.955802 58197 main.go:141] libmachine: (old-k8s-version-171598) <target type='serial' port='0'/>
I0924 00:54:41.955814 58197 main.go:141] libmachine: (old-k8s-version-171598) </console>
I0924 00:54:41.955828 58197 main.go:141] libmachine: (old-k8s-version-171598) <rng model='virtio'>
I0924 00:54:41.955842 58197 main.go:141] libmachine: (old-k8s-version-171598) <backend model='random'>/dev/random</backend>
I0924 00:54:41.955852 58197 main.go:141] libmachine: (old-k8s-version-171598) </rng>
I0924 00:54:41.955860 58197 main.go:141] libmachine: (old-k8s-version-171598)
I0924 00:54:41.955872 58197 main.go:141] libmachine: (old-k8s-version-171598)
I0924 00:54:41.955883 58197 main.go:141] libmachine: (old-k8s-version-171598) </devices>
I0924 00:54:41.955890 58197 main.go:141] libmachine: (old-k8s-version-171598) </domain>
I0924 00:54:41.955899 58197 main.go:141] libmachine: (old-k8s-version-171598)
I0924 00:54:42.083553 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | domain old-k8s-version-171598 has defined MAC address 52:54:00:14:78:aa in network default
I0924 00:54:42.084310 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | domain old-k8s-version-171598 has defined MAC address 52:54:00:20:3c:a7 in network mk-old-k8s-version-171598
I0924 00:54:42.084367 58197 main.go:141] libmachine: (old-k8s-version-171598) Ensuring networks are active...
I0924 00:54:42.085211 58197 main.go:141] libmachine: (old-k8s-version-171598) Ensuring network default is active
I0924 00:54:42.085682 58197 main.go:141] libmachine: (old-k8s-version-171598) Ensuring network mk-old-k8s-version-171598 is active
I0924 00:54:42.086360 58197 main.go:141] libmachine: (old-k8s-version-171598) Getting domain xml...
I0924 00:54:42.087218 58197 main.go:141] libmachine: (old-k8s-version-171598) Creating domain...
I0924 00:54:43.610949 58197 main.go:141] libmachine: (old-k8s-version-171598) Waiting to get IP...
I0924 00:54:43.611798 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | domain old-k8s-version-171598 has defined MAC address 52:54:00:20:3c:a7 in network mk-old-k8s-version-171598
I0924 00:54:43.612513 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | unable to find current IP address of domain old-k8s-version-171598 in network mk-old-k8s-version-171598
I0924 00:54:43.612572 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | I0924 00:54:43.612482 58277 retry.go:31] will retry after 224.42885ms: waiting for machine to come up
I0924 00:54:43.839150 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | domain old-k8s-version-171598 has defined MAC address 52:54:00:20:3c:a7 in network mk-old-k8s-version-171598
I0924 00:54:43.839857 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | unable to find current IP address of domain old-k8s-version-171598 in network mk-old-k8s-version-171598
I0924 00:54:43.839891 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | I0924 00:54:43.839799 58277 retry.go:31] will retry after 275.98256ms: waiting for machine to come up
I0924 00:54:44.117653 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | domain old-k8s-version-171598 has defined MAC address 52:54:00:20:3c:a7 in network mk-old-k8s-version-171598
I0924 00:54:44.118446 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | unable to find current IP address of domain old-k8s-version-171598 in network mk-old-k8s-version-171598
I0924 00:54:44.118467 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | I0924 00:54:44.118404 58277 retry.go:31] will retry after 320.610525ms: waiting for machine to come up
I0924 00:54:44.441174 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | domain old-k8s-version-171598 has defined MAC address 52:54:00:20:3c:a7 in network mk-old-k8s-version-171598
I0924 00:54:44.441683 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | unable to find current IP address of domain old-k8s-version-171598 in network mk-old-k8s-version-171598
I0924 00:54:44.441703 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | I0924 00:54:44.441639 58277 retry.go:31] will retry after 412.121611ms: waiting for machine to come up
I0924 00:54:44.855437 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | domain old-k8s-version-171598 has defined MAC address 52:54:00:20:3c:a7 in network mk-old-k8s-version-171598
I0924 00:54:44.856018 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | unable to find current IP address of domain old-k8s-version-171598 in network mk-old-k8s-version-171598
I0924 00:54:44.856045 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | I0924 00:54:44.855976 58277 retry.go:31] will retry after 469.110734ms: waiting for machine to come up
I0924 00:54:45.326703 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | domain old-k8s-version-171598 has defined MAC address 52:54:00:20:3c:a7 in network mk-old-k8s-version-171598
I0924 00:54:45.327314 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | unable to find current IP address of domain old-k8s-version-171598 in network mk-old-k8s-version-171598
I0924 00:54:45.327348 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | I0924 00:54:45.327245 58277 retry.go:31] will retry after 732.613161ms: waiting for machine to come up
I0924 00:54:46.061493 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | domain old-k8s-version-171598 has defined MAC address 52:54:00:20:3c:a7 in network mk-old-k8s-version-171598
I0924 00:54:46.061964 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | unable to find current IP address of domain old-k8s-version-171598 in network mk-old-k8s-version-171598
I0924 00:54:46.061993 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | I0924 00:54:46.061927 58277 retry.go:31] will retry after 1.125990562s: waiting for machine to come up
I0924 00:54:47.189213 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | domain old-k8s-version-171598 has defined MAC address 52:54:00:20:3c:a7 in network mk-old-k8s-version-171598
I0924 00:54:47.189678 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | unable to find current IP address of domain old-k8s-version-171598 in network mk-old-k8s-version-171598
I0924 00:54:47.189728 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | I0924 00:54:47.189627 58277 retry.go:31] will retry after 1.34649733s: waiting for machine to come up
I0924 00:54:48.537420 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | domain old-k8s-version-171598 has defined MAC address 52:54:00:20:3c:a7 in network mk-old-k8s-version-171598
I0924 00:54:48.537986 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | unable to find current IP address of domain old-k8s-version-171598 in network mk-old-k8s-version-171598
I0924 00:54:48.538006 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | I0924 00:54:48.537922 58277 retry.go:31] will retry after 1.262417735s: waiting for machine to come up
I0924 00:54:49.801554 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | domain old-k8s-version-171598 has defined MAC address 52:54:00:20:3c:a7 in network mk-old-k8s-version-171598
I0924 00:54:49.802238 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | unable to find current IP address of domain old-k8s-version-171598 in network mk-old-k8s-version-171598
I0924 00:54:49.802282 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | I0924 00:54:49.802159 58277 retry.go:31] will retry after 2.047718833s: waiting for machine to come up
I0924 00:54:51.851675 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | domain old-k8s-version-171598 has defined MAC address 52:54:00:20:3c:a7 in network mk-old-k8s-version-171598
I0924 00:54:51.852261 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | unable to find current IP address of domain old-k8s-version-171598 in network mk-old-k8s-version-171598
I0924 00:54:51.852285 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | I0924 00:54:51.852167 58277 retry.go:31] will retry after 2.503553236s: waiting for machine to come up
I0924 00:54:54.358926 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | domain old-k8s-version-171598 has defined MAC address 52:54:00:20:3c:a7 in network mk-old-k8s-version-171598
I0924 00:54:54.359421 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | unable to find current IP address of domain old-k8s-version-171598 in network mk-old-k8s-version-171598
I0924 00:54:54.359442 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | I0924 00:54:54.359400 58277 retry.go:31] will retry after 3.635911662s: waiting for machine to come up
I0924 00:54:57.997755 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | domain old-k8s-version-171598 has defined MAC address 52:54:00:20:3c:a7 in network mk-old-k8s-version-171598
I0924 00:54:57.998281 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | unable to find current IP address of domain old-k8s-version-171598 in network mk-old-k8s-version-171598
I0924 00:54:57.998304 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | I0924 00:54:57.998237 58277 retry.go:31] will retry after 3.751754598s: waiting for machine to come up
I0924 00:55:01.752198 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | domain old-k8s-version-171598 has defined MAC address 52:54:00:20:3c:a7 in network mk-old-k8s-version-171598
I0924 00:55:01.752881 58197 main.go:141] libmachine: (old-k8s-version-171598) Found IP for machine: 192.168.83.3
I0924 00:55:01.752902 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | domain old-k8s-version-171598 has current primary IP address 192.168.83.3 and MAC address 52:54:00:20:3c:a7 in network mk-old-k8s-version-171598
I0924 00:55:01.752908 58197 main.go:141] libmachine: (old-k8s-version-171598) Reserving static IP address...
I0924 00:55:01.753279 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-171598", mac: "52:54:00:20:3c:a7", ip: "192.168.83.3"} in network mk-old-k8s-version-171598
I0924 00:55:01.840663 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | Getting to WaitForSSH function...
I0924 00:55:01.840687 58197 main.go:141] libmachine: (old-k8s-version-171598) Reserved static IP address: 192.168.83.3
I0924 00:55:01.840699 58197 main.go:141] libmachine: (old-k8s-version-171598) Waiting for SSH to be available...
I0924 00:55:01.844238 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | domain old-k8s-version-171598 has defined MAC address 52:54:00:20:3c:a7 in network mk-old-k8s-version-171598
I0924 00:55:01.844709 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:20:3c:a7", ip: ""} in network mk-old-k8s-version-171598: {Iface:virbr3 ExpiryTime:2024-09-24 01:54:56 +0000 UTC Type:0 Mac:52:54:00:20:3c:a7 Iaid: IPaddr:192.168.83.3 Prefix:24 Hostname:minikube Clientid:01:52:54:00:20:3c:a7}
I0924 00:55:01.844740 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | domain old-k8s-version-171598 has defined IP address 192.168.83.3 and MAC address 52:54:00:20:3c:a7 in network mk-old-k8s-version-171598
I0924 00:55:01.844883 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | Using SSH client type: external
I0924 00:55:01.844907 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | Using SSH private key: /home/jenkins/minikube-integration/19696-7623/.minikube/machines/old-k8s-version-171598/id_rsa (-rw-------)
I0924 00:55:01.844940 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.83.3 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19696-7623/.minikube/machines/old-k8s-version-171598/id_rsa -p 22] /usr/bin/ssh <nil>}
I0924 00:55:01.844965 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | About to run SSH command:
I0924 00:55:01.844993 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | exit 0
I0924 00:55:01.968726 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | SSH cmd err, output: <nil>:
I0924 00:55:01.968961 58197 main.go:141] libmachine: (old-k8s-version-171598) KVM machine creation complete!
I0924 00:55:01.969312 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetConfigRaw
I0924 00:55:01.969827 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .DriverName
I0924 00:55:01.970085 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .DriverName
I0924 00:55:01.970255 58197 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0924 00:55:01.970268 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetState
I0924 00:55:01.971910 58197 main.go:141] libmachine: Detecting operating system of created instance...
I0924 00:55:01.971926 58197 main.go:141] libmachine: Waiting for SSH to be available...
I0924 00:55:01.971950 58197 main.go:141] libmachine: Getting to WaitForSSH function...
I0924 00:55:01.971959 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetSSHHostname
I0924 00:55:01.974276 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | domain old-k8s-version-171598 has defined MAC address 52:54:00:20:3c:a7 in network mk-old-k8s-version-171598
I0924 00:55:01.974699 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:20:3c:a7", ip: ""} in network mk-old-k8s-version-171598: {Iface:virbr3 ExpiryTime:2024-09-24 01:54:56 +0000 UTC Type:0 Mac:52:54:00:20:3c:a7 Iaid: IPaddr:192.168.83.3 Prefix:24 Hostname:old-k8s-version-171598 Clientid:01:52:54:00:20:3c:a7}
I0924 00:55:01.974732 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | domain old-k8s-version-171598 has defined IP address 192.168.83.3 and MAC address 52:54:00:20:3c:a7 in network mk-old-k8s-version-171598
I0924 00:55:01.974853 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetSSHPort
I0924 00:55:01.975061 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetSSHKeyPath
I0924 00:55:01.975230 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetSSHKeyPath
I0924 00:55:01.975518 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetSSHUsername
I0924 00:55:01.975694 58197 main.go:141] libmachine: Using SSH client type: native
I0924 00:55:01.975872 58197 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil> [] 0s} 192.168.83.3 22 <nil> <nil>}
I0924 00:55:01.975885 58197 main.go:141] libmachine: About to run SSH command:
exit 0
I0924 00:55:02.079653 58197 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0924 00:55:02.079686 58197 main.go:141] libmachine: Detecting the provisioner...
I0924 00:55:02.079694 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetSSHHostname
I0924 00:55:02.083048 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | domain old-k8s-version-171598 has defined MAC address 52:54:00:20:3c:a7 in network mk-old-k8s-version-171598
I0924 00:55:02.083491 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:20:3c:a7", ip: ""} in network mk-old-k8s-version-171598: {Iface:virbr3 ExpiryTime:2024-09-24 01:54:56 +0000 UTC Type:0 Mac:52:54:00:20:3c:a7 Iaid: IPaddr:192.168.83.3 Prefix:24 Hostname:old-k8s-version-171598 Clientid:01:52:54:00:20:3c:a7}
I0924 00:55:02.083528 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | domain old-k8s-version-171598 has defined IP address 192.168.83.3 and MAC address 52:54:00:20:3c:a7 in network mk-old-k8s-version-171598
I0924 00:55:02.083737 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetSSHPort
I0924 00:55:02.083980 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetSSHKeyPath
I0924 00:55:02.084159 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetSSHKeyPath
I0924 00:55:02.084367 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetSSHUsername
I0924 00:55:02.084570 58197 main.go:141] libmachine: Using SSH client type: native
I0924 00:55:02.084797 58197 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil> [] 0s} 192.168.83.3 22 <nil> <nil>}
I0924 00:55:02.084813 58197 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0924 00:55:02.189230 58197 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0924 00:55:02.189322 58197 main.go:141] libmachine: found compatible host: buildroot
I0924 00:55:02.189330 58197 main.go:141] libmachine: Provisioning with buildroot...
I0924 00:55:02.189338 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetMachineName
I0924 00:55:02.189638 58197 buildroot.go:166] provisioning hostname "old-k8s-version-171598"
I0924 00:55:02.189666 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetMachineName
I0924 00:55:02.189901 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetSSHHostname
I0924 00:55:02.192761 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | domain old-k8s-version-171598 has defined MAC address 52:54:00:20:3c:a7 in network mk-old-k8s-version-171598
I0924 00:55:02.193213 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:20:3c:a7", ip: ""} in network mk-old-k8s-version-171598: {Iface:virbr3 ExpiryTime:2024-09-24 01:54:56 +0000 UTC Type:0 Mac:52:54:00:20:3c:a7 Iaid: IPaddr:192.168.83.3 Prefix:24 Hostname:old-k8s-version-171598 Clientid:01:52:54:00:20:3c:a7}
I0924 00:55:02.193244 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | domain old-k8s-version-171598 has defined IP address 192.168.83.3 and MAC address 52:54:00:20:3c:a7 in network mk-old-k8s-version-171598
I0924 00:55:02.193388 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetSSHPort
I0924 00:55:02.193645 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetSSHKeyPath
I0924 00:55:02.193838 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetSSHKeyPath
I0924 00:55:02.194063 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetSSHUsername
I0924 00:55:02.194270 58197 main.go:141] libmachine: Using SSH client type: native
I0924 00:55:02.194480 58197 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil> [] 0s} 192.168.83.3 22 <nil> <nil>}
I0924 00:55:02.194498 58197 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-171598 && echo "old-k8s-version-171598" | sudo tee /etc/hostname
I0924 00:55:02.314997 58197 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-171598
I0924 00:55:02.315032 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetSSHHostname
I0924 00:55:02.318138 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | domain old-k8s-version-171598 has defined MAC address 52:54:00:20:3c:a7 in network mk-old-k8s-version-171598
I0924 00:55:02.318555 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:20:3c:a7", ip: ""} in network mk-old-k8s-version-171598: {Iface:virbr3 ExpiryTime:2024-09-24 01:54:56 +0000 UTC Type:0 Mac:52:54:00:20:3c:a7 Iaid: IPaddr:192.168.83.3 Prefix:24 Hostname:old-k8s-version-171598 Clientid:01:52:54:00:20:3c:a7}
I0924 00:55:02.318599 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | domain old-k8s-version-171598 has defined IP address 192.168.83.3 and MAC address 52:54:00:20:3c:a7 in network mk-old-k8s-version-171598
I0924 00:55:02.318822 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetSSHPort
I0924 00:55:02.319087 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetSSHKeyPath
I0924 00:55:02.319296 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetSSHKeyPath
I0924 00:55:02.319455 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetSSHUsername
I0924 00:55:02.319665 58197 main.go:141] libmachine: Using SSH client type: native
I0924 00:55:02.319874 58197 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil> [] 0s} 192.168.83.3 22 <nil> <nil>}
I0924 00:55:02.319891 58197 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-171598' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-171598/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-171598' | sudo tee -a /etc/hosts;
fi
fi
I0924 00:55:02.429171 58197 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0924 00:55:02.429200 58197 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19696-7623/.minikube CaCertPath:/home/jenkins/minikube-integration/19696-7623/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19696-7623/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19696-7623/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19696-7623/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19696-7623/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19696-7623/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19696-7623/.minikube}
I0924 00:55:02.429247 58197 buildroot.go:174] setting up certificates
I0924 00:55:02.429262 58197 provision.go:84] configureAuth start
I0924 00:55:02.429277 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetMachineName
I0924 00:55:02.429579 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetIP
I0924 00:55:02.432395 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | domain old-k8s-version-171598 has defined MAC address 52:54:00:20:3c:a7 in network mk-old-k8s-version-171598
I0924 00:55:02.432823 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:20:3c:a7", ip: ""} in network mk-old-k8s-version-171598: {Iface:virbr3 ExpiryTime:2024-09-24 01:54:56 +0000 UTC Type:0 Mac:52:54:00:20:3c:a7 Iaid: IPaddr:192.168.83.3 Prefix:24 Hostname:old-k8s-version-171598 Clientid:01:52:54:00:20:3c:a7}
I0924 00:55:02.432850 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | domain old-k8s-version-171598 has defined IP address 192.168.83.3 and MAC address 52:54:00:20:3c:a7 in network mk-old-k8s-version-171598
I0924 00:55:02.433101 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetSSHHostname
I0924 00:55:02.435504 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | domain old-k8s-version-171598 has defined MAC address 52:54:00:20:3c:a7 in network mk-old-k8s-version-171598
I0924 00:55:02.435869 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:20:3c:a7", ip: ""} in network mk-old-k8s-version-171598: {Iface:virbr3 ExpiryTime:2024-09-24 01:54:56 +0000 UTC Type:0 Mac:52:54:00:20:3c:a7 Iaid: IPaddr:192.168.83.3 Prefix:24 Hostname:old-k8s-version-171598 Clientid:01:52:54:00:20:3c:a7}
I0924 00:55:02.435890 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | domain old-k8s-version-171598 has defined IP address 192.168.83.3 and MAC address 52:54:00:20:3c:a7 in network mk-old-k8s-version-171598
I0924 00:55:02.436017 58197 provision.go:143] copyHostCerts
I0924 00:55:02.436086 58197 exec_runner.go:144] found /home/jenkins/minikube-integration/19696-7623/.minikube/ca.pem, removing ...
I0924 00:55:02.436105 58197 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19696-7623/.minikube/ca.pem
I0924 00:55:02.436164 58197 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19696-7623/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19696-7623/.minikube/ca.pem (1082 bytes)
I0924 00:55:02.436305 58197 exec_runner.go:144] found /home/jenkins/minikube-integration/19696-7623/.minikube/cert.pem, removing ...
I0924 00:55:02.436318 58197 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19696-7623/.minikube/cert.pem
I0924 00:55:02.436367 58197 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19696-7623/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19696-7623/.minikube/cert.pem (1123 bytes)
I0924 00:55:02.436475 58197 exec_runner.go:144] found /home/jenkins/minikube-integration/19696-7623/.minikube/key.pem, removing ...
I0924 00:55:02.436485 58197 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19696-7623/.minikube/key.pem
I0924 00:55:02.436511 58197 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19696-7623/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19696-7623/.minikube/key.pem (1679 bytes)
I0924 00:55:02.436610 58197 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19696-7623/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19696-7623/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19696-7623/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-171598 san=[127.0.0.1 192.168.83.3 localhost minikube old-k8s-version-171598]
I0924 00:55:02.528742 58197 provision.go:177] copyRemoteCerts
I0924 00:55:02.528805 58197 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0924 00:55:02.528907 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetSSHHostname
I0924 00:55:02.532302 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | domain old-k8s-version-171598 has defined MAC address 52:54:00:20:3c:a7 in network mk-old-k8s-version-171598
I0924 00:55:02.532792 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:20:3c:a7", ip: ""} in network mk-old-k8s-version-171598: {Iface:virbr3 ExpiryTime:2024-09-24 01:54:56 +0000 UTC Type:0 Mac:52:54:00:20:3c:a7 Iaid: IPaddr:192.168.83.3 Prefix:24 Hostname:old-k8s-version-171598 Clientid:01:52:54:00:20:3c:a7}
I0924 00:55:02.532823 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | domain old-k8s-version-171598 has defined IP address 192.168.83.3 and MAC address 52:54:00:20:3c:a7 in network mk-old-k8s-version-171598
I0924 00:55:02.533033 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetSSHPort
I0924 00:55:02.533224 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetSSHKeyPath
I0924 00:55:02.533448 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetSSHUsername
I0924 00:55:02.533632 58197 sshutil.go:53] new ssh client: &{IP:192.168.83.3 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19696-7623/.minikube/machines/old-k8s-version-171598/id_rsa Username:docker}
I0924 00:55:02.620500 58197 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-7623/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0924 00:55:02.655188 58197 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-7623/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0924 00:55:02.685047 58197 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-7623/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0924 00:55:02.715935 58197 provision.go:87] duration metric: took 286.660949ms to configureAuth
I0924 00:55:02.715966 58197 buildroot.go:189] setting minikube options for container-runtime
I0924 00:55:02.716128 58197 config.go:182] Loaded profile config "old-k8s-version-171598": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0924 00:55:02.716205 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetSSHHostname
I0924 00:55:02.719908 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | domain old-k8s-version-171598 has defined MAC address 52:54:00:20:3c:a7 in network mk-old-k8s-version-171598
I0924 00:55:02.720247 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:20:3c:a7", ip: ""} in network mk-old-k8s-version-171598: {Iface:virbr3 ExpiryTime:2024-09-24 01:54:56 +0000 UTC Type:0 Mac:52:54:00:20:3c:a7 Iaid: IPaddr:192.168.83.3 Prefix:24 Hostname:old-k8s-version-171598 Clientid:01:52:54:00:20:3c:a7}
I0924 00:55:02.720274 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | domain old-k8s-version-171598 has defined IP address 192.168.83.3 and MAC address 52:54:00:20:3c:a7 in network mk-old-k8s-version-171598
I0924 00:55:02.720543 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetSSHPort
I0924 00:55:02.720723 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetSSHKeyPath
I0924 00:55:02.720836 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetSSHKeyPath
I0924 00:55:02.721001 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetSSHUsername
I0924 00:55:02.721165 58197 main.go:141] libmachine: Using SSH client type: native
I0924 00:55:02.721376 58197 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil> [] 0s} 192.168.83.3 22 <nil> <nil>}
I0924 00:55:02.721403 58197 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0924 00:55:03.018082 58197 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0924 00:55:03.018107 58197 main.go:141] libmachine: Checking connection to Docker...
I0924 00:55:03.018115 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetURL
I0924 00:55:03.020121 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | Using libvirt version 6000000
I0924 00:55:03.023905 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | domain old-k8s-version-171598 has defined MAC address 52:54:00:20:3c:a7 in network mk-old-k8s-version-171598
I0924 00:55:03.024403 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:20:3c:a7", ip: ""} in network mk-old-k8s-version-171598: {Iface:virbr3 ExpiryTime:2024-09-24 01:54:56 +0000 UTC Type:0 Mac:52:54:00:20:3c:a7 Iaid: IPaddr:192.168.83.3 Prefix:24 Hostname:old-k8s-version-171598 Clientid:01:52:54:00:20:3c:a7}
I0924 00:55:03.024437 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | domain old-k8s-version-171598 has defined IP address 192.168.83.3 and MAC address 52:54:00:20:3c:a7 in network mk-old-k8s-version-171598
I0924 00:55:03.024783 58197 main.go:141] libmachine: Docker is up and running!
I0924 00:55:03.024800 58197 main.go:141] libmachine: Reticulating splines...
I0924 00:55:03.024807 58197 client.go:171] duration metric: took 22.439787669s to LocalClient.Create
I0924 00:55:03.024826 58197 start.go:167] duration metric: took 22.439855123s to libmachine.API.Create "old-k8s-version-171598"
I0924 00:55:03.024834 58197 start.go:293] postStartSetup for "old-k8s-version-171598" (driver="kvm2")
I0924 00:55:03.024843 58197 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0924 00:55:03.024857 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .DriverName
I0924 00:55:03.025082 58197 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0924 00:55:03.025114 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetSSHHostname
I0924 00:55:03.027876 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | domain old-k8s-version-171598 has defined MAC address 52:54:00:20:3c:a7 in network mk-old-k8s-version-171598
I0924 00:55:03.028199 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:20:3c:a7", ip: ""} in network mk-old-k8s-version-171598: {Iface:virbr3 ExpiryTime:2024-09-24 01:54:56 +0000 UTC Type:0 Mac:52:54:00:20:3c:a7 Iaid: IPaddr:192.168.83.3 Prefix:24 Hostname:old-k8s-version-171598 Clientid:01:52:54:00:20:3c:a7}
I0924 00:55:03.028229 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | domain old-k8s-version-171598 has defined IP address 192.168.83.3 and MAC address 52:54:00:20:3c:a7 in network mk-old-k8s-version-171598
I0924 00:55:03.028443 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetSSHPort
I0924 00:55:03.028598 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetSSHKeyPath
I0924 00:55:03.028727 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetSSHUsername
I0924 00:55:03.028874 58197 sshutil.go:53] new ssh client: &{IP:192.168.83.3 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19696-7623/.minikube/machines/old-k8s-version-171598/id_rsa Username:docker}
I0924 00:55:03.120687 58197 ssh_runner.go:195] Run: cat /etc/os-release
I0924 00:55:03.124786 58197 info.go:137] Remote host: Buildroot 2023.02.9
I0924 00:55:03.124817 58197 filesync.go:126] Scanning /home/jenkins/minikube-integration/19696-7623/.minikube/addons for local assets ...
I0924 00:55:03.124903 58197 filesync.go:126] Scanning /home/jenkins/minikube-integration/19696-7623/.minikube/files for local assets ...
I0924 00:55:03.125015 58197 filesync.go:149] local asset: /home/jenkins/minikube-integration/19696-7623/.minikube/files/etc/ssl/certs/147932.pem -> 147932.pem in /etc/ssl/certs
I0924 00:55:03.125258 58197 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0924 00:55:03.135695 58197 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-7623/.minikube/files/etc/ssl/certs/147932.pem --> /etc/ssl/certs/147932.pem (1708 bytes)
I0924 00:55:03.165018 58197 start.go:296] duration metric: took 140.171374ms for postStartSetup
I0924 00:55:03.165070 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetConfigRaw
I0924 00:55:03.165759 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetIP
I0924 00:55:03.169024 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | domain old-k8s-version-171598 has defined MAC address 52:54:00:20:3c:a7 in network mk-old-k8s-version-171598
I0924 00:55:03.169673 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:20:3c:a7", ip: ""} in network mk-old-k8s-version-171598: {Iface:virbr3 ExpiryTime:2024-09-24 01:54:56 +0000 UTC Type:0 Mac:52:54:00:20:3c:a7 Iaid: IPaddr:192.168.83.3 Prefix:24 Hostname:old-k8s-version-171598 Clientid:01:52:54:00:20:3c:a7}
I0924 00:55:03.169702 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | domain old-k8s-version-171598 has defined IP address 192.168.83.3 and MAC address 52:54:00:20:3c:a7 in network mk-old-k8s-version-171598
I0924 00:55:03.170098 58197 profile.go:143] Saving config to /home/jenkins/minikube-integration/19696-7623/.minikube/profiles/old-k8s-version-171598/config.json ...
I0924 00:55:03.170347 58197 start.go:128] duration metric: took 22.904687506s to createHost
I0924 00:55:03.170378 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetSSHHostname
I0924 00:55:03.173735 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | domain old-k8s-version-171598 has defined MAC address 52:54:00:20:3c:a7 in network mk-old-k8s-version-171598
I0924 00:55:03.174051 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:20:3c:a7", ip: ""} in network mk-old-k8s-version-171598: {Iface:virbr3 ExpiryTime:2024-09-24 01:54:56 +0000 UTC Type:0 Mac:52:54:00:20:3c:a7 Iaid: IPaddr:192.168.83.3 Prefix:24 Hostname:old-k8s-version-171598 Clientid:01:52:54:00:20:3c:a7}
I0924 00:55:03.174080 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | domain old-k8s-version-171598 has defined IP address 192.168.83.3 and MAC address 52:54:00:20:3c:a7 in network mk-old-k8s-version-171598
I0924 00:55:03.174389 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetSSHPort
I0924 00:55:03.174585 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetSSHKeyPath
I0924 00:55:03.174884 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetSSHKeyPath
I0924 00:55:03.175094 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetSSHUsername
I0924 00:55:03.175291 58197 main.go:141] libmachine: Using SSH client type: native
I0924 00:55:03.175483 58197 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil> [] 0s} 192.168.83.3 22 <nil> <nil>}
I0924 00:55:03.175496 58197 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0924 00:55:03.293095 58197 main.go:141] libmachine: SSH cmd err, output: <nil>: 1727139303.249080601
I0924 00:55:03.293129 58197 fix.go:216] guest clock: 1727139303.249080601
I0924 00:55:03.293136 58197 fix.go:229] Guest: 2024-09-24 00:55:03.249080601 +0000 UTC Remote: 2024-09-24 00:55:03.170363849 +0000 UTC m=+27.555541393 (delta=78.716752ms)
I0924 00:55:03.293158 58197 fix.go:200] guest clock delta is within tolerance: 78.716752ms
I0924 00:55:03.293164 58197 start.go:83] releasing machines lock for "old-k8s-version-171598", held for 23.027668037s
I0924 00:55:03.293198 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .DriverName
I0924 00:55:03.293446 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetIP
I0924 00:55:03.296716 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | domain old-k8s-version-171598 has defined MAC address 52:54:00:20:3c:a7 in network mk-old-k8s-version-171598
I0924 00:55:03.297182 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:20:3c:a7", ip: ""} in network mk-old-k8s-version-171598: {Iface:virbr3 ExpiryTime:2024-09-24 01:54:56 +0000 UTC Type:0 Mac:52:54:00:20:3c:a7 Iaid: IPaddr:192.168.83.3 Prefix:24 Hostname:old-k8s-version-171598 Clientid:01:52:54:00:20:3c:a7}
I0924 00:55:03.297214 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | domain old-k8s-version-171598 has defined IP address 192.168.83.3 and MAC address 52:54:00:20:3c:a7 in network mk-old-k8s-version-171598
I0924 00:55:03.297416 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .DriverName
I0924 00:55:03.297967 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .DriverName
I0924 00:55:03.298174 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .DriverName
I0924 00:55:03.298287 58197 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0924 00:55:03.298323 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetSSHHostname
I0924 00:55:03.298447 58197 ssh_runner.go:195] Run: cat /version.json
I0924 00:55:03.298475 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetSSHHostname
I0924 00:55:03.301444 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | domain old-k8s-version-171598 has defined MAC address 52:54:00:20:3c:a7 in network mk-old-k8s-version-171598
I0924 00:55:03.301611 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | domain old-k8s-version-171598 has defined MAC address 52:54:00:20:3c:a7 in network mk-old-k8s-version-171598
I0924 00:55:03.301843 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:20:3c:a7", ip: ""} in network mk-old-k8s-version-171598: {Iface:virbr3 ExpiryTime:2024-09-24 01:54:56 +0000 UTC Type:0 Mac:52:54:00:20:3c:a7 Iaid: IPaddr:192.168.83.3 Prefix:24 Hostname:old-k8s-version-171598 Clientid:01:52:54:00:20:3c:a7}
I0924 00:55:03.301867 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | domain old-k8s-version-171598 has defined IP address 192.168.83.3 and MAC address 52:54:00:20:3c:a7 in network mk-old-k8s-version-171598
I0924 00:55:03.302017 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetSSHPort
I0924 00:55:03.302108 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:20:3c:a7", ip: ""} in network mk-old-k8s-version-171598: {Iface:virbr3 ExpiryTime:2024-09-24 01:54:56 +0000 UTC Type:0 Mac:52:54:00:20:3c:a7 Iaid: IPaddr:192.168.83.3 Prefix:24 Hostname:old-k8s-version-171598 Clientid:01:52:54:00:20:3c:a7}
I0924 00:55:03.302128 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | domain old-k8s-version-171598 has defined IP address 192.168.83.3 and MAC address 52:54:00:20:3c:a7 in network mk-old-k8s-version-171598
I0924 00:55:03.302382 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetSSHPort
I0924 00:55:03.302396 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetSSHKeyPath
I0924 00:55:03.302586 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetSSHKeyPath
I0924 00:55:03.302585 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetSSHUsername
I0924 00:55:03.302796 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetSSHUsername
I0924 00:55:03.302794 58197 sshutil.go:53] new ssh client: &{IP:192.168.83.3 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19696-7623/.minikube/machines/old-k8s-version-171598/id_rsa Username:docker}
I0924 00:55:03.302952 58197 sshutil.go:53] new ssh client: &{IP:192.168.83.3 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19696-7623/.minikube/machines/old-k8s-version-171598/id_rsa Username:docker}
I0924 00:55:03.386649 58197 ssh_runner.go:195] Run: systemctl --version
I0924 00:55:03.424758 58197 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0924 00:55:03.614118 58197 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0924 00:55:03.621530 58197 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0924 00:55:03.621626 58197 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0924 00:55:03.644213 58197 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0924 00:55:03.644235 58197 start.go:495] detecting cgroup driver to use...
I0924 00:55:03.644313 58197 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0924 00:55:03.668161 58197 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0924 00:55:03.694828 58197 docker.go:217] disabling cri-docker service (if available) ...
I0924 00:55:03.694904 58197 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0924 00:55:03.713736 58197 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0924 00:55:03.730803 58197 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0924 00:55:03.899461 58197 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0924 00:55:04.063545 58197 docker.go:233] disabling docker service ...
I0924 00:55:04.063639 58197 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0924 00:55:04.083164 58197 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0924 00:55:04.097906 58197 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0924 00:55:04.269668 58197 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0924 00:55:04.402316 58197 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0924 00:55:04.418705 58197 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0924 00:55:04.440370 58197 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0924 00:55:04.440437 58197 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0924 00:55:04.451665 58197 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0924 00:55:04.451754 58197 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0924 00:55:04.462760 58197 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0924 00:55:04.475972 58197 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0924 00:55:04.490841 58197 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0924 00:55:04.504910 58197 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0924 00:55:04.517644 58197 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0924 00:55:04.517717 58197 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0924 00:55:04.531792 58197 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0924 00:55:04.543238 58197 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0924 00:55:04.662287 58197 ssh_runner.go:195] Run: sudo systemctl restart crio
I0924 00:55:04.779583 58197 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0924 00:55:04.779661 58197 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0924 00:55:04.785323 58197 start.go:563] Will wait 60s for crictl version
I0924 00:55:04.785424 58197 ssh_runner.go:195] Run: which crictl
I0924 00:55:04.790385 58197 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0924 00:55:04.841899 58197 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0924 00:55:04.841986 58197 ssh_runner.go:195] Run: crio --version
I0924 00:55:04.877618 58197 ssh_runner.go:195] Run: crio --version
I0924 00:55:04.919522 58197 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0924 00:55:04.920721 58197 main.go:141] libmachine: (old-k8s-version-171598) Calling .GetIP
I0924 00:55:04.924275 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | domain old-k8s-version-171598 has defined MAC address 52:54:00:20:3c:a7 in network mk-old-k8s-version-171598
I0924 00:55:04.924972 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:20:3c:a7", ip: ""} in network mk-old-k8s-version-171598: {Iface:virbr3 ExpiryTime:2024-09-24 01:54:56 +0000 UTC Type:0 Mac:52:54:00:20:3c:a7 Iaid: IPaddr:192.168.83.3 Prefix:24 Hostname:old-k8s-version-171598 Clientid:01:52:54:00:20:3c:a7}
I0924 00:55:04.924991 58197 main.go:141] libmachine: (old-k8s-version-171598) DBG | domain old-k8s-version-171598 has defined IP address 192.168.83.3 and MAC address 52:54:00:20:3c:a7 in network mk-old-k8s-version-171598
I0924 00:55:04.926038 58197 ssh_runner.go:195] Run: grep 192.168.83.1 host.minikube.internal$ /etc/hosts
I0924 00:55:04.931574 58197 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.83.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0924 00:55:04.948996 58197 kubeadm.go:883] updating cluster {Name:old-k8s-version-171598 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19696/minikube-v1.34.0-1727108440-19696-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-171598 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.83.3 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mou
ntPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0924 00:55:04.949142 58197 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0924 00:55:04.949213 58197 ssh_runner.go:195] Run: sudo crictl images --output json
I0924 00:55:04.994604 58197 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0924 00:55:04.994664 58197 ssh_runner.go:195] Run: which lz4
I0924 00:55:04.999098 58197 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0924 00:55:05.003940 58197 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0924 00:55:05.003978 58197 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-7623/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0924 00:55:06.629690 58197 crio.go:462] duration metric: took 1.630625581s to copy over tarball
I0924 00:55:06.629769 58197 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0924 00:55:09.431945 58197 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.802147974s)
I0924 00:55:09.431981 58197 crio.go:469] duration metric: took 2.802260804s to extract the tarball
I0924 00:55:09.431992 58197 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0924 00:55:09.476258 58197 ssh_runner.go:195] Run: sudo crictl images --output json
I0924 00:55:09.520740 58197 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0924 00:55:09.520771 58197 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0924 00:55:09.520835 58197 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0924 00:55:09.520845 58197 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0924 00:55:09.520852 58197 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0924 00:55:09.520892 58197 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0924 00:55:09.520903 58197 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0924 00:55:09.521077 58197 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0924 00:55:09.521133 58197 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0924 00:55:09.521151 58197 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0924 00:55:09.522736 58197 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0924 00:55:09.522855 58197 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0924 00:55:09.523096 58197 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0924 00:55:09.523265 58197 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0924 00:55:09.523276 58197 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0924 00:55:09.523987 58197 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0924 00:55:09.524413 58197 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0924 00:55:09.524440 58197 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0924 00:55:09.747170 58197 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0924 00:55:09.795033 58197 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0924 00:55:09.795077 58197 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0924 00:55:09.795121 58197 ssh_runner.go:195] Run: which crictl
I0924 00:55:09.799304 58197 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0924 00:55:09.843706 58197 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0924 00:55:09.845992 58197 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0924 00:55:09.850443 58197 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0924 00:55:09.854306 58197 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0924 00:55:09.864960 58197 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0924 00:55:09.875382 58197 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0924 00:55:09.887671 58197 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0924 00:55:09.927128 58197 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0924 00:55:10.011970 58197 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0924 00:55:10.012020 58197 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0924 00:55:10.012070 58197 ssh_runner.go:195] Run: which crictl
I0924 00:55:10.032032 58197 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0924 00:55:10.032097 58197 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0924 00:55:10.032141 58197 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0924 00:55:10.032199 58197 ssh_runner.go:195] Run: which crictl
I0924 00:55:10.032105 58197 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0924 00:55:10.032311 58197 ssh_runner.go:195] Run: which crictl
I0924 00:55:10.032050 58197 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0924 00:55:10.032398 58197 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0924 00:55:10.032451 58197 ssh_runner.go:195] Run: which crictl
I0924 00:55:10.032041 58197 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0924 00:55:10.032486 58197 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0924 00:55:10.032515 58197 ssh_runner.go:195] Run: which crictl
I0924 00:55:10.063272 58197 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0924 00:55:10.063322 58197 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0924 00:55:10.063390 58197 ssh_runner.go:195] Run: which crictl
I0924 00:55:10.074521 58197 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19696-7623/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0924 00:55:10.074569 58197 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0924 00:55:10.074622 58197 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0924 00:55:10.074777 58197 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0924 00:55:10.074780 58197 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0924 00:55:10.074847 58197 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0924 00:55:10.074896 58197 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0924 00:55:10.203250 58197 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0924 00:55:10.204480 58197 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0924 00:55:10.226319 58197 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0924 00:55:10.226406 58197 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0924 00:55:10.226445 58197 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0924 00:55:10.226635 58197 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0924 00:55:10.311395 58197 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0924 00:55:10.316374 58197 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0924 00:55:10.370891 58197 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0924 00:55:10.378600 58197 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0924 00:55:10.378619 58197 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0924 00:55:10.378663 58197 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0924 00:55:10.404004 58197 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19696-7623/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0924 00:55:10.409284 58197 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19696-7623/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0924 00:55:10.447183 58197 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19696-7623/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0924 00:55:10.477799 58197 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19696-7623/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0924 00:55:10.487928 58197 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19696-7623/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0924 00:55:10.487952 58197 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19696-7623/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0924 00:55:10.718161 58197 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0924 00:55:10.858849 58197 cache_images.go:92] duration metric: took 1.338064189s to LoadCachedImages
W0924 00:55:10.858965 58197 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19696-7623/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19696-7623/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2: no such file or directory
I0924 00:55:10.858982 58197 kubeadm.go:934] updating node { 192.168.83.3 8443 v1.20.0 crio true true} ...
I0924 00:55:10.859100 58197 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-171598 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.83.3
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-171598 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0924 00:55:10.859209 58197 ssh_runner.go:195] Run: crio config
I0924 00:55:10.914947 58197 cni.go:84] Creating CNI manager for ""
I0924 00:55:10.914970 58197 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0924 00:55:10.914981 58197 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0924 00:55:10.915000 58197 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.83.3 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-171598 NodeName:old-k8s-version-171598 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.83.3"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.83.3 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPo
dPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0924 00:55:10.915160 58197 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.83.3
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-171598"
kubeletExtraArgs:
node-ip: 192.168.83.3
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.83.3"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0924 00:55:10.915235 58197 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0924 00:55:10.926591 58197 binaries.go:44] Found k8s binaries, skipping transfer
I0924 00:55:10.926669 58197 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0924 00:55:10.937086 58197 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (428 bytes)
I0924 00:55:10.955192 58197 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0924 00:55:10.975809 58197 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2117 bytes)
I0924 00:55:10.995353 58197 ssh_runner.go:195] Run: grep 192.168.83.3 control-plane.minikube.internal$ /etc/hosts
I0924 00:55:10.999588 58197 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.83.3 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0924 00:55:11.012319 58197 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0924 00:55:11.150680 58197 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0924 00:55:11.169341 58197 certs.go:68] Setting up /home/jenkins/minikube-integration/19696-7623/.minikube/profiles/old-k8s-version-171598 for IP: 192.168.83.3
I0924 00:55:11.169366 58197 certs.go:194] generating shared ca certs ...
I0924 00:55:11.169386 58197 certs.go:226] acquiring lock for ca certs: {Name:mk91de42c259e96c17f08dd58c70c00821bd0735 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0924 00:55:11.169576 58197 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19696-7623/.minikube/ca.key
I0924 00:55:11.169635 58197 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19696-7623/.minikube/proxy-client-ca.key
I0924 00:55:11.169648 58197 certs.go:256] generating profile certs ...
I0924 00:55:11.169730 58197 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19696-7623/.minikube/profiles/old-k8s-version-171598/client.key
I0924 00:55:11.169749 58197 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19696-7623/.minikube/profiles/old-k8s-version-171598/client.crt with IP's: []
I0924 00:55:11.430685 58197 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19696-7623/.minikube/profiles/old-k8s-version-171598/client.crt ...
I0924 00:55:11.430717 58197 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19696-7623/.minikube/profiles/old-k8s-version-171598/client.crt: {Name:mk616c57559c12729f15fc6afa6340c84f32404b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0924 00:55:11.430922 58197 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19696-7623/.minikube/profiles/old-k8s-version-171598/client.key ...
I0924 00:55:11.430939 58197 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19696-7623/.minikube/profiles/old-k8s-version-171598/client.key: {Name:mk5e1df5936a7518cda5d33542be867b8911f037 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0924 00:55:11.431056 58197 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19696-7623/.minikube/profiles/old-k8s-version-171598/apiserver.key.577554d3
I0924 00:55:11.431074 58197 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19696-7623/.minikube/profiles/old-k8s-version-171598/apiserver.crt.577554d3 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.83.3]
I0924 00:55:11.883770 58197 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19696-7623/.minikube/profiles/old-k8s-version-171598/apiserver.crt.577554d3 ...
I0924 00:55:11.883816 58197 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19696-7623/.minikube/profiles/old-k8s-version-171598/apiserver.crt.577554d3: {Name:mkc35d328d004db968a560da2814aa8a204607ed Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0924 00:55:11.884029 58197 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19696-7623/.minikube/profiles/old-k8s-version-171598/apiserver.key.577554d3 ...
I0924 00:55:11.884049 58197 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19696-7623/.minikube/profiles/old-k8s-version-171598/apiserver.key.577554d3: {Name:mkd8777464b5dd7ebecde7ec9927e3e1b2235b66 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0924 00:55:11.884159 58197 certs.go:381] copying /home/jenkins/minikube-integration/19696-7623/.minikube/profiles/old-k8s-version-171598/apiserver.crt.577554d3 -> /home/jenkins/minikube-integration/19696-7623/.minikube/profiles/old-k8s-version-171598/apiserver.crt
I0924 00:55:11.884291 58197 certs.go:385] copying /home/jenkins/minikube-integration/19696-7623/.minikube/profiles/old-k8s-version-171598/apiserver.key.577554d3 -> /home/jenkins/minikube-integration/19696-7623/.minikube/profiles/old-k8s-version-171598/apiserver.key
I0924 00:55:11.884414 58197 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19696-7623/.minikube/profiles/old-k8s-version-171598/proxy-client.key
I0924 00:55:11.884439 58197 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19696-7623/.minikube/profiles/old-k8s-version-171598/proxy-client.crt with IP's: []
I0924 00:55:12.061948 58197 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19696-7623/.minikube/profiles/old-k8s-version-171598/proxy-client.crt ...
I0924 00:55:12.061981 58197 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19696-7623/.minikube/profiles/old-k8s-version-171598/proxy-client.crt: {Name:mkbdcaee3095c012d8003e8c8a96b2287ba0a954 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0924 00:55:12.062168 58197 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19696-7623/.minikube/profiles/old-k8s-version-171598/proxy-client.key ...
I0924 00:55:12.062186 58197 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19696-7623/.minikube/profiles/old-k8s-version-171598/proxy-client.key: {Name:mkf18d79cc3b0f3df25fedb6ab2177c4fe89a5f3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0924 00:55:12.062383 58197 certs.go:484] found cert: /home/jenkins/minikube-integration/19696-7623/.minikube/certs/14793.pem (1338 bytes)
W0924 00:55:12.062438 58197 certs.go:480] ignoring /home/jenkins/minikube-integration/19696-7623/.minikube/certs/14793_empty.pem, impossibly tiny 0 bytes
I0924 00:55:12.062454 58197 certs.go:484] found cert: /home/jenkins/minikube-integration/19696-7623/.minikube/certs/ca-key.pem (1675 bytes)
I0924 00:55:12.062499 58197 certs.go:484] found cert: /home/jenkins/minikube-integration/19696-7623/.minikube/certs/ca.pem (1082 bytes)
I0924 00:55:12.062533 58197 certs.go:484] found cert: /home/jenkins/minikube-integration/19696-7623/.minikube/certs/cert.pem (1123 bytes)
I0924 00:55:12.062566 58197 certs.go:484] found cert: /home/jenkins/minikube-integration/19696-7623/.minikube/certs/key.pem (1679 bytes)
I0924 00:55:12.062626 58197 certs.go:484] found cert: /home/jenkins/minikube-integration/19696-7623/.minikube/files/etc/ssl/certs/147932.pem (1708 bytes)
I0924 00:55:12.063237 58197 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-7623/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0924 00:55:12.105982 58197 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-7623/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0924 00:55:12.145329 58197 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-7623/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0924 00:55:12.170145 58197 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-7623/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0924 00:55:12.194790 58197 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-7623/.minikube/profiles/old-k8s-version-171598/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0924 00:55:12.219640 58197 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-7623/.minikube/profiles/old-k8s-version-171598/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0924 00:55:12.245732 58197 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-7623/.minikube/profiles/old-k8s-version-171598/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0924 00:55:12.268826 58197 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-7623/.minikube/profiles/old-k8s-version-171598/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0924 00:55:12.291732 58197 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-7623/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0924 00:55:12.314938 58197 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-7623/.minikube/certs/14793.pem --> /usr/share/ca-certificates/14793.pem (1338 bytes)
I0924 00:55:12.341672 58197 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19696-7623/.minikube/files/etc/ssl/certs/147932.pem --> /usr/share/ca-certificates/147932.pem (1708 bytes)
I0924 00:55:12.368258 58197 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0924 00:55:12.386468 58197 ssh_runner.go:195] Run: openssl version
I0924 00:55:12.392885 58197 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0924 00:55:12.403889 58197 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0924 00:55:12.408583 58197 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 23 23:38 /usr/share/ca-certificates/minikubeCA.pem
I0924 00:55:12.408639 58197 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0924 00:55:12.415043 58197 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0924 00:55:12.426581 58197 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14793.pem && ln -fs /usr/share/ca-certificates/14793.pem /etc/ssl/certs/14793.pem"
I0924 00:55:12.438775 58197 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14793.pem
I0924 00:55:12.443896 58197 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 23 23:55 /usr/share/ca-certificates/14793.pem
I0924 00:55:12.443968 58197 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14793.pem
I0924 00:55:12.451943 58197 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/14793.pem /etc/ssl/certs/51391683.0"
I0924 00:55:12.463415 58197 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/147932.pem && ln -fs /usr/share/ca-certificates/147932.pem /etc/ssl/certs/147932.pem"
I0924 00:55:12.475627 58197 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/147932.pem
I0924 00:55:12.480586 58197 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 23 23:55 /usr/share/ca-certificates/147932.pem
I0924 00:55:12.480655 58197 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/147932.pem
I0924 00:55:12.486577 58197 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/147932.pem /etc/ssl/certs/3ec20f2e.0"
I0924 00:55:12.497456 58197 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0924 00:55:12.502868 58197 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0924 00:55:12.502937 58197 kubeadm.go:392] StartCluster: {Name:old-k8s-version-171598 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19696/minikube-v1.34.0-1727108440-19696-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-171598 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.83.3 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountP
ort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0924 00:55:12.503037 58197 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0924 00:55:12.503108 58197 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0924 00:55:12.540729 58197 cri.go:89] found id: ""
I0924 00:55:12.540807 58197 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0924 00:55:12.550453 58197 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0924 00:55:12.560243 58197 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0924 00:55:12.570448 58197 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0924 00:55:12.570471 58197 kubeadm.go:157] found existing configuration files:
I0924 00:55:12.570544 58197 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0924 00:55:12.579773 58197 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0924 00:55:12.579836 58197 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0924 00:55:12.589453 58197 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0924 00:55:12.598775 58197 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0924 00:55:12.598836 58197 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0924 00:55:12.608535 58197 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0924 00:55:12.618445 58197 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0924 00:55:12.618520 58197 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0924 00:55:12.627871 58197 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0924 00:55:12.640097 58197 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0924 00:55:12.640164 58197 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0924 00:55:12.649427 58197 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0924 00:55:12.763381 58197 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0924 00:55:12.763453 58197 kubeadm.go:310] [preflight] Running pre-flight checks
I0924 00:55:12.939530 58197 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0924 00:55:12.939723 58197 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0924 00:55:12.939876 58197 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0924 00:55:13.137960 58197 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0924 00:55:13.140188 58197 out.go:235] - Generating certificates and keys ...
I0924 00:55:13.140309 58197 kubeadm.go:310] [certs] Using existing ca certificate authority
I0924 00:55:13.140397 58197 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0924 00:55:13.254000 58197 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0924 00:55:13.413517 58197 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0924 00:55:13.476007 58197 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0924 00:55:13.610945 58197 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0924 00:55:13.696657 58197 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0924 00:55:13.696968 58197 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-171598] and IPs [192.168.83.3 127.0.0.1 ::1]
I0924 00:55:13.887739 58197 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0924 00:55:13.887927 58197 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-171598] and IPs [192.168.83.3 127.0.0.1 ::1]
I0924 00:55:14.067317 58197 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0924 00:55:14.142058 58197 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0924 00:55:14.260531 58197 kubeadm.go:310] [certs] Generating "sa" key and public key
I0924 00:55:14.260648 58197 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0924 00:55:14.699218 58197 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0924 00:55:14.791856 58197 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0924 00:55:14.971392 58197 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0924 00:55:15.065251 58197 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0924 00:55:15.094012 58197 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0924 00:55:15.095244 58197 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0924 00:55:15.095332 58197 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0924 00:55:15.242552 58197 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0924 00:55:15.244496 58197 out.go:235] - Booting up control plane ...
I0924 00:55:15.244633 58197 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0924 00:55:15.254906 58197 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0924 00:55:15.258639 58197 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0924 00:55:15.259617 58197 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0924 00:55:15.272758 58197 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0924 00:55:55.239128 58197 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0924 00:55:55.239882 58197 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0924 00:55:55.240069 58197 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0924 00:56:00.238991 58197 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0924 00:56:00.239233 58197 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0924 00:56:10.238009 58197 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0924 00:56:10.238276 58197 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0924 00:56:30.238236 58197 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0924 00:56:30.238455 58197 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0924 00:57:10.236498 58197 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0924 00:57:10.236811 58197 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0924 00:57:10.236835 58197 kubeadm.go:310]
I0924 00:57:10.236886 58197 kubeadm.go:310] Unfortunately, an error has occurred:
I0924 00:57:10.236952 58197 kubeadm.go:310] timed out waiting for the condition
I0924 00:57:10.236962 58197 kubeadm.go:310]
I0924 00:57:10.237018 58197 kubeadm.go:310] This error is likely caused by:
I0924 00:57:10.237058 58197 kubeadm.go:310] - The kubelet is not running
I0924 00:57:10.237193 58197 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0924 00:57:10.237199 58197 kubeadm.go:310]
I0924 00:57:10.237337 58197 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0924 00:57:10.237381 58197 kubeadm.go:310] - 'systemctl status kubelet'
I0924 00:57:10.237425 58197 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0924 00:57:10.237431 58197 kubeadm.go:310]
I0924 00:57:10.237566 58197 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0924 00:57:10.237672 58197 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0924 00:57:10.237679 58197 kubeadm.go:310]
I0924 00:57:10.237806 58197 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0924 00:57:10.237920 58197 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0924 00:57:10.238016 58197 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0924 00:57:10.238106 58197 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0924 00:57:10.238113 58197 kubeadm.go:310]
I0924 00:57:10.239180 58197 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0924 00:57:10.239314 58197 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0924 00:57:10.239402 58197 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
W0924 00:57:10.239551 58197 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-171598] and IPs [192.168.83.3 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-171598] and IPs [192.168.83.3 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-171598] and IPs [192.168.83.3 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-171598] and IPs [192.168.83.3 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0924 00:57:10.239602 58197 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0924 00:57:10.705530 58197 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0924 00:57:10.721993 58197 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0924 00:57:10.731415 58197 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0924 00:57:10.731440 58197 kubeadm.go:157] found existing configuration files:
I0924 00:57:10.731488 58197 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0924 00:57:10.740743 58197 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0924 00:57:10.740815 58197 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0924 00:57:10.753240 58197 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0924 00:57:10.765378 58197 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0924 00:57:10.765453 58197 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0924 00:57:10.776798 58197 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0924 00:57:10.788549 58197 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0924 00:57:10.788607 58197 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0924 00:57:10.801385 58197 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0924 00:57:10.813926 58197 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0924 00:57:10.813995 58197 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0924 00:57:10.825711 58197 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0924 00:57:10.901635 58197 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0924 00:57:10.901769 58197 kubeadm.go:310] [preflight] Running pre-flight checks
I0924 00:57:11.055037 58197 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0924 00:57:11.055185 58197 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0924 00:57:11.055352 58197 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0924 00:57:11.245084 58197 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0924 00:57:11.246648 58197 out.go:235] - Generating certificates and keys ...
I0924 00:57:11.246746 58197 kubeadm.go:310] [certs] Using existing ca certificate authority
I0924 00:57:11.246822 58197 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0924 00:57:11.246927 58197 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0924 00:57:11.247012 58197 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0924 00:57:11.247112 58197 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0924 00:57:11.247201 58197 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0924 00:57:11.247650 58197 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0924 00:57:11.248206 58197 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0924 00:57:11.248932 58197 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0924 00:57:11.249577 58197 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0924 00:57:11.249782 58197 kubeadm.go:310] [certs] Using the existing "sa" key
I0924 00:57:11.249866 58197 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0924 00:57:11.395658 58197 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0924 00:57:11.450324 58197 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0924 00:57:11.753855 58197 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0924 00:57:11.956228 58197 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0924 00:57:11.977230 58197 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0924 00:57:11.978371 58197 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0924 00:57:11.978479 58197 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0924 00:57:12.123633 58197 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0924 00:57:12.125515 58197 out.go:235] - Booting up control plane ...
I0924 00:57:12.125645 58197 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0924 00:57:12.132112 58197 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0924 00:57:12.133042 58197 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0924 00:57:12.133778 58197 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0924 00:57:12.135726 58197 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0924 00:57:52.137452 58197 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0924 00:57:52.137758 58197 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0924 00:57:52.137994 58197 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0924 00:57:57.138668 58197 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0924 00:57:57.138876 58197 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0924 00:58:07.139453 58197 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0924 00:58:07.139638 58197 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0924 00:58:27.141025 58197 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0924 00:58:27.141259 58197 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0924 00:59:07.141045 58197 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0924 00:59:07.141256 58197 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0924 00:59:07.141270 58197 kubeadm.go:310]
I0924 00:59:07.141310 58197 kubeadm.go:310] Unfortunately, an error has occurred:
I0924 00:59:07.141343 58197 kubeadm.go:310] timed out waiting for the condition
I0924 00:59:07.141353 58197 kubeadm.go:310]
I0924 00:59:07.141389 58197 kubeadm.go:310] This error is likely caused by:
I0924 00:59:07.141420 58197 kubeadm.go:310] - The kubelet is not running
I0924 00:59:07.141540 58197 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0924 00:59:07.141552 58197 kubeadm.go:310]
I0924 00:59:07.141667 58197 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0924 00:59:07.141705 58197 kubeadm.go:310] - 'systemctl status kubelet'
I0924 00:59:07.141752 58197 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0924 00:59:07.141762 58197 kubeadm.go:310]
I0924 00:59:07.141889 58197 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0924 00:59:07.141999 58197 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0924 00:59:07.142010 58197 kubeadm.go:310]
I0924 00:59:07.142138 58197 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0924 00:59:07.142257 58197 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0924 00:59:07.142356 58197 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0924 00:59:07.142452 58197 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0924 00:59:07.142461 58197 kubeadm.go:310]
I0924 00:59:07.143517 58197 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0924 00:59:07.143626 58197 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0924 00:59:07.143720 58197 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0924 00:59:07.143800 58197 kubeadm.go:394] duration metric: took 3m54.640867952s to StartCluster
I0924 00:59:07.143838 58197 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0924 00:59:07.143889 58197 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0924 00:59:07.195056 58197 cri.go:89] found id: ""
I0924 00:59:07.195086 58197 logs.go:276] 0 containers: []
W0924 00:59:07.195097 58197 logs.go:278] No container was found matching "kube-apiserver"
I0924 00:59:07.195105 58197 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0924 00:59:07.195166 58197 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0924 00:59:07.230743 58197 cri.go:89] found id: ""
I0924 00:59:07.230767 58197 logs.go:276] 0 containers: []
W0924 00:59:07.230776 58197 logs.go:278] No container was found matching "etcd"
I0924 00:59:07.230783 58197 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0924 00:59:07.230844 58197 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0924 00:59:07.263706 58197 cri.go:89] found id: ""
I0924 00:59:07.263734 58197 logs.go:276] 0 containers: []
W0924 00:59:07.263745 58197 logs.go:278] No container was found matching "coredns"
I0924 00:59:07.263752 58197 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0924 00:59:07.263802 58197 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0924 00:59:07.298583 58197 cri.go:89] found id: ""
I0924 00:59:07.298613 58197 logs.go:276] 0 containers: []
W0924 00:59:07.298622 58197 logs.go:278] No container was found matching "kube-scheduler"
I0924 00:59:07.298628 58197 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0924 00:59:07.298681 58197 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0924 00:59:07.335812 58197 cri.go:89] found id: ""
I0924 00:59:07.335843 58197 logs.go:276] 0 containers: []
W0924 00:59:07.335851 58197 logs.go:278] No container was found matching "kube-proxy"
I0924 00:59:07.335857 58197 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0924 00:59:07.335965 58197 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0924 00:59:07.368476 58197 cri.go:89] found id: ""
I0924 00:59:07.368504 58197 logs.go:276] 0 containers: []
W0924 00:59:07.368513 58197 logs.go:278] No container was found matching "kube-controller-manager"
I0924 00:59:07.368519 58197 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0924 00:59:07.368566 58197 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0924 00:59:07.401430 58197 cri.go:89] found id: ""
I0924 00:59:07.401459 58197 logs.go:276] 0 containers: []
W0924 00:59:07.401467 58197 logs.go:278] No container was found matching "kindnet"
I0924 00:59:07.401477 58197 logs.go:123] Gathering logs for kubelet ...
I0924 00:59:07.401489 58197 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0924 00:59:07.450308 58197 logs.go:123] Gathering logs for dmesg ...
I0924 00:59:07.450348 58197 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0924 00:59:07.463692 58197 logs.go:123] Gathering logs for describe nodes ...
I0924 00:59:07.463723 58197 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0924 00:59:07.573920 58197 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0924 00:59:07.573944 58197 logs.go:123] Gathering logs for CRI-O ...
I0924 00:59:07.573954 58197 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0924 00:59:07.672349 58197 logs.go:123] Gathering logs for container status ...
I0924 00:59:07.672390 58197 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0924 00:59:07.711470 58197 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0924 00:59:07.711544 58197 out.go:270] *
*
W0924 00:59:07.711608 58197 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0924 00:59:07.711631 58197 out.go:270] *
*
W0924 00:59:07.713001 58197 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0924 00:59:07.716033 58197 out.go:201]
W0924 00:59:07.717191 58197 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0924 00:59:07.717243 58197 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0924 00:59:07.717267 58197 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0924 00:59:07.718640 58197 out.go:201]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-171598 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-171598 -n old-k8s-version-171598
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-171598 -n old-k8s-version-171598: exit status 6 (223.732066ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0924 00:59:07.991854 61193 status.go:451] kubeconfig endpoint: get endpoint: "old-k8s-version-171598" does not appear in /home/jenkins/minikube-integration/19696-7623/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-171598" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (272.40s)