=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:184: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-181389 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:184: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-181389 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m58.506743179s)
-- stdout --
* [old-k8s-version-181389] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=20288
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/20288-247142/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/20288-247142/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-181389" primary control-plane node in "old-k8s-version-181389" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0122 21:16:27.348448 304536 out.go:345] Setting OutFile to fd 1 ...
I0122 21:16:27.349100 304536 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0122 21:16:27.349118 304536 out.go:358] Setting ErrFile to fd 2...
I0122 21:16:27.349127 304536 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0122 21:16:27.349605 304536 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20288-247142/.minikube/bin
I0122 21:16:27.350710 304536 out.go:352] Setting JSON to false
I0122 21:16:27.352131 304536 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-3","uptime":14333,"bootTime":1737566254,"procs":216,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1074-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0122 21:16:27.352262 304536 start.go:139] virtualization: kvm guest
I0122 21:16:27.354323 304536 out.go:177] * [old-k8s-version-181389] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
I0122 21:16:27.355877 304536 out.go:177] - MINIKUBE_LOCATION=20288
I0122 21:16:27.355911 304536 notify.go:220] Checking for updates...
I0122 21:16:27.357490 304536 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0122 21:16:27.359039 304536 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/20288-247142/kubeconfig
I0122 21:16:27.360540 304536 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/20288-247142/.minikube
I0122 21:16:27.362008 304536 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0122 21:16:27.363637 304536 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0122 21:16:27.365583 304536 config.go:182] Loaded profile config "bridge-804887": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.1
I0122 21:16:27.365763 304536 config.go:182] Loaded profile config "enable-default-cni-804887": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.1
I0122 21:16:27.365871 304536 config.go:182] Loaded profile config "flannel-804887": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.1
I0122 21:16:27.366019 304536 driver.go:394] Setting default libvirt URI to qemu:///system
I0122 21:16:27.406950 304536 out.go:177] * Using the kvm2 driver based on user configuration
I0122 21:16:27.408574 304536 start.go:297] selected driver: kvm2
I0122 21:16:27.408601 304536 start.go:901] validating driver "kvm2" against <nil>
I0122 21:16:27.408617 304536 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0122 21:16:27.409851 304536 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0122 21:16:27.410007 304536 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/20288-247142/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0122 21:16:27.427677 304536 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.35.0
I0122 21:16:27.427738 304536 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0122 21:16:27.428019 304536 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0122 21:16:27.428059 304536 cni.go:84] Creating CNI manager for ""
I0122 21:16:27.428123 304536 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0122 21:16:27.428136 304536 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0122 21:16:27.428214 304536 start.go:340] cluster config:
{Name:old-k8s-version-181389 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-181389 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRI
Socket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:
0 GPUs: AutoPauseInterval:1m0s}
I0122 21:16:27.428327 304536 iso.go:125] acquiring lock: {Name:mk30bd26a0b89dc7e1dff013948e67816ce26cb1 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0122 21:16:27.430566 304536 out.go:177] * Starting "old-k8s-version-181389" primary control-plane node in "old-k8s-version-181389" cluster
I0122 21:16:27.431914 304536 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0122 21:16:27.431981 304536 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20288-247142/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0122 21:16:27.431997 304536 cache.go:56] Caching tarball of preloaded images
I0122 21:16:27.432124 304536 preload.go:172] Found /home/jenkins/minikube-integration/20288-247142/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0122 21:16:27.432136 304536 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0122 21:16:27.432312 304536 profile.go:143] Saving config to /home/jenkins/minikube-integration/20288-247142/.minikube/profiles/old-k8s-version-181389/config.json ...
I0122 21:16:27.432338 304536 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20288-247142/.minikube/profiles/old-k8s-version-181389/config.json: {Name:mk0e7128cf874df05c61380a988d5eb6bada0ab2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0122 21:16:27.432534 304536 start.go:360] acquireMachinesLock for old-k8s-version-181389: {Name:mkd3ee07afa7e80b6bcd139f15d206bc8a587a99 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0122 21:16:47.792774 304536 start.go:364] duration metric: took 20.360196146s to acquireMachinesLock for "old-k8s-version-181389"
I0122 21:16:47.792869 304536 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-181389 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-versi
on-181389 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMir
ror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0122 21:16:47.793052 304536 start.go:125] createHost starting for "" (driver="kvm2")
I0122 21:16:47.794575 304536 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0122 21:16:47.794850 304536 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0122 21:16:47.794917 304536 main.go:141] libmachine: Launching plugin server for driver kvm2
I0122 21:16:47.816638 304536 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40215
I0122 21:16:47.817197 304536 main.go:141] libmachine: () Calling .GetVersion
I0122 21:16:47.817973 304536 main.go:141] libmachine: Using API Version 1
I0122 21:16:47.818003 304536 main.go:141] libmachine: () Calling .SetConfigRaw
I0122 21:16:47.818489 304536 main.go:141] libmachine: () Calling .GetMachineName
I0122 21:16:47.818706 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetMachineName
I0122 21:16:47.818896 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .DriverName
I0122 21:16:47.819087 304536 start.go:159] libmachine.API.Create for "old-k8s-version-181389" (driver="kvm2")
I0122 21:16:47.819128 304536 client.go:168] LocalClient.Create starting
I0122 21:16:47.819178 304536 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20288-247142/.minikube/certs/ca.pem
I0122 21:16:47.819237 304536 main.go:141] libmachine: Decoding PEM data...
I0122 21:16:47.819266 304536 main.go:141] libmachine: Parsing certificate...
I0122 21:16:47.819341 304536 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20288-247142/.minikube/certs/cert.pem
I0122 21:16:47.819368 304536 main.go:141] libmachine: Decoding PEM data...
I0122 21:16:47.819386 304536 main.go:141] libmachine: Parsing certificate...
I0122 21:16:47.819413 304536 main.go:141] libmachine: Running pre-create checks...
I0122 21:16:47.819429 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .PreCreateCheck
I0122 21:16:47.819841 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetConfigRaw
I0122 21:16:47.820354 304536 main.go:141] libmachine: Creating machine...
I0122 21:16:47.820371 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .Create
I0122 21:16:47.820531 304536 main.go:141] libmachine: (old-k8s-version-181389) creating KVM machine...
I0122 21:16:47.820555 304536 main.go:141] libmachine: (old-k8s-version-181389) creating network...
I0122 21:16:47.822051 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | found existing default KVM network
I0122 21:16:47.823473 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | I0122 21:16:47.823255 304694 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:1a:77:9d} reservation:<nil>}
I0122 21:16:47.824774 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | I0122 21:16:47.824653 304694 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:2b:58:68} reservation:<nil>}
I0122 21:16:47.826219 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | I0122 21:16:47.826065 304694 network.go:211] skipping subnet 192.168.61.0/24 that is taken: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName:virbr3 IfaceIPv4:192.168.61.1 IfaceMTU:1500 IfaceMAC:52:54:00:ca:cc:02} reservation:<nil>}
I0122 21:16:47.827823 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | I0122 21:16:47.827699 304694 network.go:206] using free private subnet 192.168.72.0/24: &{IP:192.168.72.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.72.0/24 Gateway:192.168.72.1 ClientMin:192.168.72.2 ClientMax:192.168.72.254 Broadcast:192.168.72.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00030b1b0}
I0122 21:16:47.827860 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | created network xml:
I0122 21:16:47.827873 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | <network>
I0122 21:16:47.827881 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | <name>mk-old-k8s-version-181389</name>
I0122 21:16:47.827889 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | <dns enable='no'/>
I0122 21:16:47.827895 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG |
I0122 21:16:47.827914 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | <ip address='192.168.72.1' netmask='255.255.255.0'>
I0122 21:16:47.827921 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | <dhcp>
I0122 21:16:47.827930 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | <range start='192.168.72.2' end='192.168.72.253'/>
I0122 21:16:47.827936 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | </dhcp>
I0122 21:16:47.827944 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | </ip>
I0122 21:16:47.827952 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG |
I0122 21:16:47.827959 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | </network>
I0122 21:16:47.827966 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG |
I0122 21:16:47.834732 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | trying to create private KVM network mk-old-k8s-version-181389 192.168.72.0/24...
I0122 21:16:47.942740 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | private KVM network mk-old-k8s-version-181389 192.168.72.0/24 created
I0122 21:16:47.942844 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | I0122 21:16:47.942694 304694 common.go:144] Making disk image using store path: /home/jenkins/minikube-integration/20288-247142/.minikube
I0122 21:16:47.942884 304536 main.go:141] libmachine: (old-k8s-version-181389) setting up store path in /home/jenkins/minikube-integration/20288-247142/.minikube/machines/old-k8s-version-181389 ...
I0122 21:16:47.942913 304536 main.go:141] libmachine: (old-k8s-version-181389) building disk image from file:///home/jenkins/minikube-integration/20288-247142/.minikube/cache/iso/amd64/minikube-v1.35.0-amd64.iso
I0122 21:16:47.942931 304536 main.go:141] libmachine: (old-k8s-version-181389) Downloading /home/jenkins/minikube-integration/20288-247142/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/20288-247142/.minikube/cache/iso/amd64/minikube-v1.35.0-amd64.iso...
I0122 21:16:48.288974 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | I0122 21:16:48.288757 304694 common.go:151] Creating ssh key: /home/jenkins/minikube-integration/20288-247142/.minikube/machines/old-k8s-version-181389/id_rsa...
I0122 21:16:48.366105 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | I0122 21:16:48.365899 304694 common.go:157] Creating raw disk image: /home/jenkins/minikube-integration/20288-247142/.minikube/machines/old-k8s-version-181389/old-k8s-version-181389.rawdisk...
I0122 21:16:48.366147 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | Writing magic tar header
I0122 21:16:48.366167 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | Writing SSH key tar header
I0122 21:16:48.366254 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | I0122 21:16:48.366069 304694 common.go:171] Fixing permissions on /home/jenkins/minikube-integration/20288-247142/.minikube/machines/old-k8s-version-181389 ...
I0122 21:16:48.366285 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20288-247142/.minikube/machines/old-k8s-version-181389
I0122 21:16:48.366308 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20288-247142/.minikube/machines
I0122 21:16:48.366328 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20288-247142/.minikube
I0122 21:16:48.366340 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20288-247142
I0122 21:16:48.366366 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | checking permissions on dir: /home/jenkins/minikube-integration
I0122 21:16:48.366386 304536 main.go:141] libmachine: (old-k8s-version-181389) setting executable bit set on /home/jenkins/minikube-integration/20288-247142/.minikube/machines/old-k8s-version-181389 (perms=drwx------)
I0122 21:16:48.366398 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | checking permissions on dir: /home/jenkins
I0122 21:16:48.366412 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | checking permissions on dir: /home
I0122 21:16:48.366424 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | skipping /home - not owner
I0122 21:16:48.366449 304536 main.go:141] libmachine: (old-k8s-version-181389) setting executable bit set on /home/jenkins/minikube-integration/20288-247142/.minikube/machines (perms=drwxr-xr-x)
I0122 21:16:48.366464 304536 main.go:141] libmachine: (old-k8s-version-181389) setting executable bit set on /home/jenkins/minikube-integration/20288-247142/.minikube (perms=drwxr-xr-x)
I0122 21:16:48.366474 304536 main.go:141] libmachine: (old-k8s-version-181389) setting executable bit set on /home/jenkins/minikube-integration/20288-247142 (perms=drwxrwxr-x)
I0122 21:16:48.366488 304536 main.go:141] libmachine: (old-k8s-version-181389) setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0122 21:16:48.366501 304536 main.go:141] libmachine: (old-k8s-version-181389) setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0122 21:16:48.366514 304536 main.go:141] libmachine: (old-k8s-version-181389) creating domain...
I0122 21:16:48.367931 304536 main.go:141] libmachine: (old-k8s-version-181389) define libvirt domain using xml:
I0122 21:16:48.367980 304536 main.go:141] libmachine: (old-k8s-version-181389) <domain type='kvm'>
I0122 21:16:48.367992 304536 main.go:141] libmachine: (old-k8s-version-181389) <name>old-k8s-version-181389</name>
I0122 21:16:48.368000 304536 main.go:141] libmachine: (old-k8s-version-181389) <memory unit='MiB'>2200</memory>
I0122 21:16:48.368008 304536 main.go:141] libmachine: (old-k8s-version-181389) <vcpu>2</vcpu>
I0122 21:16:48.368019 304536 main.go:141] libmachine: (old-k8s-version-181389) <features>
I0122 21:16:48.368027 304536 main.go:141] libmachine: (old-k8s-version-181389) <acpi/>
I0122 21:16:48.368037 304536 main.go:141] libmachine: (old-k8s-version-181389) <apic/>
I0122 21:16:48.368045 304536 main.go:141] libmachine: (old-k8s-version-181389) <pae/>
I0122 21:16:48.368055 304536 main.go:141] libmachine: (old-k8s-version-181389)
I0122 21:16:48.368064 304536 main.go:141] libmachine: (old-k8s-version-181389) </features>
I0122 21:16:48.368074 304536 main.go:141] libmachine: (old-k8s-version-181389) <cpu mode='host-passthrough'>
I0122 21:16:48.368107 304536 main.go:141] libmachine: (old-k8s-version-181389)
I0122 21:16:48.368114 304536 main.go:141] libmachine: (old-k8s-version-181389) </cpu>
I0122 21:16:48.368121 304536 main.go:141] libmachine: (old-k8s-version-181389) <os>
I0122 21:16:48.368133 304536 main.go:141] libmachine: (old-k8s-version-181389) <type>hvm</type>
I0122 21:16:48.368140 304536 main.go:141] libmachine: (old-k8s-version-181389) <boot dev='cdrom'/>
I0122 21:16:48.368146 304536 main.go:141] libmachine: (old-k8s-version-181389) <boot dev='hd'/>
I0122 21:16:48.368155 304536 main.go:141] libmachine: (old-k8s-version-181389) <bootmenu enable='no'/>
I0122 21:16:48.368165 304536 main.go:141] libmachine: (old-k8s-version-181389) </os>
I0122 21:16:48.368173 304536 main.go:141] libmachine: (old-k8s-version-181389) <devices>
I0122 21:16:48.368178 304536 main.go:141] libmachine: (old-k8s-version-181389) <disk type='file' device='cdrom'>
I0122 21:16:48.368195 304536 main.go:141] libmachine: (old-k8s-version-181389) <source file='/home/jenkins/minikube-integration/20288-247142/.minikube/machines/old-k8s-version-181389/boot2docker.iso'/>
I0122 21:16:48.368203 304536 main.go:141] libmachine: (old-k8s-version-181389) <target dev='hdc' bus='scsi'/>
I0122 21:16:48.368212 304536 main.go:141] libmachine: (old-k8s-version-181389) <readonly/>
I0122 21:16:48.368218 304536 main.go:141] libmachine: (old-k8s-version-181389) </disk>
I0122 21:16:48.368227 304536 main.go:141] libmachine: (old-k8s-version-181389) <disk type='file' device='disk'>
I0122 21:16:48.368236 304536 main.go:141] libmachine: (old-k8s-version-181389) <driver name='qemu' type='raw' cache='default' io='threads' />
I0122 21:16:48.368252 304536 main.go:141] libmachine: (old-k8s-version-181389) <source file='/home/jenkins/minikube-integration/20288-247142/.minikube/machines/old-k8s-version-181389/old-k8s-version-181389.rawdisk'/>
I0122 21:16:48.368260 304536 main.go:141] libmachine: (old-k8s-version-181389) <target dev='hda' bus='virtio'/>
I0122 21:16:48.368268 304536 main.go:141] libmachine: (old-k8s-version-181389) </disk>
I0122 21:16:48.368276 304536 main.go:141] libmachine: (old-k8s-version-181389) <interface type='network'>
I0122 21:16:48.368286 304536 main.go:141] libmachine: (old-k8s-version-181389) <source network='mk-old-k8s-version-181389'/>
I0122 21:16:48.368297 304536 main.go:141] libmachine: (old-k8s-version-181389) <model type='virtio'/>
I0122 21:16:48.368312 304536 main.go:141] libmachine: (old-k8s-version-181389) </interface>
I0122 21:16:48.368323 304536 main.go:141] libmachine: (old-k8s-version-181389) <interface type='network'>
I0122 21:16:48.368333 304536 main.go:141] libmachine: (old-k8s-version-181389) <source network='default'/>
I0122 21:16:48.368343 304536 main.go:141] libmachine: (old-k8s-version-181389) <model type='virtio'/>
I0122 21:16:48.368352 304536 main.go:141] libmachine: (old-k8s-version-181389) </interface>
I0122 21:16:48.368362 304536 main.go:141] libmachine: (old-k8s-version-181389) <serial type='pty'>
I0122 21:16:48.368371 304536 main.go:141] libmachine: (old-k8s-version-181389) <target port='0'/>
I0122 21:16:48.368380 304536 main.go:141] libmachine: (old-k8s-version-181389) </serial>
I0122 21:16:48.368389 304536 main.go:141] libmachine: (old-k8s-version-181389) <console type='pty'>
I0122 21:16:48.368400 304536 main.go:141] libmachine: (old-k8s-version-181389) <target type='serial' port='0'/>
I0122 21:16:48.368408 304536 main.go:141] libmachine: (old-k8s-version-181389) </console>
I0122 21:16:48.368415 304536 main.go:141] libmachine: (old-k8s-version-181389) <rng model='virtio'>
I0122 21:16:48.368424 304536 main.go:141] libmachine: (old-k8s-version-181389) <backend model='random'>/dev/random</backend>
I0122 21:16:48.368429 304536 main.go:141] libmachine: (old-k8s-version-181389) </rng>
I0122 21:16:48.368436 304536 main.go:141] libmachine: (old-k8s-version-181389)
I0122 21:16:48.368443 304536 main.go:141] libmachine: (old-k8s-version-181389)
I0122 21:16:48.368451 304536 main.go:141] libmachine: (old-k8s-version-181389) </devices>
I0122 21:16:48.368458 304536 main.go:141] libmachine: (old-k8s-version-181389) </domain>
I0122 21:16:48.368469 304536 main.go:141] libmachine: (old-k8s-version-181389)
I0122 21:16:48.373155 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined MAC address 52:54:00:6c:df:82 in network default
I0122 21:16:48.374011 304536 main.go:141] libmachine: (old-k8s-version-181389) starting domain...
I0122 21:16:48.374049 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:16:48.374059 304536 main.go:141] libmachine: (old-k8s-version-181389) ensuring networks are active...
I0122 21:16:48.375086 304536 main.go:141] libmachine: (old-k8s-version-181389) Ensuring network default is active
I0122 21:16:48.375541 304536 main.go:141] libmachine: (old-k8s-version-181389) Ensuring network mk-old-k8s-version-181389 is active
I0122 21:16:48.376293 304536 main.go:141] libmachine: (old-k8s-version-181389) getting domain XML...
I0122 21:16:48.377207 304536 main.go:141] libmachine: (old-k8s-version-181389) creating domain...
I0122 21:16:49.898948 304536 main.go:141] libmachine: (old-k8s-version-181389) waiting for IP...
I0122 21:16:49.900103 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:16:49.900853 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | unable to find current IP address of domain old-k8s-version-181389 in network mk-old-k8s-version-181389
I0122 21:16:49.900949 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | I0122 21:16:49.900847 304694 retry.go:31] will retry after 197.157374ms: waiting for domain to come up
I0122 21:16:50.099601 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:16:50.100392 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | unable to find current IP address of domain old-k8s-version-181389 in network mk-old-k8s-version-181389
I0122 21:16:50.100426 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | I0122 21:16:50.100349 304694 retry.go:31] will retry after 250.812027ms: waiting for domain to come up
I0122 21:16:50.353319 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:16:50.353618 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | unable to find current IP address of domain old-k8s-version-181389 in network mk-old-k8s-version-181389
I0122 21:16:50.353641 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | I0122 21:16:50.353615 304694 retry.go:31] will retry after 430.728513ms: waiting for domain to come up
I0122 21:16:50.786855 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:16:50.786896 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | unable to find current IP address of domain old-k8s-version-181389 in network mk-old-k8s-version-181389
I0122 21:16:50.787026 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | I0122 21:16:50.786917 304694 retry.go:31] will retry after 573.488889ms: waiting for domain to come up
I0122 21:16:51.361895 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:16:51.362695 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | unable to find current IP address of domain old-k8s-version-181389 in network mk-old-k8s-version-181389
I0122 21:16:51.362733 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | I0122 21:16:51.362665 304694 retry.go:31] will retry after 554.527628ms: waiting for domain to come up
I0122 21:16:51.918879 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:16:51.919639 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | unable to find current IP address of domain old-k8s-version-181389 in network mk-old-k8s-version-181389
I0122 21:16:51.919689 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | I0122 21:16:51.919585 304694 retry.go:31] will retry after 860.372762ms: waiting for domain to come up
I0122 21:16:52.781620 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:16:52.782142 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | unable to find current IP address of domain old-k8s-version-181389 in network mk-old-k8s-version-181389
I0122 21:16:52.782172 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | I0122 21:16:52.782099 304694 retry.go:31] will retry after 874.575311ms: waiting for domain to come up
I0122 21:16:53.659093 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:16:53.659755 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | unable to find current IP address of domain old-k8s-version-181389 in network mk-old-k8s-version-181389
I0122 21:16:53.659810 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | I0122 21:16:53.659643 304694 retry.go:31] will retry after 1.051382018s: waiting for domain to come up
I0122 21:16:54.712604 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:16:54.713329 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | unable to find current IP address of domain old-k8s-version-181389 in network mk-old-k8s-version-181389
I0122 21:16:54.713405 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | I0122 21:16:54.713310 304694 retry.go:31] will retry after 1.255028354s: waiting for domain to come up
I0122 21:16:55.970045 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:16:55.970595 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | unable to find current IP address of domain old-k8s-version-181389 in network mk-old-k8s-version-181389
I0122 21:16:55.970626 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | I0122 21:16:55.970551 304694 retry.go:31] will retry after 2.042126107s: waiting for domain to come up
I0122 21:16:58.014810 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:16:58.015346 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | unable to find current IP address of domain old-k8s-version-181389 in network mk-old-k8s-version-181389
I0122 21:16:58.015366 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | I0122 21:16:58.015312 304694 retry.go:31] will retry after 2.056121344s: waiting for domain to come up
I0122 21:17:00.074669 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:17:00.075347 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | unable to find current IP address of domain old-k8s-version-181389 in network mk-old-k8s-version-181389
I0122 21:17:00.075441 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | I0122 21:17:00.075310 304694 retry.go:31] will retry after 3.107597415s: waiting for domain to come up
I0122 21:17:03.185665 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:17:03.186496 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | unable to find current IP address of domain old-k8s-version-181389 in network mk-old-k8s-version-181389
I0122 21:17:03.186523 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | I0122 21:17:03.186383 304694 retry.go:31] will retry after 3.347091187s: waiting for domain to come up
I0122 21:17:06.535541 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:17:06.536212 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | unable to find current IP address of domain old-k8s-version-181389 in network mk-old-k8s-version-181389
I0122 21:17:06.536243 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | I0122 21:17:06.536172 304694 retry.go:31] will retry after 5.208628484s: waiting for domain to come up
I0122 21:17:11.747690 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:17:11.748203 304536 main.go:141] libmachine: (old-k8s-version-181389) found domain IP: 192.168.72.222
I0122 21:17:11.748227 304536 main.go:141] libmachine: (old-k8s-version-181389) reserving static IP address...
I0122 21:17:11.748241 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has current primary IP address 192.168.72.222 and MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:17:11.748738 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-181389", mac: "52:54:00:b5:43:94", ip: "192.168.72.222"} in network mk-old-k8s-version-181389
I0122 21:17:11.876127 304536 main.go:141] libmachine: (old-k8s-version-181389) reserved static IP address 192.168.72.222 for domain old-k8s-version-181389
I0122 21:17:11.876158 304536 main.go:141] libmachine: (old-k8s-version-181389) waiting for SSH...
I0122 21:17:11.876180 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | Getting to WaitForSSH function...
I0122 21:17:11.884279 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:17:11.887924 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | unable to find host DHCP lease matching {name: "", mac: "52:54:00:b5:43:94", ip: ""} in network mk-old-k8s-version-181389
I0122 21:17:11.887958 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | unable to find defined IP address of network mk-old-k8s-version-181389 interface with MAC address 52:54:00:b5:43:94
I0122 21:17:11.888534 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | Using SSH client type: external
I0122 21:17:11.888560 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | Using SSH private key: /home/jenkins/minikube-integration/20288-247142/.minikube/machines/old-k8s-version-181389/id_rsa (-rw-------)
I0122 21:17:11.888590 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@ -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/20288-247142/.minikube/machines/old-k8s-version-181389/id_rsa -p 22] /usr/bin/ssh <nil>}
I0122 21:17:11.888604 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | About to run SSH command:
I0122 21:17:11.888630 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | exit 0
I0122 21:17:11.894277 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | SSH cmd err, output: exit status 255:
I0122 21:17:11.894300 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | Error getting ssh command 'exit 0' : ssh command error:
I0122 21:17:11.894308 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | command : exit 0
I0122 21:17:11.894313 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | err : exit status 255
I0122 21:17:11.894321 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | output :
I0122 21:17:14.894975 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | Getting to WaitForSSH function...
I0122 21:17:14.898335 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:17:14.898846 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b5:43:94", ip: ""} in network mk-old-k8s-version-181389: {Iface:virbr4 ExpiryTime:2025-01-22 22:17:06 +0000 UTC Type:0 Mac:52:54:00:b5:43:94 Iaid: IPaddr:192.168.72.222 Prefix:24 Hostname:old-k8s-version-181389 Clientid:01:52:54:00:b5:43:94}
I0122 21:17:14.898871 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined IP address 192.168.72.222 and MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:17:14.899171 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | Using SSH client type: external
I0122 21:17:14.899201 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | Using SSH private key: /home/jenkins/minikube-integration/20288-247142/.minikube/machines/old-k8s-version-181389/id_rsa (-rw-------)
I0122 21:17:14.899240 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.72.222 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/20288-247142/.minikube/machines/old-k8s-version-181389/id_rsa -p 22] /usr/bin/ssh <nil>}
I0122 21:17:14.899257 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | About to run SSH command:
I0122 21:17:14.899270 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | exit 0
I0122 21:17:15.039833 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | SSH cmd err, output: <nil>:
I0122 21:17:15.040031 304536 main.go:141] libmachine: (old-k8s-version-181389) KVM machine creation complete
I0122 21:17:15.040419 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetConfigRaw
I0122 21:17:15.041285 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .DriverName
I0122 21:17:15.041569 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .DriverName
I0122 21:17:15.041752 304536 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0122 21:17:15.041769 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetState
I0122 21:17:15.043618 304536 main.go:141] libmachine: Detecting operating system of created instance...
I0122 21:17:15.043639 304536 main.go:141] libmachine: Waiting for SSH to be available...
I0122 21:17:15.043645 304536 main.go:141] libmachine: Getting to WaitForSSH function...
I0122 21:17:15.043652 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetSSHHostname
I0122 21:17:15.046829 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:17:15.048738 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b5:43:94", ip: ""} in network mk-old-k8s-version-181389: {Iface:virbr4 ExpiryTime:2025-01-22 22:17:06 +0000 UTC Type:0 Mac:52:54:00:b5:43:94 Iaid: IPaddr:192.168.72.222 Prefix:24 Hostname:old-k8s-version-181389 Clientid:01:52:54:00:b5:43:94}
I0122 21:17:15.048766 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined IP address 192.168.72.222 and MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:17:15.049098 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetSSHPort
I0122 21:17:15.049366 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetSSHKeyPath
I0122 21:17:15.049569 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetSSHKeyPath
I0122 21:17:15.049751 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetSSHUsername
I0122 21:17:15.049990 304536 main.go:141] libmachine: Using SSH client type: native
I0122 21:17:15.050301 304536 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.72.222 22 <nil> <nil>}
I0122 21:17:15.050321 304536 main.go:141] libmachine: About to run SSH command:
exit 0
I0122 21:17:15.199419 304536 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0122 21:17:15.199448 304536 main.go:141] libmachine: Detecting the provisioner...
I0122 21:17:15.199461 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetSSHHostname
I0122 21:17:15.203213 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:17:15.203646 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b5:43:94", ip: ""} in network mk-old-k8s-version-181389: {Iface:virbr4 ExpiryTime:2025-01-22 22:17:06 +0000 UTC Type:0 Mac:52:54:00:b5:43:94 Iaid: IPaddr:192.168.72.222 Prefix:24 Hostname:old-k8s-version-181389 Clientid:01:52:54:00:b5:43:94}
I0122 21:17:15.203705 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined IP address 192.168.72.222 and MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:17:15.203911 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetSSHPort
I0122 21:17:15.204170 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetSSHKeyPath
I0122 21:17:15.204388 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetSSHKeyPath
I0122 21:17:15.204548 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetSSHUsername
I0122 21:17:15.204726 304536 main.go:141] libmachine: Using SSH client type: native
I0122 21:17:15.205047 304536 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.72.222 22 <nil> <nil>}
I0122 21:17:15.205120 304536 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0122 21:17:15.332322 304536 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0122 21:17:15.332414 304536 main.go:141] libmachine: found compatible host: buildroot
I0122 21:17:15.332426 304536 main.go:141] libmachine: Provisioning with buildroot...
I0122 21:17:15.332436 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetMachineName
I0122 21:17:15.332733 304536 buildroot.go:166] provisioning hostname "old-k8s-version-181389"
I0122 21:17:15.332765 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetMachineName
I0122 21:17:15.332967 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetSSHHostname
I0122 21:17:15.336523 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:17:15.336976 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b5:43:94", ip: ""} in network mk-old-k8s-version-181389: {Iface:virbr4 ExpiryTime:2025-01-22 22:17:06 +0000 UTC Type:0 Mac:52:54:00:b5:43:94 Iaid: IPaddr:192.168.72.222 Prefix:24 Hostname:old-k8s-version-181389 Clientid:01:52:54:00:b5:43:94}
I0122 21:17:15.337015 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined IP address 192.168.72.222 and MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:17:15.337149 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetSSHPort
I0122 21:17:15.337398 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetSSHKeyPath
I0122 21:17:15.337589 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetSSHKeyPath
I0122 21:17:15.337794 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetSSHUsername
I0122 21:17:15.337992 304536 main.go:141] libmachine: Using SSH client type: native
I0122 21:17:15.338224 304536 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.72.222 22 <nil> <nil>}
I0122 21:17:15.338243 304536 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-181389 && echo "old-k8s-version-181389" | sudo tee /etc/hostname
I0122 21:17:15.484507 304536 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-181389
I0122 21:17:15.484555 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetSSHHostname
I0122 21:17:15.488091 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:17:15.488623 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b5:43:94", ip: ""} in network mk-old-k8s-version-181389: {Iface:virbr4 ExpiryTime:2025-01-22 22:17:06 +0000 UTC Type:0 Mac:52:54:00:b5:43:94 Iaid: IPaddr:192.168.72.222 Prefix:24 Hostname:old-k8s-version-181389 Clientid:01:52:54:00:b5:43:94}
I0122 21:17:15.488673 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined IP address 192.168.72.222 and MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:17:15.489020 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetSSHPort
I0122 21:17:15.489246 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetSSHKeyPath
I0122 21:17:15.489448 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetSSHKeyPath
I0122 21:17:15.489603 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetSSHUsername
I0122 21:17:15.489768 304536 main.go:141] libmachine: Using SSH client type: native
I0122 21:17:15.489971 304536 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.72.222 22 <nil> <nil>}
I0122 21:17:15.489988 304536 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-181389' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-181389/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-181389' | sudo tee -a /etc/hosts;
fi
fi
I0122 21:17:15.626917 304536 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0122 21:17:15.626961 304536 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/20288-247142/.minikube CaCertPath:/home/jenkins/minikube-integration/20288-247142/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20288-247142/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20288-247142/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20288-247142/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20288-247142/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20288-247142/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20288-247142/.minikube}
I0122 21:17:15.627003 304536 buildroot.go:174] setting up certificates
I0122 21:17:15.627020 304536 provision.go:84] configureAuth start
I0122 21:17:15.627037 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetMachineName
I0122 21:17:15.627394 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetIP
I0122 21:17:15.631234 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:17:15.631625 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b5:43:94", ip: ""} in network mk-old-k8s-version-181389: {Iface:virbr4 ExpiryTime:2025-01-22 22:17:06 +0000 UTC Type:0 Mac:52:54:00:b5:43:94 Iaid: IPaddr:192.168.72.222 Prefix:24 Hostname:old-k8s-version-181389 Clientid:01:52:54:00:b5:43:94}
I0122 21:17:15.631663 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined IP address 192.168.72.222 and MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:17:15.631800 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetSSHHostname
I0122 21:17:15.635158 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:17:15.635524 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b5:43:94", ip: ""} in network mk-old-k8s-version-181389: {Iface:virbr4 ExpiryTime:2025-01-22 22:17:06 +0000 UTC Type:0 Mac:52:54:00:b5:43:94 Iaid: IPaddr:192.168.72.222 Prefix:24 Hostname:old-k8s-version-181389 Clientid:01:52:54:00:b5:43:94}
I0122 21:17:15.635561 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined IP address 192.168.72.222 and MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:17:15.635723 304536 provision.go:143] copyHostCerts
I0122 21:17:15.635779 304536 exec_runner.go:144] found /home/jenkins/minikube-integration/20288-247142/.minikube/ca.pem, removing ...
I0122 21:17:15.635821 304536 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20288-247142/.minikube/ca.pem
I0122 21:17:15.635878 304536 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20288-247142/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20288-247142/.minikube/ca.pem (1082 bytes)
I0122 21:17:15.635983 304536 exec_runner.go:144] found /home/jenkins/minikube-integration/20288-247142/.minikube/cert.pem, removing ...
I0122 21:17:15.635991 304536 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20288-247142/.minikube/cert.pem
I0122 21:17:15.636012 304536 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20288-247142/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20288-247142/.minikube/cert.pem (1123 bytes)
I0122 21:17:15.636116 304536 exec_runner.go:144] found /home/jenkins/minikube-integration/20288-247142/.minikube/key.pem, removing ...
I0122 21:17:15.636130 304536 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20288-247142/.minikube/key.pem
I0122 21:17:15.636163 304536 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20288-247142/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20288-247142/.minikube/key.pem (1675 bytes)
I0122 21:17:15.636257 304536 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20288-247142/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20288-247142/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20288-247142/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-181389 san=[127.0.0.1 192.168.72.222 localhost minikube old-k8s-version-181389]
I0122 21:17:15.795140 304536 provision.go:177] copyRemoteCerts
I0122 21:17:15.795245 304536 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0122 21:17:15.795285 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetSSHHostname
I0122 21:17:15.799036 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:17:15.799570 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b5:43:94", ip: ""} in network mk-old-k8s-version-181389: {Iface:virbr4 ExpiryTime:2025-01-22 22:17:06 +0000 UTC Type:0 Mac:52:54:00:b5:43:94 Iaid: IPaddr:192.168.72.222 Prefix:24 Hostname:old-k8s-version-181389 Clientid:01:52:54:00:b5:43:94}
I0122 21:17:15.799608 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined IP address 192.168.72.222 and MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:17:15.799862 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetSSHPort
I0122 21:17:15.800112 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetSSHKeyPath
I0122 21:17:15.800276 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetSSHUsername
I0122 21:17:15.800452 304536 sshutil.go:53] new ssh client: &{IP:192.168.72.222 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20288-247142/.minikube/machines/old-k8s-version-181389/id_rsa Username:docker}
I0122 21:17:15.899129 304536 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20288-247142/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0122 21:17:15.937490 304536 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20288-247142/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0122 21:17:15.974966 304536 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20288-247142/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0122 21:17:16.008149 304536 provision.go:87] duration metric: took 381.112599ms to configureAuth
I0122 21:17:16.008184 304536 buildroot.go:189] setting minikube options for container-runtime
I0122 21:17:16.008382 304536 config.go:182] Loaded profile config "old-k8s-version-181389": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0122 21:17:16.008490 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetSSHHostname
I0122 21:17:16.011852 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:17:16.012280 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b5:43:94", ip: ""} in network mk-old-k8s-version-181389: {Iface:virbr4 ExpiryTime:2025-01-22 22:17:06 +0000 UTC Type:0 Mac:52:54:00:b5:43:94 Iaid: IPaddr:192.168.72.222 Prefix:24 Hostname:old-k8s-version-181389 Clientid:01:52:54:00:b5:43:94}
I0122 21:17:16.012330 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined IP address 192.168.72.222 and MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:17:16.012490 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetSSHPort
I0122 21:17:16.012738 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetSSHKeyPath
I0122 21:17:16.012942 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetSSHKeyPath
I0122 21:17:16.013104 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetSSHUsername
I0122 21:17:16.013290 304536 main.go:141] libmachine: Using SSH client type: native
I0122 21:17:16.013536 304536 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.72.222 22 <nil> <nil>}
I0122 21:17:16.013555 304536 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0122 21:17:16.290392 304536 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0122 21:17:16.290430 304536 main.go:141] libmachine: Checking connection to Docker...
I0122 21:17:16.290442 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetURL
I0122 21:17:16.292048 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | using libvirt version 6000000
I0122 21:17:16.295193 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:17:16.295575 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b5:43:94", ip: ""} in network mk-old-k8s-version-181389: {Iface:virbr4 ExpiryTime:2025-01-22 22:17:06 +0000 UTC Type:0 Mac:52:54:00:b5:43:94 Iaid: IPaddr:192.168.72.222 Prefix:24 Hostname:old-k8s-version-181389 Clientid:01:52:54:00:b5:43:94}
I0122 21:17:16.295607 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined IP address 192.168.72.222 and MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:17:16.295808 304536 main.go:141] libmachine: Docker is up and running!
I0122 21:17:16.295827 304536 main.go:141] libmachine: Reticulating splines...
I0122 21:17:16.295836 304536 client.go:171] duration metric: took 28.47669619s to LocalClient.Create
I0122 21:17:16.295874 304536 start.go:167] duration metric: took 28.476788025s to libmachine.API.Create "old-k8s-version-181389"
I0122 21:17:16.295889 304536 start.go:293] postStartSetup for "old-k8s-version-181389" (driver="kvm2")
I0122 21:17:16.295903 304536 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0122 21:17:16.295940 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .DriverName
I0122 21:17:16.296204 304536 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0122 21:17:16.296238 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetSSHHostname
I0122 21:17:16.298918 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:17:16.299243 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b5:43:94", ip: ""} in network mk-old-k8s-version-181389: {Iface:virbr4 ExpiryTime:2025-01-22 22:17:06 +0000 UTC Type:0 Mac:52:54:00:b5:43:94 Iaid: IPaddr:192.168.72.222 Prefix:24 Hostname:old-k8s-version-181389 Clientid:01:52:54:00:b5:43:94}
I0122 21:17:16.299323 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined IP address 192.168.72.222 and MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:17:16.299522 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetSSHPort
I0122 21:17:16.299762 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetSSHKeyPath
I0122 21:17:16.299970 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetSSHUsername
I0122 21:17:16.300129 304536 sshutil.go:53] new ssh client: &{IP:192.168.72.222 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20288-247142/.minikube/machines/old-k8s-version-181389/id_rsa Username:docker}
I0122 21:17:16.395130 304536 ssh_runner.go:195] Run: cat /etc/os-release
I0122 21:17:16.401957 304536 info.go:137] Remote host: Buildroot 2023.02.9
I0122 21:17:16.401999 304536 filesync.go:126] Scanning /home/jenkins/minikube-integration/20288-247142/.minikube/addons for local assets ...
I0122 21:17:16.402076 304536 filesync.go:126] Scanning /home/jenkins/minikube-integration/20288-247142/.minikube/files for local assets ...
I0122 21:17:16.402167 304536 filesync.go:149] local asset: /home/jenkins/minikube-integration/20288-247142/.minikube/files/etc/ssl/certs/2547542.pem -> 2547542.pem in /etc/ssl/certs
I0122 21:17:16.402313 304536 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0122 21:17:16.413754 304536 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20288-247142/.minikube/files/etc/ssl/certs/2547542.pem --> /etc/ssl/certs/2547542.pem (1708 bytes)
I0122 21:17:16.448163 304536 start.go:296] duration metric: took 152.253145ms for postStartSetup
I0122 21:17:16.448226 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetConfigRaw
I0122 21:17:16.448954 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetIP
I0122 21:17:16.452289 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:17:16.452766 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b5:43:94", ip: ""} in network mk-old-k8s-version-181389: {Iface:virbr4 ExpiryTime:2025-01-22 22:17:06 +0000 UTC Type:0 Mac:52:54:00:b5:43:94 Iaid: IPaddr:192.168.72.222 Prefix:24 Hostname:old-k8s-version-181389 Clientid:01:52:54:00:b5:43:94}
I0122 21:17:16.452815 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined IP address 192.168.72.222 and MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:17:16.453336 304536 profile.go:143] Saving config to /home/jenkins/minikube-integration/20288-247142/.minikube/profiles/old-k8s-version-181389/config.json ...
I0122 21:17:16.453657 304536 start.go:128] duration metric: took 28.660581462s to createHost
I0122 21:17:16.453701 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetSSHHostname
I0122 21:17:16.457311 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:17:16.457881 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b5:43:94", ip: ""} in network mk-old-k8s-version-181389: {Iface:virbr4 ExpiryTime:2025-01-22 22:17:06 +0000 UTC Type:0 Mac:52:54:00:b5:43:94 Iaid: IPaddr:192.168.72.222 Prefix:24 Hostname:old-k8s-version-181389 Clientid:01:52:54:00:b5:43:94}
I0122 21:17:16.457907 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined IP address 192.168.72.222 and MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:17:16.457971 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetSSHPort
I0122 21:17:16.458325 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetSSHKeyPath
I0122 21:17:16.458863 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetSSHKeyPath
I0122 21:17:16.459156 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetSSHUsername
I0122 21:17:16.459393 304536 main.go:141] libmachine: Using SSH client type: native
I0122 21:17:16.459635 304536 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.72.222 22 <nil> <nil>}
I0122 21:17:16.459646 304536 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0122 21:17:16.588922 304536 main.go:141] libmachine: SSH cmd err, output: <nil>: 1737580636.572176845
I0122 21:17:16.588953 304536 fix.go:216] guest clock: 1737580636.572176845
I0122 21:17:16.588965 304536 fix.go:229] Guest: 2025-01-22 21:17:16.572176845 +0000 UTC Remote: 2025-01-22 21:17:16.45367454 +0000 UTC m=+49.153437625 (delta=118.502305ms)
I0122 21:17:16.589028 304536 fix.go:200] guest clock delta is within tolerance: 118.502305ms
I0122 21:17:16.589037 304536 start.go:83] releasing machines lock for "old-k8s-version-181389", held for 28.796231779s
I0122 21:17:16.589060 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .DriverName
I0122 21:17:16.589422 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetIP
I0122 21:17:16.592303 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:17:16.592761 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b5:43:94", ip: ""} in network mk-old-k8s-version-181389: {Iface:virbr4 ExpiryTime:2025-01-22 22:17:06 +0000 UTC Type:0 Mac:52:54:00:b5:43:94 Iaid: IPaddr:192.168.72.222 Prefix:24 Hostname:old-k8s-version-181389 Clientid:01:52:54:00:b5:43:94}
I0122 21:17:16.592799 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined IP address 192.168.72.222 and MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:17:16.593038 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .DriverName
I0122 21:17:16.593637 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .DriverName
I0122 21:17:16.593888 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .DriverName
I0122 21:17:16.593987 304536 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0122 21:17:16.594035 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetSSHHostname
I0122 21:17:16.594092 304536 ssh_runner.go:195] Run: cat /version.json
I0122 21:17:16.594114 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetSSHHostname
I0122 21:17:16.597070 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:17:16.597410 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b5:43:94", ip: ""} in network mk-old-k8s-version-181389: {Iface:virbr4 ExpiryTime:2025-01-22 22:17:06 +0000 UTC Type:0 Mac:52:54:00:b5:43:94 Iaid: IPaddr:192.168.72.222 Prefix:24 Hostname:old-k8s-version-181389 Clientid:01:52:54:00:b5:43:94}
I0122 21:17:16.597435 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:17:16.597457 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined IP address 192.168.72.222 and MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:17:16.597650 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetSSHPort
I0122 21:17:16.597872 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetSSHKeyPath
I0122 21:17:16.597937 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b5:43:94", ip: ""} in network mk-old-k8s-version-181389: {Iface:virbr4 ExpiryTime:2025-01-22 22:17:06 +0000 UTC Type:0 Mac:52:54:00:b5:43:94 Iaid: IPaddr:192.168.72.222 Prefix:24 Hostname:old-k8s-version-181389 Clientid:01:52:54:00:b5:43:94}
I0122 21:17:16.597963 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined IP address 192.168.72.222 and MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:17:16.598103 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetSSHPort
I0122 21:17:16.598276 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetSSHUsername
I0122 21:17:16.598308 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetSSHKeyPath
I0122 21:17:16.598388 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetSSHUsername
I0122 21:17:16.598427 304536 sshutil.go:53] new ssh client: &{IP:192.168.72.222 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20288-247142/.minikube/machines/old-k8s-version-181389/id_rsa Username:docker}
I0122 21:17:16.598735 304536 sshutil.go:53] new ssh client: &{IP:192.168.72.222 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20288-247142/.minikube/machines/old-k8s-version-181389/id_rsa Username:docker}
I0122 21:17:16.706523 304536 ssh_runner.go:195] Run: systemctl --version
I0122 21:17:16.713879 304536 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0122 21:17:16.882513 304536 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0122 21:17:16.890470 304536 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0122 21:17:16.890573 304536 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0122 21:17:16.911362 304536 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0122 21:17:16.911395 304536 start.go:495] detecting cgroup driver to use...
I0122 21:17:16.911460 304536 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0122 21:17:16.932446 304536 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0122 21:17:16.949465 304536 docker.go:217] disabling cri-docker service (if available) ...
I0122 21:17:16.949549 304536 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0122 21:17:16.965646 304536 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0122 21:17:16.982025 304536 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0122 21:17:17.129877 304536 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0122 21:17:17.311898 304536 docker.go:233] disabling docker service ...
I0122 21:17:17.311983 304536 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0122 21:17:17.330302 304536 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0122 21:17:17.347620 304536 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0122 21:17:17.491794 304536 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0122 21:17:17.655194 304536 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0122 21:17:17.673581 304536 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0122 21:17:17.700256 304536 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0122 21:17:17.700348 304536 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0122 21:17:17.714252 304536 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0122 21:17:17.714327 304536 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0122 21:17:17.727852 304536 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0122 21:17:17.741395 304536 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0122 21:17:17.754766 304536 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0122 21:17:17.777800 304536 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0122 21:17:17.790905 304536 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0122 21:17:17.790985 304536 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0122 21:17:17.809281 304536 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0122 21:17:17.822402 304536 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0122 21:17:17.966612 304536 ssh_runner.go:195] Run: sudo systemctl restart crio
I0122 21:17:18.077210 304536 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0122 21:17:18.077294 304536 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0122 21:17:18.083933 304536 start.go:563] Will wait 60s for crictl version
I0122 21:17:18.084016 304536 ssh_runner.go:195] Run: which crictl
I0122 21:17:18.091597 304536 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0122 21:17:18.144214 304536 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0122 21:17:18.144311 304536 ssh_runner.go:195] Run: crio --version
I0122 21:17:18.187292 304536 ssh_runner.go:195] Run: crio --version
I0122 21:17:18.248003 304536 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0122 21:17:18.249430 304536 main.go:141] libmachine: (old-k8s-version-181389) Calling .GetIP
I0122 21:17:18.253325 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:17:18.253797 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b5:43:94", ip: ""} in network mk-old-k8s-version-181389: {Iface:virbr4 ExpiryTime:2025-01-22 22:17:06 +0000 UTC Type:0 Mac:52:54:00:b5:43:94 Iaid: IPaddr:192.168.72.222 Prefix:24 Hostname:old-k8s-version-181389 Clientid:01:52:54:00:b5:43:94}
I0122 21:17:18.253824 304536 main.go:141] libmachine: (old-k8s-version-181389) DBG | domain old-k8s-version-181389 has defined IP address 192.168.72.222 and MAC address 52:54:00:b5:43:94 in network mk-old-k8s-version-181389
I0122 21:17:18.254151 304536 ssh_runner.go:195] Run: grep 192.168.72.1 host.minikube.internal$ /etc/hosts
I0122 21:17:18.263503 304536 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.72.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0122 21:17:18.280366 304536 kubeadm.go:883] updating cluster {Name:old-k8s-version-181389 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-181389 Namespace
:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.222 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror:
DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0122 21:17:18.280539 304536 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0122 21:17:18.280608 304536 ssh_runner.go:195] Run: sudo crictl images --output json
I0122 21:17:18.326217 304536 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0122 21:17:18.326311 304536 ssh_runner.go:195] Run: which lz4
I0122 21:17:18.331912 304536 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0122 21:17:18.337539 304536 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0122 21:17:18.337581 304536 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20288-247142/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0122 21:17:20.399805 304536 crio.go:462] duration metric: took 2.067940708s to copy over tarball
I0122 21:17:20.399933 304536 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0122 21:17:23.764618 304536 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.364643853s)
I0122 21:17:23.764654 304536 crio.go:469] duration metric: took 3.364815053s to extract the tarball
I0122 21:17:23.764665 304536 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0122 21:17:23.812145 304536 ssh_runner.go:195] Run: sudo crictl images --output json
I0122 21:17:23.870003 304536 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0122 21:17:23.870035 304536 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0122 21:17:23.870162 304536 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0122 21:17:23.870228 304536 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0122 21:17:23.870241 304536 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0122 21:17:23.870252 304536 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0122 21:17:23.870141 304536 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0122 21:17:23.870288 304536 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0122 21:17:23.870420 304536 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0122 21:17:23.870145 304536 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0122 21:17:23.873080 304536 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0122 21:17:23.872873 304536 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0122 21:17:23.873492 304536 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0122 21:17:23.873574 304536 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0122 21:17:23.873569 304536 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0122 21:17:23.874058 304536 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0122 21:17:23.874418 304536 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0122 21:17:23.874567 304536 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0122 21:17:24.025404 304536 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0122 21:17:24.034373 304536 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0122 21:17:24.037543 304536 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0122 21:17:24.043531 304536 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0122 21:17:24.047110 304536 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0122 21:17:24.054677 304536 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0122 21:17:24.070571 304536 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0122 21:17:24.128681 304536 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0122 21:17:24.128768 304536 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0122 21:17:24.128823 304536 ssh_runner.go:195] Run: which crictl
I0122 21:17:24.272853 304536 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0122 21:17:24.272938 304536 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0122 21:17:24.273003 304536 ssh_runner.go:195] Run: which crictl
I0122 21:17:24.301301 304536 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0122 21:17:24.301357 304536 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0122 21:17:24.301398 304536 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0122 21:17:24.301413 304536 ssh_runner.go:195] Run: which crictl
I0122 21:17:24.301441 304536 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0122 21:17:24.301493 304536 ssh_runner.go:195] Run: which crictl
I0122 21:17:24.319314 304536 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0122 21:17:24.319383 304536 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0122 21:17:24.319394 304536 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0122 21:17:24.319439 304536 ssh_runner.go:195] Run: which crictl
I0122 21:17:24.319460 304536 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0122 21:17:24.319504 304536 ssh_runner.go:195] Run: which crictl
I0122 21:17:24.320312 304536 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0122 21:17:24.320356 304536 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0122 21:17:24.320406 304536 ssh_runner.go:195] Run: which crictl
I0122 21:17:24.320415 304536 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0122 21:17:24.320426 304536 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0122 21:17:24.320482 304536 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0122 21:17:24.320488 304536 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0122 21:17:24.326734 304536 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0122 21:17:24.329181 304536 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0122 21:17:24.515143 304536 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0122 21:17:24.515395 304536 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0122 21:17:24.517156 304536 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0122 21:17:24.517328 304536 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0122 21:17:24.517377 304536 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0122 21:17:24.536018 304536 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0122 21:17:24.536138 304536 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0122 21:17:24.734423 304536 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0122 21:17:24.734509 304536 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0122 21:17:24.747554 304536 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0122 21:17:24.752447 304536 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0122 21:17:24.752684 304536 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0122 21:17:24.761897 304536 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0122 21:17:24.796563 304536 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0122 21:17:24.819399 304536 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0122 21:17:24.941138 304536 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20288-247142/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0122 21:17:24.941392 304536 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0122 21:17:24.941529 304536 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20288-247142/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0122 21:17:24.978731 304536 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20288-247142/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0122 21:17:24.997560 304536 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20288-247142/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0122 21:17:24.997707 304536 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20288-247142/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0122 21:17:25.033706 304536 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20288-247142/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0122 21:17:25.156145 304536 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20288-247142/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0122 21:17:25.156221 304536 cache_images.go:92] duration metric: took 1.286170258s to LoadCachedImages
W0122 21:17:25.156342 304536 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20288-247142/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20288-247142/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0: no such file or directory
I0122 21:17:25.156368 304536 kubeadm.go:934] updating node { 192.168.72.222 8443 v1.20.0 crio true true} ...
I0122 21:17:25.156525 304536 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-181389 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.72.222
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-181389 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0122 21:17:25.156624 304536 ssh_runner.go:195] Run: crio config
I0122 21:17:25.217648 304536 cni.go:84] Creating CNI manager for ""
I0122 21:17:25.217677 304536 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0122 21:17:25.217693 304536 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0122 21:17:25.217721 304536 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.72.222 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-181389 NodeName:old-k8s-version-181389 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.72.222"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.72.222 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0122 21:17:25.217889 304536 kubeadm.go:195] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.72.222
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-181389"
kubeletExtraArgs:
node-ip: 192.168.72.222
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.72.222"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0122 21:17:25.217974 304536 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0122 21:17:25.231722 304536 binaries.go:44] Found k8s binaries, skipping transfer
I0122 21:17:25.231811 304536 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0122 21:17:25.244863 304536 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0122 21:17:25.267389 304536 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0122 21:17:25.289407 304536 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0122 21:17:25.311922 304536 ssh_runner.go:195] Run: grep 192.168.72.222 control-plane.minikube.internal$ /etc/hosts
I0122 21:17:25.316889 304536 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.72.222 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0122 21:17:25.335522 304536 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0122 21:17:25.509646 304536 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0122 21:17:25.541081 304536 certs.go:68] Setting up /home/jenkins/minikube-integration/20288-247142/.minikube/profiles/old-k8s-version-181389 for IP: 192.168.72.222
I0122 21:17:25.541111 304536 certs.go:194] generating shared ca certs ...
I0122 21:17:25.541135 304536 certs.go:226] acquiring lock for ca certs: {Name:mkdd0d4b6fa26e9115895f82be25875589405ed3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0122 21:17:25.541330 304536 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20288-247142/.minikube/ca.key
I0122 21:17:25.541386 304536 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20288-247142/.minikube/proxy-client-ca.key
I0122 21:17:25.541401 304536 certs.go:256] generating profile certs ...
I0122 21:17:25.541482 304536 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/20288-247142/.minikube/profiles/old-k8s-version-181389/client.key
I0122 21:17:25.541522 304536 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20288-247142/.minikube/profiles/old-k8s-version-181389/client.crt with IP's: []
I0122 21:17:26.075736 304536 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20288-247142/.minikube/profiles/old-k8s-version-181389/client.crt ...
I0122 21:17:26.075772 304536 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20288-247142/.minikube/profiles/old-k8s-version-181389/client.crt: {Name:mkc9f35fcc4c07ddb8bd87c24744d6fb2ef7839e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0122 21:17:26.076014 304536 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20288-247142/.minikube/profiles/old-k8s-version-181389/client.key ...
I0122 21:17:26.076037 304536 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20288-247142/.minikube/profiles/old-k8s-version-181389/client.key: {Name:mk61377e20df402fd6d74ed6d57089d2844421cc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0122 21:17:26.076184 304536 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20288-247142/.minikube/profiles/old-k8s-version-181389/apiserver.key.d562c0b4
I0122 21:17:26.076206 304536 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20288-247142/.minikube/profiles/old-k8s-version-181389/apiserver.crt.d562c0b4 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.72.222]
I0122 21:17:26.160507 304536 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20288-247142/.minikube/profiles/old-k8s-version-181389/apiserver.crt.d562c0b4 ...
I0122 21:17:26.160544 304536 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20288-247142/.minikube/profiles/old-k8s-version-181389/apiserver.crt.d562c0b4: {Name:mkb09216c78b824220e990418793ad45cced5931 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0122 21:17:26.160722 304536 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20288-247142/.minikube/profiles/old-k8s-version-181389/apiserver.key.d562c0b4 ...
I0122 21:17:26.160744 304536 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20288-247142/.minikube/profiles/old-k8s-version-181389/apiserver.key.d562c0b4: {Name:mk20010e321604122a36c351cb2e8d911cb58953 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0122 21:17:26.160817 304536 certs.go:381] copying /home/jenkins/minikube-integration/20288-247142/.minikube/profiles/old-k8s-version-181389/apiserver.crt.d562c0b4 -> /home/jenkins/minikube-integration/20288-247142/.minikube/profiles/old-k8s-version-181389/apiserver.crt
I0122 21:17:26.160890 304536 certs.go:385] copying /home/jenkins/minikube-integration/20288-247142/.minikube/profiles/old-k8s-version-181389/apiserver.key.d562c0b4 -> /home/jenkins/minikube-integration/20288-247142/.minikube/profiles/old-k8s-version-181389/apiserver.key
I0122 21:17:26.160941 304536 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/20288-247142/.minikube/profiles/old-k8s-version-181389/proxy-client.key
I0122 21:17:26.160956 304536 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20288-247142/.minikube/profiles/old-k8s-version-181389/proxy-client.crt with IP's: []
I0122 21:17:26.232357 304536 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20288-247142/.minikube/profiles/old-k8s-version-181389/proxy-client.crt ...
I0122 21:17:26.232403 304536 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20288-247142/.minikube/profiles/old-k8s-version-181389/proxy-client.crt: {Name:mk40443e5ba6e7f61b84a88dde558ee528b489c7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0122 21:17:26.232625 304536 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20288-247142/.minikube/profiles/old-k8s-version-181389/proxy-client.key ...
I0122 21:17:26.232642 304536 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20288-247142/.minikube/profiles/old-k8s-version-181389/proxy-client.key: {Name:mkc13e938477728d8922b6ddecdaf90fefa327f4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0122 21:17:26.232854 304536 certs.go:484] found cert: /home/jenkins/minikube-integration/20288-247142/.minikube/certs/254754.pem (1338 bytes)
W0122 21:17:26.232910 304536 certs.go:480] ignoring /home/jenkins/minikube-integration/20288-247142/.minikube/certs/254754_empty.pem, impossibly tiny 0 bytes
I0122 21:17:26.232921 304536 certs.go:484] found cert: /home/jenkins/minikube-integration/20288-247142/.minikube/certs/ca-key.pem (1675 bytes)
I0122 21:17:26.232945 304536 certs.go:484] found cert: /home/jenkins/minikube-integration/20288-247142/.minikube/certs/ca.pem (1082 bytes)
I0122 21:17:26.232974 304536 certs.go:484] found cert: /home/jenkins/minikube-integration/20288-247142/.minikube/certs/cert.pem (1123 bytes)
I0122 21:17:26.232996 304536 certs.go:484] found cert: /home/jenkins/minikube-integration/20288-247142/.minikube/certs/key.pem (1675 bytes)
I0122 21:17:26.233037 304536 certs.go:484] found cert: /home/jenkins/minikube-integration/20288-247142/.minikube/files/etc/ssl/certs/2547542.pem (1708 bytes)
I0122 21:17:26.234623 304536 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20288-247142/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0122 21:17:26.278315 304536 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20288-247142/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0122 21:17:26.315894 304536 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20288-247142/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0122 21:17:26.354888 304536 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20288-247142/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0122 21:17:26.392974 304536 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20288-247142/.minikube/profiles/old-k8s-version-181389/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0122 21:17:26.424467 304536 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20288-247142/.minikube/profiles/old-k8s-version-181389/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0122 21:17:26.458873 304536 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20288-247142/.minikube/profiles/old-k8s-version-181389/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0122 21:17:26.495466 304536 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20288-247142/.minikube/profiles/old-k8s-version-181389/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0122 21:17:26.534607 304536 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20288-247142/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0122 21:17:26.569517 304536 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20288-247142/.minikube/certs/254754.pem --> /usr/share/ca-certificates/254754.pem (1338 bytes)
I0122 21:17:26.616150 304536 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20288-247142/.minikube/files/etc/ssl/certs/2547542.pem --> /usr/share/ca-certificates/2547542.pem (1708 bytes)
I0122 21:17:26.680183 304536 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0122 21:17:26.709607 304536 ssh_runner.go:195] Run: openssl version
I0122 21:17:26.719453 304536 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/2547542.pem && ln -fs /usr/share/ca-certificates/2547542.pem /etc/ssl/certs/2547542.pem"
I0122 21:17:26.735805 304536 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/2547542.pem
I0122 21:17:26.742635 304536 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jan 22 20:11 /usr/share/ca-certificates/2547542.pem
I0122 21:17:26.742729 304536 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/2547542.pem
I0122 21:17:26.751511 304536 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/2547542.pem /etc/ssl/certs/3ec20f2e.0"
I0122 21:17:26.767892 304536 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0122 21:17:26.780990 304536 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0122 21:17:26.786508 304536 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jan 22 20:02 /usr/share/ca-certificates/minikubeCA.pem
I0122 21:17:26.786599 304536 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0122 21:17:26.793407 304536 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0122 21:17:26.808659 304536 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/254754.pem && ln -fs /usr/share/ca-certificates/254754.pem /etc/ssl/certs/254754.pem"
I0122 21:17:26.825199 304536 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/254754.pem
I0122 21:17:26.831491 304536 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jan 22 20:11 /usr/share/ca-certificates/254754.pem
I0122 21:17:26.831566 304536 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/254754.pem
I0122 21:17:26.840679 304536 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/254754.pem /etc/ssl/certs/51391683.0"
I0122 21:17:26.854465 304536 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0122 21:17:26.859767 304536 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0122 21:17:26.859842 304536 kubeadm.go:392] StartCluster: {Name:old-k8s-version-181389 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-181389 Namespace:de
fault APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.222 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Dis
ableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0122 21:17:26.859971 304536 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0122 21:17:26.860055 304536 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0122 21:17:26.911794 304536 cri.go:89] found id: ""
I0122 21:17:26.911890 304536 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0122 21:17:26.926404 304536 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0122 21:17:26.941289 304536 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0122 21:17:26.954235 304536 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0122 21:17:26.954264 304536 kubeadm.go:157] found existing configuration files:
I0122 21:17:26.954390 304536 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0122 21:17:26.966489 304536 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0122 21:17:26.966576 304536 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0122 21:17:26.978870 304536 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0122 21:17:26.990805 304536 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0122 21:17:26.990883 304536 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0122 21:17:27.003863 304536 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0122 21:17:27.016484 304536 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0122 21:17:27.016566 304536 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0122 21:17:27.030647 304536 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0122 21:17:27.041592 304536 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0122 21:17:27.041670 304536 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0122 21:17:27.055297 304536 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0122 21:17:27.239648 304536 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0122 21:17:27.240214 304536 kubeadm.go:310] [preflight] Running pre-flight checks
I0122 21:17:27.437284 304536 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0122 21:17:27.437463 304536 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0122 21:17:27.437619 304536 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0122 21:17:27.715394 304536 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0122 21:17:27.716905 304536 out.go:235] - Generating certificates and keys ...
I0122 21:17:27.717043 304536 kubeadm.go:310] [certs] Using existing ca certificate authority
I0122 21:17:27.717132 304536 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0122 21:17:28.116488 304536 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0122 21:17:28.444981 304536 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0122 21:17:28.578224 304536 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0122 21:17:28.730071 304536 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0122 21:17:28.940509 304536 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0122 21:17:28.940837 304536 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-181389] and IPs [192.168.72.222 127.0.0.1 ::1]
I0122 21:17:29.059570 304536 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0122 21:17:29.059755 304536 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-181389] and IPs [192.168.72.222 127.0.0.1 ::1]
I0122 21:17:29.356408 304536 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0122 21:17:29.484675 304536 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0122 21:17:29.562860 304536 kubeadm.go:310] [certs] Generating "sa" key and public key
I0122 21:17:29.563213 304536 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0122 21:17:29.694824 304536 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0122 21:17:29.861858 304536 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0122 21:17:30.135602 304536 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0122 21:17:30.464432 304536 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0122 21:17:30.494094 304536 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0122 21:17:30.494269 304536 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0122 21:17:30.494326 304536 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0122 21:17:30.744236 304536 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0122 21:17:30.746154 304536 out.go:235] - Booting up control plane ...
I0122 21:17:30.746316 304536 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0122 21:17:30.755068 304536 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0122 21:17:30.761008 304536 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0122 21:17:30.763141 304536 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0122 21:17:30.781658 304536 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0122 21:18:10.780095 304536 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0122 21:18:10.781352 304536 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0122 21:18:10.781652 304536 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0122 21:18:15.781901 304536 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0122 21:18:15.782169 304536 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0122 21:18:25.782964 304536 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0122 21:18:25.783235 304536 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0122 21:18:45.784276 304536 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0122 21:18:45.784537 304536 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0122 21:19:25.784504 304536 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0122 21:19:25.784744 304536 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0122 21:19:25.784765 304536 kubeadm.go:310]
I0122 21:19:25.784803 304536 kubeadm.go:310] Unfortunately, an error has occurred:
I0122 21:19:25.784862 304536 kubeadm.go:310] timed out waiting for the condition
I0122 21:19:25.784910 304536 kubeadm.go:310]
I0122 21:19:25.784962 304536 kubeadm.go:310] This error is likely caused by:
I0122 21:19:25.785001 304536 kubeadm.go:310] - The kubelet is not running
I0122 21:19:25.785117 304536 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0122 21:19:25.785128 304536 kubeadm.go:310]
I0122 21:19:25.785219 304536 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0122 21:19:25.785254 304536 kubeadm.go:310] - 'systemctl status kubelet'
I0122 21:19:25.785282 304536 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0122 21:19:25.785289 304536 kubeadm.go:310]
I0122 21:19:25.785390 304536 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0122 21:19:25.785477 304536 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0122 21:19:25.785484 304536 kubeadm.go:310]
I0122 21:19:25.785576 304536 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0122 21:19:25.785660 304536 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0122 21:19:25.785777 304536 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0122 21:19:25.785866 304536 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0122 21:19:25.785881 304536 kubeadm.go:310]
I0122 21:19:25.786851 304536 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0122 21:19:25.786977 304536 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0122 21:19:25.787128 304536 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
W0122 21:19:25.787272 304536 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-181389] and IPs [192.168.72.222 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-181389] and IPs [192.168.72.222 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-181389] and IPs [192.168.72.222 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-181389] and IPs [192.168.72.222 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0122 21:19:25.787338 304536 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0122 21:19:28.424734 304536 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (2.637361929s)
I0122 21:19:28.424833 304536 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0122 21:19:28.442203 304536 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0122 21:19:28.455536 304536 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0122 21:19:28.455575 304536 kubeadm.go:157] found existing configuration files:
I0122 21:19:28.455637 304536 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0122 21:19:28.468998 304536 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0122 21:19:28.469071 304536 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0122 21:19:28.481395 304536 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0122 21:19:28.494031 304536 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0122 21:19:28.494123 304536 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0122 21:19:28.506558 304536 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0122 21:19:28.517989 304536 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0122 21:19:28.518080 304536 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0122 21:19:28.530049 304536 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0122 21:19:28.543830 304536 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0122 21:19:28.543908 304536 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0122 21:19:28.556324 304536 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0122 21:19:28.809426 304536 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0122 21:21:24.937389 304536 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0122 21:21:24.937509 304536 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0122 21:21:24.940091 304536 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0122 21:21:24.940181 304536 kubeadm.go:310] [preflight] Running pre-flight checks
I0122 21:21:24.940282 304536 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0122 21:21:24.940410 304536 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0122 21:21:24.940540 304536 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0122 21:21:24.940622 304536 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0122 21:21:24.942617 304536 out.go:235] - Generating certificates and keys ...
I0122 21:21:24.942744 304536 kubeadm.go:310] [certs] Using existing ca certificate authority
I0122 21:21:24.942854 304536 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0122 21:21:24.943001 304536 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0122 21:21:24.943110 304536 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0122 21:21:24.943219 304536 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0122 21:21:24.943316 304536 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0122 21:21:24.943419 304536 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0122 21:21:24.943524 304536 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0122 21:21:24.943636 304536 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0122 21:21:24.943727 304536 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0122 21:21:24.943781 304536 kubeadm.go:310] [certs] Using the existing "sa" key
I0122 21:21:24.943887 304536 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0122 21:21:24.943969 304536 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0122 21:21:24.944017 304536 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0122 21:21:24.944086 304536 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0122 21:21:24.944158 304536 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0122 21:21:24.944298 304536 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0122 21:21:24.944414 304536 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0122 21:21:24.944478 304536 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0122 21:21:24.944559 304536 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0122 21:21:24.946371 304536 out.go:235] - Booting up control plane ...
I0122 21:21:24.946500 304536 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0122 21:21:24.946614 304536 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0122 21:21:24.946703 304536 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0122 21:21:24.946855 304536 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0122 21:21:24.947113 304536 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0122 21:21:24.947177 304536 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0122 21:21:24.947263 304536 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0122 21:21:24.947498 304536 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0122 21:21:24.947597 304536 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0122 21:21:24.947744 304536 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0122 21:21:24.947808 304536 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0122 21:21:24.948015 304536 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0122 21:21:24.948097 304536 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0122 21:21:24.948268 304536 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0122 21:21:24.948324 304536 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0122 21:21:24.948538 304536 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0122 21:21:24.948554 304536 kubeadm.go:310]
I0122 21:21:24.948605 304536 kubeadm.go:310] Unfortunately, an error has occurred:
I0122 21:21:24.948650 304536 kubeadm.go:310] timed out waiting for the condition
I0122 21:21:24.948657 304536 kubeadm.go:310]
I0122 21:21:24.948702 304536 kubeadm.go:310] This error is likely caused by:
I0122 21:21:24.948748 304536 kubeadm.go:310] - The kubelet is not running
I0122 21:21:24.948882 304536 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0122 21:21:24.948897 304536 kubeadm.go:310]
I0122 21:21:24.949016 304536 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0122 21:21:24.949067 304536 kubeadm.go:310] - 'systemctl status kubelet'
I0122 21:21:24.949109 304536 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0122 21:21:24.949119 304536 kubeadm.go:310]
I0122 21:21:24.949251 304536 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0122 21:21:24.949366 304536 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0122 21:21:24.949377 304536 kubeadm.go:310]
I0122 21:21:24.949512 304536 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0122 21:21:24.949618 304536 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0122 21:21:24.949716 304536 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0122 21:21:24.949775 304536 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0122 21:21:24.949854 304536 kubeadm.go:394] duration metric: took 3m58.090019905s to StartCluster
I0122 21:21:24.949907 304536 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0122 21:21:24.949965 304536 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0122 21:21:24.950021 304536 kubeadm.go:310]
I0122 21:21:25.023254 304536 cri.go:89] found id: ""
I0122 21:21:25.023292 304536 logs.go:282] 0 containers: []
W0122 21:21:25.023304 304536 logs.go:284] No container was found matching "kube-apiserver"
I0122 21:21:25.023313 304536 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0122 21:21:25.023396 304536 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0122 21:21:25.073210 304536 cri.go:89] found id: ""
I0122 21:21:25.073247 304536 logs.go:282] 0 containers: []
W0122 21:21:25.073260 304536 logs.go:284] No container was found matching "etcd"
I0122 21:21:25.073272 304536 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0122 21:21:25.073346 304536 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0122 21:21:25.123863 304536 cri.go:89] found id: ""
I0122 21:21:25.123896 304536 logs.go:282] 0 containers: []
W0122 21:21:25.123906 304536 logs.go:284] No container was found matching "coredns"
I0122 21:21:25.123915 304536 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0122 21:21:25.123985 304536 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0122 21:21:25.171334 304536 cri.go:89] found id: ""
I0122 21:21:25.171376 304536 logs.go:282] 0 containers: []
W0122 21:21:25.171389 304536 logs.go:284] No container was found matching "kube-scheduler"
I0122 21:21:25.171397 304536 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0122 21:21:25.171471 304536 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0122 21:21:25.226280 304536 cri.go:89] found id: ""
I0122 21:21:25.226312 304536 logs.go:282] 0 containers: []
W0122 21:21:25.226323 304536 logs.go:284] No container was found matching "kube-proxy"
I0122 21:21:25.226331 304536 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0122 21:21:25.226421 304536 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0122 21:21:25.275261 304536 cri.go:89] found id: ""
I0122 21:21:25.275343 304536 logs.go:282] 0 containers: []
W0122 21:21:25.275364 304536 logs.go:284] No container was found matching "kube-controller-manager"
I0122 21:21:25.275379 304536 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0122 21:21:25.275460 304536 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0122 21:21:25.324681 304536 cri.go:89] found id: ""
I0122 21:21:25.324713 304536 logs.go:282] 0 containers: []
W0122 21:21:25.324723 304536 logs.go:284] No container was found matching "kindnet"
I0122 21:21:25.324750 304536 logs.go:123] Gathering logs for CRI-O ...
I0122 21:21:25.324767 304536 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0122 21:21:25.465350 304536 logs.go:123] Gathering logs for container status ...
I0122 21:21:25.465395 304536 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0122 21:21:25.533076 304536 logs.go:123] Gathering logs for kubelet ...
I0122 21:21:25.533126 304536 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0122 21:21:25.604874 304536 logs.go:123] Gathering logs for dmesg ...
I0122 21:21:25.604930 304536 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0122 21:21:25.624144 304536 logs.go:123] Gathering logs for describe nodes ...
I0122 21:21:25.624194 304536 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0122 21:21:25.788127 304536 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
W0122 21:21:25.788181 304536 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0122 21:21:25.788250 304536 out.go:270] *
*
W0122 21:21:25.788322 304536 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0122 21:21:25.788342 304536 out.go:270] *
*
W0122 21:21:25.789271 304536 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0122 21:21:25.792485 304536 out.go:201]
W0122 21:21:25.793868 304536 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0122 21:21:25.793941 304536 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0122 21:21:25.793969 304536 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0122 21:21:25.795596 304536 out.go:201]
** /stderr **
start_stop_delete_test.go:186: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-181389 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-181389 -n old-k8s-version-181389
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-181389 -n old-k8s-version-181389: exit status 6 (275.470658ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0122 21:21:26.129361 311785 status.go:458] kubeconfig endpoint: get endpoint: "old-k8s-version-181389" does not appear in /home/jenkins/minikube-integration/20288-247142/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-181389" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (298.86s)