=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-979033 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-979033 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m56.571950983s)
-- stdout --
* [old-k8s-version-979033] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=18998
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/18998-9396/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/18998-9396/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-979033" primary control-plane node in "old-k8s-version-979033" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0703 23:59:46.524131 58668 out.go:291] Setting OutFile to fd 1 ...
I0703 23:59:46.524243 58668 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0703 23:59:46.524252 58668 out.go:304] Setting ErrFile to fd 2...
I0703 23:59:46.524256 58668 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0703 23:59:46.524426 58668 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18998-9396/.minikube/bin
I0703 23:59:46.525004 58668 out.go:298] Setting JSON to false
I0703 23:59:46.525956 58668 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-10","uptime":6126,"bootTime":1720045060,"procs":215,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1062-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0703 23:59:46.526018 58668 start.go:139] virtualization: kvm guest
I0703 23:59:46.528249 58668 out.go:177] * [old-k8s-version-979033] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
I0703 23:59:46.529779 58668 out.go:177] - MINIKUBE_LOCATION=18998
I0703 23:59:46.529812 58668 notify.go:220] Checking for updates...
I0703 23:59:46.532586 58668 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0703 23:59:46.534104 58668 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18998-9396/kubeconfig
I0703 23:59:46.535523 58668 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18998-9396/.minikube
I0703 23:59:46.536819 58668 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0703 23:59:46.538066 58668 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0703 23:59:46.540300 58668 config.go:182] Loaded profile config "cert-expiration-979438": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.2
I0703 23:59:46.540454 58668 config.go:182] Loaded profile config "cert-options-768841": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.2
I0703 23:59:46.540563 58668 config.go:182] Loaded profile config "kubernetes-upgrade-652205": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.2
I0703 23:59:46.541034 58668 driver.go:392] Setting default libvirt URI to qemu:///system
I0703 23:59:46.586885 58668 out.go:177] * Using the kvm2 driver based on user configuration
I0703 23:59:46.588289 58668 start.go:297] selected driver: kvm2
I0703 23:59:46.588312 58668 start.go:901] validating driver "kvm2" against <nil>
I0703 23:59:46.588329 58668 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0703 23:59:46.589370 58668 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0703 23:59:46.589478 58668 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/18998-9396/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0703 23:59:46.606176 58668 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.1
I0703 23:59:46.606222 58668 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0703 23:59:46.606487 58668 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0703 23:59:46.606539 58668 cni.go:84] Creating CNI manager for ""
I0703 23:59:46.606556 58668 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0703 23:59:46.606572 58668 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0703 23:59:46.606634 58668 start.go:340] cluster config:
{Name:old-k8s-version-979033 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719972989-19184@sha256:86cb76941aa00fc70e665895234bda20991d5563e39b8ff07212e31a82ce7fb1 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-979033 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0703 23:59:46.606764 58668 iso.go:125] acquiring lock: {Name:mkffc890db9547cc7a0d480624a5e119b2686d5d Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0703 23:59:46.608417 58668 out.go:177] * Starting "old-k8s-version-979033" primary control-plane node in "old-k8s-version-979033" cluster
I0703 23:59:46.609713 58668 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0703 23:59:46.609763 58668 preload.go:147] Found local preload: /home/jenkins/minikube-integration/18998-9396/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0703 23:59:46.609776 58668 cache.go:56] Caching tarball of preloaded images
I0703 23:59:46.609909 58668 preload.go:173] Found /home/jenkins/minikube-integration/18998-9396/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0703 23:59:46.609923 58668 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0703 23:59:46.610052 58668 profile.go:143] Saving config to /home/jenkins/minikube-integration/18998-9396/.minikube/profiles/old-k8s-version-979033/config.json ...
I0703 23:59:46.610085 58668 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18998-9396/.minikube/profiles/old-k8s-version-979033/config.json: {Name:mk6ff6d1e0f449297d4b8a14766b568decb09b7a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0703 23:59:46.610240 58668 start.go:360] acquireMachinesLock for old-k8s-version-979033: {Name:mk4c099674fa2b439f09526eb17d9a7a4d495819 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0704 00:00:11.029558 58668 start.go:364] duration metric: took 24.419275178s to acquireMachinesLock for "old-k8s-version-979033"
I0704 00:00:11.029649 58668 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-979033 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19175/minikube-v1.33.1-1719929171-19175-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719972989-19184@sha256:86cb76941aa00fc70e665895234bda20991d5563e39b8ff07212e31a82ce7fb1 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-979033 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0704 00:00:11.029779 58668 start.go:125] createHost starting for "" (driver="kvm2")
I0704 00:00:11.033106 58668 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0704 00:00:11.033385 58668 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0704 00:00:11.033447 58668 main.go:141] libmachine: Launching plugin server for driver kvm2
I0704 00:00:11.051470 58668 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41131
I0704 00:00:11.052032 58668 main.go:141] libmachine: () Calling .GetVersion
I0704 00:00:11.060512 58668 main.go:141] libmachine: Using API Version 1
I0704 00:00:11.060540 58668 main.go:141] libmachine: () Calling .SetConfigRaw
I0704 00:00:11.060905 58668 main.go:141] libmachine: () Calling .GetMachineName
I0704 00:00:11.061144 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetMachineName
I0704 00:00:11.061322 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .DriverName
I0704 00:00:11.061568 58668 start.go:159] libmachine.API.Create for "old-k8s-version-979033" (driver="kvm2")
I0704 00:00:11.061620 58668 client.go:168] LocalClient.Create starting
I0704 00:00:11.061657 58668 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18998-9396/.minikube/certs/ca.pem
I0704 00:00:11.061695 58668 main.go:141] libmachine: Decoding PEM data...
I0704 00:00:11.061714 58668 main.go:141] libmachine: Parsing certificate...
I0704 00:00:11.061778 58668 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18998-9396/.minikube/certs/cert.pem
I0704 00:00:11.061811 58668 main.go:141] libmachine: Decoding PEM data...
I0704 00:00:11.061828 58668 main.go:141] libmachine: Parsing certificate...
I0704 00:00:11.061850 58668 main.go:141] libmachine: Running pre-create checks...
I0704 00:00:11.061861 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .PreCreateCheck
I0704 00:00:11.062345 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetConfigRaw
I0704 00:00:11.062841 58668 main.go:141] libmachine: Creating machine...
I0704 00:00:11.062860 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .Create
I0704 00:00:11.063031 58668 main.go:141] libmachine: (old-k8s-version-979033) Creating KVM machine...
I0704 00:00:11.064733 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | found existing default KVM network
I0704 00:00:11.067006 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | I0704 00:00:11.066792 58953 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:fa:41:7f} reservation:<nil>}
I0704 00:00:11.068323 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | I0704 00:00:11.068145 58953 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:f5:85:96} reservation:<nil>}
I0704 00:00:11.069576 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | I0704 00:00:11.069502 58953 network.go:211] skipping subnet 192.168.61.0/24 that is taken: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName:virbr3 IfaceIPv4:192.168.61.1 IfaceMTU:1500 IfaceMAC:52:54:00:e7:0f:46} reservation:<nil>}
I0704 00:00:11.071029 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | I0704 00:00:11.070954 58953 network.go:206] using free private subnet 192.168.72.0/24: &{IP:192.168.72.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.72.0/24 Gateway:192.168.72.1 ClientMin:192.168.72.2 ClientMax:192.168.72.254 Broadcast:192.168.72.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0002c1870}
I0704 00:00:11.071273 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | created network xml:
I0704 00:00:11.071286 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | <network>
I0704 00:00:11.071302 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | <name>mk-old-k8s-version-979033</name>
I0704 00:00:11.071307 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | <dns enable='no'/>
I0704 00:00:11.071312 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG |
I0704 00:00:11.071318 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | <ip address='192.168.72.1' netmask='255.255.255.0'>
I0704 00:00:11.071325 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | <dhcp>
I0704 00:00:11.071336 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | <range start='192.168.72.2' end='192.168.72.253'/>
I0704 00:00:11.071341 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | </dhcp>
I0704 00:00:11.071345 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | </ip>
I0704 00:00:11.071351 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG |
I0704 00:00:11.071355 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | </network>
I0704 00:00:11.071362 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG |
I0704 00:00:11.077697 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | trying to create private KVM network mk-old-k8s-version-979033 192.168.72.0/24...
I0704 00:00:11.175322 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | private KVM network mk-old-k8s-version-979033 192.168.72.0/24 created
I0704 00:00:11.175351 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | I0704 00:00:11.175256 58953 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/18998-9396/.minikube
I0704 00:00:11.175373 58668 main.go:141] libmachine: (old-k8s-version-979033) Setting up store path in /home/jenkins/minikube-integration/18998-9396/.minikube/machines/old-k8s-version-979033 ...
I0704 00:00:11.175385 58668 main.go:141] libmachine: (old-k8s-version-979033) Building disk image from file:///home/jenkins/minikube-integration/18998-9396/.minikube/cache/iso/amd64/minikube-v1.33.1-1719929171-19175-amd64.iso
I0704 00:00:11.175469 58668 main.go:141] libmachine: (old-k8s-version-979033) Downloading /home/jenkins/minikube-integration/18998-9396/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/18998-9396/.minikube/cache/iso/amd64/minikube-v1.33.1-1719929171-19175-amd64.iso...
I0704 00:00:11.422179 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | I0704 00:00:11.422067 58953 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/18998-9396/.minikube/machines/old-k8s-version-979033/id_rsa...
I0704 00:00:11.529772 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | I0704 00:00:11.529607 58953 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/18998-9396/.minikube/machines/old-k8s-version-979033/old-k8s-version-979033.rawdisk...
I0704 00:00:11.529808 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | Writing magic tar header
I0704 00:00:11.529865 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | Writing SSH key tar header
I0704 00:00:11.529905 58668 main.go:141] libmachine: (old-k8s-version-979033) Setting executable bit set on /home/jenkins/minikube-integration/18998-9396/.minikube/machines/old-k8s-version-979033 (perms=drwx------)
I0704 00:00:11.529945 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | I0704 00:00:11.529745 58953 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/18998-9396/.minikube/machines/old-k8s-version-979033 ...
I0704 00:00:11.529963 58668 main.go:141] libmachine: (old-k8s-version-979033) Setting executable bit set on /home/jenkins/minikube-integration/18998-9396/.minikube/machines (perms=drwxr-xr-x)
I0704 00:00:11.529981 58668 main.go:141] libmachine: (old-k8s-version-979033) Setting executable bit set on /home/jenkins/minikube-integration/18998-9396/.minikube (perms=drwxr-xr-x)
I0704 00:00:11.529994 58668 main.go:141] libmachine: (old-k8s-version-979033) Setting executable bit set on /home/jenkins/minikube-integration/18998-9396 (perms=drwxrwxr-x)
I0704 00:00:11.530071 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18998-9396/.minikube/machines/old-k8s-version-979033
I0704 00:00:11.530099 58668 main.go:141] libmachine: (old-k8s-version-979033) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0704 00:00:11.530111 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18998-9396/.minikube/machines
I0704 00:00:11.530125 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18998-9396/.minikube
I0704 00:00:11.530138 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18998-9396
I0704 00:00:11.530152 58668 main.go:141] libmachine: (old-k8s-version-979033) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0704 00:00:11.530166 58668 main.go:141] libmachine: (old-k8s-version-979033) Creating domain...
I0704 00:00:11.530177 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0704 00:00:11.530188 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | Checking permissions on dir: /home/jenkins
I0704 00:00:11.530201 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | Checking permissions on dir: /home
I0704 00:00:11.530211 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | Skipping /home - not owner
I0704 00:00:11.531589 58668 main.go:141] libmachine: (old-k8s-version-979033) define libvirt domain using xml:
I0704 00:00:11.531612 58668 main.go:141] libmachine: (old-k8s-version-979033) <domain type='kvm'>
I0704 00:00:11.531622 58668 main.go:141] libmachine: (old-k8s-version-979033) <name>old-k8s-version-979033</name>
I0704 00:00:11.531630 58668 main.go:141] libmachine: (old-k8s-version-979033) <memory unit='MiB'>2200</memory>
I0704 00:00:11.531638 58668 main.go:141] libmachine: (old-k8s-version-979033) <vcpu>2</vcpu>
I0704 00:00:11.531645 58668 main.go:141] libmachine: (old-k8s-version-979033) <features>
I0704 00:00:11.531666 58668 main.go:141] libmachine: (old-k8s-version-979033) <acpi/>
I0704 00:00:11.531672 58668 main.go:141] libmachine: (old-k8s-version-979033) <apic/>
I0704 00:00:11.531679 58668 main.go:141] libmachine: (old-k8s-version-979033) <pae/>
I0704 00:00:11.531687 58668 main.go:141] libmachine: (old-k8s-version-979033)
I0704 00:00:11.531696 58668 main.go:141] libmachine: (old-k8s-version-979033) </features>
I0704 00:00:11.531702 58668 main.go:141] libmachine: (old-k8s-version-979033) <cpu mode='host-passthrough'>
I0704 00:00:11.531710 58668 main.go:141] libmachine: (old-k8s-version-979033)
I0704 00:00:11.531716 58668 main.go:141] libmachine: (old-k8s-version-979033) </cpu>
I0704 00:00:11.531723 58668 main.go:141] libmachine: (old-k8s-version-979033) <os>
I0704 00:00:11.531730 58668 main.go:141] libmachine: (old-k8s-version-979033) <type>hvm</type>
I0704 00:00:11.531738 58668 main.go:141] libmachine: (old-k8s-version-979033) <boot dev='cdrom'/>
I0704 00:00:11.531744 58668 main.go:141] libmachine: (old-k8s-version-979033) <boot dev='hd'/>
I0704 00:00:11.531753 58668 main.go:141] libmachine: (old-k8s-version-979033) <bootmenu enable='no'/>
I0704 00:00:11.531760 58668 main.go:141] libmachine: (old-k8s-version-979033) </os>
I0704 00:00:11.531769 58668 main.go:141] libmachine: (old-k8s-version-979033) <devices>
I0704 00:00:11.531777 58668 main.go:141] libmachine: (old-k8s-version-979033) <disk type='file' device='cdrom'>
I0704 00:00:11.531802 58668 main.go:141] libmachine: (old-k8s-version-979033) <source file='/home/jenkins/minikube-integration/18998-9396/.minikube/machines/old-k8s-version-979033/boot2docker.iso'/>
I0704 00:00:11.531809 58668 main.go:141] libmachine: (old-k8s-version-979033) <target dev='hdc' bus='scsi'/>
I0704 00:00:11.531814 58668 main.go:141] libmachine: (old-k8s-version-979033) <readonly/>
I0704 00:00:11.531818 58668 main.go:141] libmachine: (old-k8s-version-979033) </disk>
I0704 00:00:11.531824 58668 main.go:141] libmachine: (old-k8s-version-979033) <disk type='file' device='disk'>
I0704 00:00:11.531830 58668 main.go:141] libmachine: (old-k8s-version-979033) <driver name='qemu' type='raw' cache='default' io='threads' />
I0704 00:00:11.531838 58668 main.go:141] libmachine: (old-k8s-version-979033) <source file='/home/jenkins/minikube-integration/18998-9396/.minikube/machines/old-k8s-version-979033/old-k8s-version-979033.rawdisk'/>
I0704 00:00:11.531843 58668 main.go:141] libmachine: (old-k8s-version-979033) <target dev='hda' bus='virtio'/>
I0704 00:00:11.531848 58668 main.go:141] libmachine: (old-k8s-version-979033) </disk>
I0704 00:00:11.531852 58668 main.go:141] libmachine: (old-k8s-version-979033) <interface type='network'>
I0704 00:00:11.531858 58668 main.go:141] libmachine: (old-k8s-version-979033) <source network='mk-old-k8s-version-979033'/>
I0704 00:00:11.531862 58668 main.go:141] libmachine: (old-k8s-version-979033) <model type='virtio'/>
I0704 00:00:11.531867 58668 main.go:141] libmachine: (old-k8s-version-979033) </interface>
I0704 00:00:11.531907 58668 main.go:141] libmachine: (old-k8s-version-979033) <interface type='network'>
I0704 00:00:11.531918 58668 main.go:141] libmachine: (old-k8s-version-979033) <source network='default'/>
I0704 00:00:11.531925 58668 main.go:141] libmachine: (old-k8s-version-979033) <model type='virtio'/>
I0704 00:00:11.531937 58668 main.go:141] libmachine: (old-k8s-version-979033) </interface>
I0704 00:00:11.531943 58668 main.go:141] libmachine: (old-k8s-version-979033) <serial type='pty'>
I0704 00:00:11.531950 58668 main.go:141] libmachine: (old-k8s-version-979033) <target port='0'/>
I0704 00:00:11.531956 58668 main.go:141] libmachine: (old-k8s-version-979033) </serial>
I0704 00:00:11.531965 58668 main.go:141] libmachine: (old-k8s-version-979033) <console type='pty'>
I0704 00:00:11.531972 58668 main.go:141] libmachine: (old-k8s-version-979033) <target type='serial' port='0'/>
I0704 00:00:11.531981 58668 main.go:141] libmachine: (old-k8s-version-979033) </console>
I0704 00:00:11.531992 58668 main.go:141] libmachine: (old-k8s-version-979033) <rng model='virtio'>
I0704 00:00:11.532004 58668 main.go:141] libmachine: (old-k8s-version-979033) <backend model='random'>/dev/random</backend>
I0704 00:00:11.532019 58668 main.go:141] libmachine: (old-k8s-version-979033) </rng>
I0704 00:00:11.532029 58668 main.go:141] libmachine: (old-k8s-version-979033)
I0704 00:00:11.532040 58668 main.go:141] libmachine: (old-k8s-version-979033)
I0704 00:00:11.532052 58668 main.go:141] libmachine: (old-k8s-version-979033) </devices>
I0704 00:00:11.532062 58668 main.go:141] libmachine: (old-k8s-version-979033) </domain>
I0704 00:00:11.532074 58668 main.go:141] libmachine: (old-k8s-version-979033)
I0704 00:00:11.537876 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has defined MAC address 52:54:00:ab:fe:c3 in network default
I0704 00:00:11.538609 58668 main.go:141] libmachine: (old-k8s-version-979033) Ensuring networks are active...
I0704 00:00:11.538637 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has defined MAC address 52:54:00:af:98:c8 in network mk-old-k8s-version-979033
I0704 00:00:11.539869 58668 main.go:141] libmachine: (old-k8s-version-979033) Ensuring network default is active
I0704 00:00:11.540296 58668 main.go:141] libmachine: (old-k8s-version-979033) Ensuring network mk-old-k8s-version-979033 is active
I0704 00:00:11.540998 58668 main.go:141] libmachine: (old-k8s-version-979033) Getting domain xml...
I0704 00:00:11.541831 58668 main.go:141] libmachine: (old-k8s-version-979033) Creating domain...
I0704 00:00:12.952228 58668 main.go:141] libmachine: (old-k8s-version-979033) Waiting to get IP...
I0704 00:00:12.953098 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has defined MAC address 52:54:00:af:98:c8 in network mk-old-k8s-version-979033
I0704 00:00:12.953567 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | unable to find current IP address of domain old-k8s-version-979033 in network mk-old-k8s-version-979033
I0704 00:00:12.953592 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | I0704 00:00:12.953536 58953 retry.go:31] will retry after 229.874564ms: waiting for machine to come up
I0704 00:00:13.185226 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has defined MAC address 52:54:00:af:98:c8 in network mk-old-k8s-version-979033
I0704 00:00:13.185908 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | unable to find current IP address of domain old-k8s-version-979033 in network mk-old-k8s-version-979033
I0704 00:00:13.185948 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | I0704 00:00:13.185845 58953 retry.go:31] will retry after 357.943475ms: waiting for machine to come up
I0704 00:00:13.545847 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has defined MAC address 52:54:00:af:98:c8 in network mk-old-k8s-version-979033
I0704 00:00:13.547053 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | unable to find current IP address of domain old-k8s-version-979033 in network mk-old-k8s-version-979033
I0704 00:00:13.547092 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | I0704 00:00:13.546916 58953 retry.go:31] will retry after 388.846207ms: waiting for machine to come up
I0704 00:00:13.937454 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has defined MAC address 52:54:00:af:98:c8 in network mk-old-k8s-version-979033
I0704 00:00:13.938106 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | unable to find current IP address of domain old-k8s-version-979033 in network mk-old-k8s-version-979033
I0704 00:00:13.938129 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | I0704 00:00:13.938065 58953 retry.go:31] will retry after 404.621139ms: waiting for machine to come up
I0704 00:00:14.345022 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has defined MAC address 52:54:00:af:98:c8 in network mk-old-k8s-version-979033
I0704 00:00:14.345520 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | unable to find current IP address of domain old-k8s-version-979033 in network mk-old-k8s-version-979033
I0704 00:00:14.345543 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | I0704 00:00:14.345470 58953 retry.go:31] will retry after 595.571574ms: waiting for machine to come up
I0704 00:00:14.942516 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has defined MAC address 52:54:00:af:98:c8 in network mk-old-k8s-version-979033
I0704 00:00:14.943163 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | unable to find current IP address of domain old-k8s-version-979033 in network mk-old-k8s-version-979033
I0704 00:00:14.943201 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | I0704 00:00:14.943128 58953 retry.go:31] will retry after 722.971695ms: waiting for machine to come up
I0704 00:00:15.668231 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has defined MAC address 52:54:00:af:98:c8 in network mk-old-k8s-version-979033
I0704 00:00:15.668730 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | unable to find current IP address of domain old-k8s-version-979033 in network mk-old-k8s-version-979033
I0704 00:00:15.668758 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | I0704 00:00:15.668686 58953 retry.go:31] will retry after 973.036812ms: waiting for machine to come up
I0704 00:00:16.643566 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has defined MAC address 52:54:00:af:98:c8 in network mk-old-k8s-version-979033
I0704 00:00:16.644023 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | unable to find current IP address of domain old-k8s-version-979033 in network mk-old-k8s-version-979033
I0704 00:00:16.644053 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | I0704 00:00:16.643978 58953 retry.go:31] will retry after 1.072559314s: waiting for machine to come up
I0704 00:00:17.717804 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has defined MAC address 52:54:00:af:98:c8 in network mk-old-k8s-version-979033
I0704 00:00:17.718238 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | unable to find current IP address of domain old-k8s-version-979033 in network mk-old-k8s-version-979033
I0704 00:00:17.718268 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | I0704 00:00:17.718183 58953 retry.go:31] will retry after 1.437120655s: waiting for machine to come up
I0704 00:00:19.157375 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has defined MAC address 52:54:00:af:98:c8 in network mk-old-k8s-version-979033
I0704 00:00:19.157988 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | unable to find current IP address of domain old-k8s-version-979033 in network mk-old-k8s-version-979033
I0704 00:00:19.158012 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | I0704 00:00:19.157930 58953 retry.go:31] will retry after 1.605923846s: waiting for machine to come up
I0704 00:00:20.765160 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has defined MAC address 52:54:00:af:98:c8 in network mk-old-k8s-version-979033
I0704 00:00:20.765665 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | unable to find current IP address of domain old-k8s-version-979033 in network mk-old-k8s-version-979033
I0704 00:00:20.765687 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | I0704 00:00:20.765625 58953 retry.go:31] will retry after 2.476639753s: waiting for machine to come up
I0704 00:00:23.243743 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has defined MAC address 52:54:00:af:98:c8 in network mk-old-k8s-version-979033
I0704 00:00:23.244355 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | unable to find current IP address of domain old-k8s-version-979033 in network mk-old-k8s-version-979033
I0704 00:00:23.244380 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | I0704 00:00:23.244300 58953 retry.go:31] will retry after 2.495332847s: waiting for machine to come up
I0704 00:00:25.741655 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has defined MAC address 52:54:00:af:98:c8 in network mk-old-k8s-version-979033
I0704 00:00:25.742213 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | unable to find current IP address of domain old-k8s-version-979033 in network mk-old-k8s-version-979033
I0704 00:00:25.742242 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | I0704 00:00:25.742165 58953 retry.go:31] will retry after 3.177310247s: waiting for machine to come up
I0704 00:00:28.921061 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has defined MAC address 52:54:00:af:98:c8 in network mk-old-k8s-version-979033
I0704 00:00:28.921681 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | unable to find current IP address of domain old-k8s-version-979033 in network mk-old-k8s-version-979033
I0704 00:00:28.921713 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | I0704 00:00:28.921628 58953 retry.go:31] will retry after 4.903759878s: waiting for machine to come up
I0704 00:00:34.193082 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has defined MAC address 52:54:00:af:98:c8 in network mk-old-k8s-version-979033
I0704 00:00:34.193582 58668 main.go:141] libmachine: (old-k8s-version-979033) Found IP for machine: 192.168.72.59
I0704 00:00:34.193603 58668 main.go:141] libmachine: (old-k8s-version-979033) Reserving static IP address...
I0704 00:00:34.193615 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has current primary IP address 192.168.72.59 and MAC address 52:54:00:af:98:c8 in network mk-old-k8s-version-979033
I0704 00:00:34.194129 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-979033", mac: "52:54:00:af:98:c8", ip: "192.168.72.59"} in network mk-old-k8s-version-979033
I0704 00:00:34.287211 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | Getting to WaitForSSH function...
I0704 00:00:34.287243 58668 main.go:141] libmachine: (old-k8s-version-979033) Reserved static IP address: 192.168.72.59
I0704 00:00:34.287256 58668 main.go:141] libmachine: (old-k8s-version-979033) Waiting for SSH to be available...
I0704 00:00:34.290658 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has defined MAC address 52:54:00:af:98:c8 in network mk-old-k8s-version-979033
I0704 00:00:34.291202 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:af:98:c8", ip: ""} in network mk-old-k8s-version-979033: {Iface:virbr4 ExpiryTime:2024-07-04 01:00:26 +0000 UTC Type:0 Mac:52:54:00:af:98:c8 Iaid: IPaddr:192.168.72.59 Prefix:24 Hostname:minikube Clientid:01:52:54:00:af:98:c8}
I0704 00:00:34.291237 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has defined IP address 192.168.72.59 and MAC address 52:54:00:af:98:c8 in network mk-old-k8s-version-979033
I0704 00:00:34.291488 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | Using SSH client type: external
I0704 00:00:34.291517 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | Using SSH private key: /home/jenkins/minikube-integration/18998-9396/.minikube/machines/old-k8s-version-979033/id_rsa (-rw-------)
I0704 00:00:34.291544 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.72.59 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/18998-9396/.minikube/machines/old-k8s-version-979033/id_rsa -p 22] /usr/bin/ssh <nil>}
I0704 00:00:34.291558 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | About to run SSH command:
I0704 00:00:34.291576 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | exit 0
I0704 00:00:34.424824 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | SSH cmd err, output: <nil>:
I0704 00:00:34.425131 58668 main.go:141] libmachine: (old-k8s-version-979033) KVM machine creation complete!
I0704 00:00:34.425493 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetConfigRaw
I0704 00:00:34.426009 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .DriverName
I0704 00:00:34.426260 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .DriverName
I0704 00:00:34.426445 58668 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0704 00:00:34.426474 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetState
I0704 00:00:34.428029 58668 main.go:141] libmachine: Detecting operating system of created instance...
I0704 00:00:34.428044 58668 main.go:141] libmachine: Waiting for SSH to be available...
I0704 00:00:34.428052 58668 main.go:141] libmachine: Getting to WaitForSSH function...
I0704 00:00:34.428059 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetSSHHostname
I0704 00:00:34.430691 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has defined MAC address 52:54:00:af:98:c8 in network mk-old-k8s-version-979033
I0704 00:00:34.431087 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:af:98:c8", ip: ""} in network mk-old-k8s-version-979033: {Iface:virbr4 ExpiryTime:2024-07-04 01:00:26 +0000 UTC Type:0 Mac:52:54:00:af:98:c8 Iaid: IPaddr:192.168.72.59 Prefix:24 Hostname:old-k8s-version-979033 Clientid:01:52:54:00:af:98:c8}
I0704 00:00:34.431132 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has defined IP address 192.168.72.59 and MAC address 52:54:00:af:98:c8 in network mk-old-k8s-version-979033
I0704 00:00:34.431296 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetSSHPort
I0704 00:00:34.431491 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetSSHKeyPath
I0704 00:00:34.431650 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetSSHKeyPath
I0704 00:00:34.431805 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetSSHUsername
I0704 00:00:34.432028 58668 main.go:141] libmachine: Using SSH client type: native
I0704 00:00:34.432321 58668 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil> [] 0s} 192.168.72.59 22 <nil> <nil>}
I0704 00:00:34.432338 58668 main.go:141] libmachine: About to run SSH command:
exit 0
I0704 00:00:34.539462 58668 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0704 00:00:34.539484 58668 main.go:141] libmachine: Detecting the provisioner...
I0704 00:00:34.539495 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetSSHHostname
I0704 00:00:34.542732 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has defined MAC address 52:54:00:af:98:c8 in network mk-old-k8s-version-979033
I0704 00:00:34.543162 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:af:98:c8", ip: ""} in network mk-old-k8s-version-979033: {Iface:virbr4 ExpiryTime:2024-07-04 01:00:26 +0000 UTC Type:0 Mac:52:54:00:af:98:c8 Iaid: IPaddr:192.168.72.59 Prefix:24 Hostname:old-k8s-version-979033 Clientid:01:52:54:00:af:98:c8}
I0704 00:00:34.543203 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has defined IP address 192.168.72.59 and MAC address 52:54:00:af:98:c8 in network mk-old-k8s-version-979033
I0704 00:00:34.543442 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetSSHPort
I0704 00:00:34.543670 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetSSHKeyPath
I0704 00:00:34.543844 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetSSHKeyPath
I0704 00:00:34.544009 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetSSHUsername
I0704 00:00:34.544159 58668 main.go:141] libmachine: Using SSH client type: native
I0704 00:00:34.544368 58668 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil> [] 0s} 192.168.72.59 22 <nil> <nil>}
I0704 00:00:34.544383 58668 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0704 00:00:34.649075 58668 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0704 00:00:34.649229 58668 main.go:141] libmachine: found compatible host: buildroot
I0704 00:00:34.649277 58668 main.go:141] libmachine: Provisioning with buildroot...
I0704 00:00:34.649296 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetMachineName
I0704 00:00:34.649574 58668 buildroot.go:166] provisioning hostname "old-k8s-version-979033"
I0704 00:00:34.649616 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetMachineName
I0704 00:00:34.649828 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetSSHHostname
I0704 00:00:34.653644 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has defined MAC address 52:54:00:af:98:c8 in network mk-old-k8s-version-979033
I0704 00:00:34.654057 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:af:98:c8", ip: ""} in network mk-old-k8s-version-979033: {Iface:virbr4 ExpiryTime:2024-07-04 01:00:26 +0000 UTC Type:0 Mac:52:54:00:af:98:c8 Iaid: IPaddr:192.168.72.59 Prefix:24 Hostname:old-k8s-version-979033 Clientid:01:52:54:00:af:98:c8}
I0704 00:00:34.654087 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has defined IP address 192.168.72.59 and MAC address 52:54:00:af:98:c8 in network mk-old-k8s-version-979033
I0704 00:00:34.654298 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetSSHPort
I0704 00:00:34.654528 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetSSHKeyPath
I0704 00:00:34.654687 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetSSHKeyPath
I0704 00:00:34.654837 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetSSHUsername
I0704 00:00:34.655006 58668 main.go:141] libmachine: Using SSH client type: native
I0704 00:00:34.655196 58668 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil> [] 0s} 192.168.72.59 22 <nil> <nil>}
I0704 00:00:34.655211 58668 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-979033 && echo "old-k8s-version-979033" | sudo tee /etc/hostname
I0704 00:00:34.774694 58668 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-979033
I0704 00:00:34.774730 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetSSHHostname
I0704 00:00:34.778383 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has defined MAC address 52:54:00:af:98:c8 in network mk-old-k8s-version-979033
I0704 00:00:34.778792 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:af:98:c8", ip: ""} in network mk-old-k8s-version-979033: {Iface:virbr4 ExpiryTime:2024-07-04 01:00:26 +0000 UTC Type:0 Mac:52:54:00:af:98:c8 Iaid: IPaddr:192.168.72.59 Prefix:24 Hostname:old-k8s-version-979033 Clientid:01:52:54:00:af:98:c8}
I0704 00:00:34.778819 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has defined IP address 192.168.72.59 and MAC address 52:54:00:af:98:c8 in network mk-old-k8s-version-979033
I0704 00:00:34.779144 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetSSHPort
I0704 00:00:34.779431 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetSSHKeyPath
I0704 00:00:34.779665 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetSSHKeyPath
I0704 00:00:34.779835 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetSSHUsername
I0704 00:00:34.780051 58668 main.go:141] libmachine: Using SSH client type: native
I0704 00:00:34.780283 58668 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil> [] 0s} 192.168.72.59 22 <nil> <nil>}
I0704 00:00:34.780311 58668 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-979033' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-979033/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-979033' | sudo tee -a /etc/hosts;
fi
fi
I0704 00:00:34.896690 58668 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0704 00:00:34.896722 58668 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/18998-9396/.minikube CaCertPath:/home/jenkins/minikube-integration/18998-9396/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18998-9396/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18998-9396/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18998-9396/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18998-9396/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18998-9396/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18998-9396/.minikube}
I0704 00:00:34.896770 58668 buildroot.go:174] setting up certificates
I0704 00:00:34.896782 58668 provision.go:84] configureAuth start
I0704 00:00:34.896798 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetMachineName
I0704 00:00:34.897094 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetIP
I0704 00:00:34.900289 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has defined MAC address 52:54:00:af:98:c8 in network mk-old-k8s-version-979033
I0704 00:00:34.900680 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:af:98:c8", ip: ""} in network mk-old-k8s-version-979033: {Iface:virbr4 ExpiryTime:2024-07-04 01:00:26 +0000 UTC Type:0 Mac:52:54:00:af:98:c8 Iaid: IPaddr:192.168.72.59 Prefix:24 Hostname:old-k8s-version-979033 Clientid:01:52:54:00:af:98:c8}
I0704 00:00:34.900722 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has defined IP address 192.168.72.59 and MAC address 52:54:00:af:98:c8 in network mk-old-k8s-version-979033
I0704 00:00:34.900922 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetSSHHostname
I0704 00:00:34.903648 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has defined MAC address 52:54:00:af:98:c8 in network mk-old-k8s-version-979033
I0704 00:00:34.904043 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:af:98:c8", ip: ""} in network mk-old-k8s-version-979033: {Iface:virbr4 ExpiryTime:2024-07-04 01:00:26 +0000 UTC Type:0 Mac:52:54:00:af:98:c8 Iaid: IPaddr:192.168.72.59 Prefix:24 Hostname:old-k8s-version-979033 Clientid:01:52:54:00:af:98:c8}
I0704 00:00:34.904074 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has defined IP address 192.168.72.59 and MAC address 52:54:00:af:98:c8 in network mk-old-k8s-version-979033
I0704 00:00:34.904259 58668 provision.go:143] copyHostCerts
I0704 00:00:34.904321 58668 exec_runner.go:144] found /home/jenkins/minikube-integration/18998-9396/.minikube/ca.pem, removing ...
I0704 00:00:34.904333 58668 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18998-9396/.minikube/ca.pem
I0704 00:00:34.904390 58668 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18998-9396/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18998-9396/.minikube/ca.pem (1078 bytes)
I0704 00:00:34.904493 58668 exec_runner.go:144] found /home/jenkins/minikube-integration/18998-9396/.minikube/cert.pem, removing ...
I0704 00:00:34.904502 58668 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18998-9396/.minikube/cert.pem
I0704 00:00:34.904522 58668 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18998-9396/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18998-9396/.minikube/cert.pem (1123 bytes)
I0704 00:00:34.904593 58668 exec_runner.go:144] found /home/jenkins/minikube-integration/18998-9396/.minikube/key.pem, removing ...
I0704 00:00:34.904601 58668 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18998-9396/.minikube/key.pem
I0704 00:00:34.904617 58668 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18998-9396/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18998-9396/.minikube/key.pem (1679 bytes)
I0704 00:00:34.904689 58668 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18998-9396/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18998-9396/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18998-9396/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-979033 san=[127.0.0.1 192.168.72.59 localhost minikube old-k8s-version-979033]
I0704 00:00:35.181466 58668 provision.go:177] copyRemoteCerts
I0704 00:00:35.181532 58668 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0704 00:00:35.181563 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetSSHHostname
I0704 00:00:35.184683 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has defined MAC address 52:54:00:af:98:c8 in network mk-old-k8s-version-979033
I0704 00:00:35.185081 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:af:98:c8", ip: ""} in network mk-old-k8s-version-979033: {Iface:virbr4 ExpiryTime:2024-07-04 01:00:26 +0000 UTC Type:0 Mac:52:54:00:af:98:c8 Iaid: IPaddr:192.168.72.59 Prefix:24 Hostname:old-k8s-version-979033 Clientid:01:52:54:00:af:98:c8}
I0704 00:00:35.185111 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has defined IP address 192.168.72.59 and MAC address 52:54:00:af:98:c8 in network mk-old-k8s-version-979033
I0704 00:00:35.185300 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetSSHPort
I0704 00:00:35.185530 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetSSHKeyPath
I0704 00:00:35.185673 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetSSHUsername
I0704 00:00:35.185805 58668 sshutil.go:53] new ssh client: &{IP:192.168.72.59 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18998-9396/.minikube/machines/old-k8s-version-979033/id_rsa Username:docker}
I0704 00:00:35.271503 58668 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18998-9396/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0704 00:00:35.299933 58668 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18998-9396/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0704 00:00:35.330063 58668 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18998-9396/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0704 00:00:35.357363 58668 provision.go:87] duration metric: took 460.563889ms to configureAuth
I0704 00:00:35.357393 58668 buildroot.go:189] setting minikube options for container-runtime
I0704 00:00:35.357589 58668 config.go:182] Loaded profile config "old-k8s-version-979033": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0704 00:00:35.357657 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetSSHHostname
I0704 00:00:35.360333 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has defined MAC address 52:54:00:af:98:c8 in network mk-old-k8s-version-979033
I0704 00:00:35.360775 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:af:98:c8", ip: ""} in network mk-old-k8s-version-979033: {Iface:virbr4 ExpiryTime:2024-07-04 01:00:26 +0000 UTC Type:0 Mac:52:54:00:af:98:c8 Iaid: IPaddr:192.168.72.59 Prefix:24 Hostname:old-k8s-version-979033 Clientid:01:52:54:00:af:98:c8}
I0704 00:00:35.360809 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has defined IP address 192.168.72.59 and MAC address 52:54:00:af:98:c8 in network mk-old-k8s-version-979033
I0704 00:00:35.361013 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetSSHPort
I0704 00:00:35.361262 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetSSHKeyPath
I0704 00:00:35.361428 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetSSHKeyPath
I0704 00:00:35.361577 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetSSHUsername
I0704 00:00:35.361749 58668 main.go:141] libmachine: Using SSH client type: native
I0704 00:00:35.361929 58668 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil> [] 0s} 192.168.72.59 22 <nil> <nil>}
I0704 00:00:35.361950 58668 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0704 00:00:35.652917 58668 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0704 00:00:35.652950 58668 main.go:141] libmachine: Checking connection to Docker...
I0704 00:00:35.652961 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetURL
I0704 00:00:35.654259 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | Using libvirt version 6000000
I0704 00:00:35.656886 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has defined MAC address 52:54:00:af:98:c8 in network mk-old-k8s-version-979033
I0704 00:00:35.657471 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:af:98:c8", ip: ""} in network mk-old-k8s-version-979033: {Iface:virbr4 ExpiryTime:2024-07-04 01:00:26 +0000 UTC Type:0 Mac:52:54:00:af:98:c8 Iaid: IPaddr:192.168.72.59 Prefix:24 Hostname:old-k8s-version-979033 Clientid:01:52:54:00:af:98:c8}
I0704 00:00:35.657514 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has defined IP address 192.168.72.59 and MAC address 52:54:00:af:98:c8 in network mk-old-k8s-version-979033
I0704 00:00:35.657660 58668 main.go:141] libmachine: Docker is up and running!
I0704 00:00:35.657680 58668 main.go:141] libmachine: Reticulating splines...
I0704 00:00:35.657689 58668 client.go:171] duration metric: took 24.596057721s to LocalClient.Create
I0704 00:00:35.657718 58668 start.go:167] duration metric: took 24.596150696s to libmachine.API.Create "old-k8s-version-979033"
I0704 00:00:35.657729 58668 start.go:293] postStartSetup for "old-k8s-version-979033" (driver="kvm2")
I0704 00:00:35.657741 58668 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0704 00:00:35.657759 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .DriverName
I0704 00:00:35.658068 58668 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0704 00:00:35.658096 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetSSHHostname
I0704 00:00:35.660695 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has defined MAC address 52:54:00:af:98:c8 in network mk-old-k8s-version-979033
I0704 00:00:35.661057 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:af:98:c8", ip: ""} in network mk-old-k8s-version-979033: {Iface:virbr4 ExpiryTime:2024-07-04 01:00:26 +0000 UTC Type:0 Mac:52:54:00:af:98:c8 Iaid: IPaddr:192.168.72.59 Prefix:24 Hostname:old-k8s-version-979033 Clientid:01:52:54:00:af:98:c8}
I0704 00:00:35.661090 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has defined IP address 192.168.72.59 and MAC address 52:54:00:af:98:c8 in network mk-old-k8s-version-979033
I0704 00:00:35.661228 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetSSHPort
I0704 00:00:35.661464 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetSSHKeyPath
I0704 00:00:35.661673 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetSSHUsername
I0704 00:00:35.661914 58668 sshutil.go:53] new ssh client: &{IP:192.168.72.59 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18998-9396/.minikube/machines/old-k8s-version-979033/id_rsa Username:docker}
I0704 00:00:35.743345 58668 ssh_runner.go:195] Run: cat /etc/os-release
I0704 00:00:35.748645 58668 info.go:137] Remote host: Buildroot 2023.02.9
I0704 00:00:35.748676 58668 filesync.go:126] Scanning /home/jenkins/minikube-integration/18998-9396/.minikube/addons for local assets ...
I0704 00:00:35.748765 58668 filesync.go:126] Scanning /home/jenkins/minikube-integration/18998-9396/.minikube/files for local assets ...
I0704 00:00:35.748855 58668 filesync.go:149] local asset: /home/jenkins/minikube-integration/18998-9396/.minikube/files/etc/ssl/certs/165742.pem -> 165742.pem in /etc/ssl/certs
I0704 00:00:35.748962 58668 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0704 00:00:35.761598 58668 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18998-9396/.minikube/files/etc/ssl/certs/165742.pem --> /etc/ssl/certs/165742.pem (1708 bytes)
I0704 00:00:35.798851 58668 start.go:296] duration metric: took 141.105745ms for postStartSetup
I0704 00:00:35.798934 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetConfigRaw
I0704 00:00:35.799748 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetIP
I0704 00:00:35.803424 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has defined MAC address 52:54:00:af:98:c8 in network mk-old-k8s-version-979033
I0704 00:00:35.803835 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:af:98:c8", ip: ""} in network mk-old-k8s-version-979033: {Iface:virbr4 ExpiryTime:2024-07-04 01:00:26 +0000 UTC Type:0 Mac:52:54:00:af:98:c8 Iaid: IPaddr:192.168.72.59 Prefix:24 Hostname:old-k8s-version-979033 Clientid:01:52:54:00:af:98:c8}
I0704 00:00:35.803866 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has defined IP address 192.168.72.59 and MAC address 52:54:00:af:98:c8 in network mk-old-k8s-version-979033
I0704 00:00:35.804157 58668 profile.go:143] Saving config to /home/jenkins/minikube-integration/18998-9396/.minikube/profiles/old-k8s-version-979033/config.json ...
I0704 00:00:35.804400 58668 start.go:128] duration metric: took 24.774599729s to createHost
I0704 00:00:35.804426 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetSSHHostname
I0704 00:00:35.807787 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has defined MAC address 52:54:00:af:98:c8 in network mk-old-k8s-version-979033
I0704 00:00:35.808505 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:af:98:c8", ip: ""} in network mk-old-k8s-version-979033: {Iface:virbr4 ExpiryTime:2024-07-04 01:00:26 +0000 UTC Type:0 Mac:52:54:00:af:98:c8 Iaid: IPaddr:192.168.72.59 Prefix:24 Hostname:old-k8s-version-979033 Clientid:01:52:54:00:af:98:c8}
I0704 00:00:35.808530 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has defined IP address 192.168.72.59 and MAC address 52:54:00:af:98:c8 in network mk-old-k8s-version-979033
I0704 00:00:35.808863 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetSSHPort
I0704 00:00:35.809112 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetSSHKeyPath
I0704 00:00:35.809306 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetSSHKeyPath
I0704 00:00:35.809479 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetSSHUsername
I0704 00:00:35.809710 58668 main.go:141] libmachine: Using SSH client type: native
I0704 00:00:35.809942 58668 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil> [] 0s} 192.168.72.59 22 <nil> <nil>}
I0704 00:00:35.809975 58668 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0704 00:00:35.935777 58668 main.go:141] libmachine: SSH cmd err, output: <nil>: 1720051235.907716412
I0704 00:00:35.935804 58668 fix.go:216] guest clock: 1720051235.907716412
I0704 00:00:35.935813 58668 fix.go:229] Guest: 2024-07-04 00:00:35.907716412 +0000 UTC Remote: 2024-07-04 00:00:35.804412433 +0000 UTC m=+49.322768963 (delta=103.303979ms)
I0704 00:00:35.935859 58668 fix.go:200] guest clock delta is within tolerance: 103.303979ms
I0704 00:00:35.935865 58668 start.go:83] releasing machines lock for "old-k8s-version-979033", held for 24.906272196s
I0704 00:00:35.935966 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .DriverName
I0704 00:00:35.936814 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetIP
I0704 00:00:35.941084 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has defined MAC address 52:54:00:af:98:c8 in network mk-old-k8s-version-979033
I0704 00:00:35.941480 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:af:98:c8", ip: ""} in network mk-old-k8s-version-979033: {Iface:virbr4 ExpiryTime:2024-07-04 01:00:26 +0000 UTC Type:0 Mac:52:54:00:af:98:c8 Iaid: IPaddr:192.168.72.59 Prefix:24 Hostname:old-k8s-version-979033 Clientid:01:52:54:00:af:98:c8}
I0704 00:00:35.941520 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has defined IP address 192.168.72.59 and MAC address 52:54:00:af:98:c8 in network mk-old-k8s-version-979033
I0704 00:00:35.941865 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .DriverName
I0704 00:00:35.942837 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .DriverName
I0704 00:00:35.943050 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .DriverName
I0704 00:00:35.943137 58668 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0704 00:00:35.943177 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetSSHHostname
I0704 00:00:35.943748 58668 ssh_runner.go:195] Run: cat /version.json
I0704 00:00:35.943811 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetSSHHostname
I0704 00:00:35.947102 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has defined MAC address 52:54:00:af:98:c8 in network mk-old-k8s-version-979033
I0704 00:00:35.947522 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:af:98:c8", ip: ""} in network mk-old-k8s-version-979033: {Iface:virbr4 ExpiryTime:2024-07-04 01:00:26 +0000 UTC Type:0 Mac:52:54:00:af:98:c8 Iaid: IPaddr:192.168.72.59 Prefix:24 Hostname:old-k8s-version-979033 Clientid:01:52:54:00:af:98:c8}
I0704 00:00:35.947552 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has defined IP address 192.168.72.59 and MAC address 52:54:00:af:98:c8 in network mk-old-k8s-version-979033
I0704 00:00:35.947673 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetSSHPort
I0704 00:00:35.947830 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetSSHKeyPath
I0704 00:00:35.947980 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetSSHUsername
I0704 00:00:35.948093 58668 sshutil.go:53] new ssh client: &{IP:192.168.72.59 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18998-9396/.minikube/machines/old-k8s-version-979033/id_rsa Username:docker}
I0704 00:00:35.948380 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has defined MAC address 52:54:00:af:98:c8 in network mk-old-k8s-version-979033
I0704 00:00:35.949076 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:af:98:c8", ip: ""} in network mk-old-k8s-version-979033: {Iface:virbr4 ExpiryTime:2024-07-04 01:00:26 +0000 UTC Type:0 Mac:52:54:00:af:98:c8 Iaid: IPaddr:192.168.72.59 Prefix:24 Hostname:old-k8s-version-979033 Clientid:01:52:54:00:af:98:c8}
I0704 00:00:35.949120 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has defined IP address 192.168.72.59 and MAC address 52:54:00:af:98:c8 in network mk-old-k8s-version-979033
I0704 00:00:35.949080 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetSSHPort
I0704 00:00:35.949301 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetSSHKeyPath
I0704 00:00:35.949506 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetSSHUsername
I0704 00:00:35.949673 58668 sshutil.go:53] new ssh client: &{IP:192.168.72.59 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18998-9396/.minikube/machines/old-k8s-version-979033/id_rsa Username:docker}
I0704 00:00:36.052844 58668 ssh_runner.go:195] Run: systemctl --version
I0704 00:00:36.061480 58668 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0704 00:00:36.258318 58668 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0704 00:00:36.264963 58668 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0704 00:00:36.265044 58668 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0704 00:00:36.288798 58668 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0704 00:00:36.288828 58668 start.go:494] detecting cgroup driver to use...
I0704 00:00:36.288957 58668 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0704 00:00:36.312074 58668 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0704 00:00:36.333588 58668 docker.go:217] disabling cri-docker service (if available) ...
I0704 00:00:36.333654 58668 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0704 00:00:36.350147 58668 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0704 00:00:36.366618 58668 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0704 00:00:36.522633 58668 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0704 00:00:36.698779 58668 docker.go:233] disabling docker service ...
I0704 00:00:36.698852 58668 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0704 00:00:36.714705 58668 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0704 00:00:36.730437 58668 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0704 00:00:36.880225 58668 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0704 00:00:37.003093 58668 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0704 00:00:37.019184 58668 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0704 00:00:37.041860 58668 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0704 00:00:37.041942 58668 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0704 00:00:37.054186 58668 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0704 00:00:37.054266 58668 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0704 00:00:37.066575 58668 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0704 00:00:37.078385 58668 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0704 00:00:37.090041 58668 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0704 00:00:37.101810 58668 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0704 00:00:37.112061 58668 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0704 00:00:37.112123 58668 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0704 00:00:37.126731 58668 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0704 00:00:37.137332 58668 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0704 00:00:37.253842 58668 ssh_runner.go:195] Run: sudo systemctl restart crio
I0704 00:00:37.399126 58668 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0704 00:00:37.399202 58668 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0704 00:00:37.405147 58668 start.go:562] Will wait 60s for crictl version
I0704 00:00:37.405228 58668 ssh_runner.go:195] Run: which crictl
I0704 00:00:37.410118 58668 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0704 00:00:37.454702 58668 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0704 00:00:37.454799 58668 ssh_runner.go:195] Run: crio --version
I0704 00:00:37.486440 58668 ssh_runner.go:195] Run: crio --version
I0704 00:00:37.523250 58668 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0704 00:00:37.524674 58668 main.go:141] libmachine: (old-k8s-version-979033) Calling .GetIP
I0704 00:00:37.528321 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has defined MAC address 52:54:00:af:98:c8 in network mk-old-k8s-version-979033
I0704 00:00:37.528773 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:af:98:c8", ip: ""} in network mk-old-k8s-version-979033: {Iface:virbr4 ExpiryTime:2024-07-04 01:00:26 +0000 UTC Type:0 Mac:52:54:00:af:98:c8 Iaid: IPaddr:192.168.72.59 Prefix:24 Hostname:old-k8s-version-979033 Clientid:01:52:54:00:af:98:c8}
I0704 00:00:37.528806 58668 main.go:141] libmachine: (old-k8s-version-979033) DBG | domain old-k8s-version-979033 has defined IP address 192.168.72.59 and MAC address 52:54:00:af:98:c8 in network mk-old-k8s-version-979033
I0704 00:00:37.529074 58668 ssh_runner.go:195] Run: grep 192.168.72.1 host.minikube.internal$ /etc/hosts
I0704 00:00:37.533829 58668 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.72.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0704 00:00:37.548193 58668 kubeadm.go:877] updating cluster {Name:old-k8s-version-979033 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19175/minikube-v1.33.1-1719929171-19175-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719972989-19184@sha256:86cb76941aa00fc70e665895234bda20991d5563e39b8ff07212e31a82ce7fb1 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-979033 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.59 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mo
untPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0704 00:00:37.548296 58668 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0704 00:00:37.548341 58668 ssh_runner.go:195] Run: sudo crictl images --output json
I0704 00:00:37.581326 58668 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0704 00:00:37.581394 58668 ssh_runner.go:195] Run: which lz4
I0704 00:00:37.585683 58668 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0704 00:00:37.590254 58668 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0704 00:00:37.590295 58668 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18998-9396/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0704 00:00:39.382825 58668 crio.go:462] duration metric: took 1.797183726s to copy over tarball
I0704 00:00:39.382905 58668 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0704 00:00:42.010567 58668 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.627639356s)
I0704 00:00:42.010590 58668 crio.go:469] duration metric: took 2.62773709s to extract the tarball
I0704 00:00:42.010596 58668 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0704 00:00:42.055377 58668 ssh_runner.go:195] Run: sudo crictl images --output json
I0704 00:00:42.109077 58668 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0704 00:00:42.109105 58668 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0704 00:00:42.109171 58668 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0704 00:00:42.109200 58668 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0704 00:00:42.109215 58668 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0704 00:00:42.109243 58668 image.go:134] retrieving image: registry.k8s.io/coredns:1.7.0
I0704 00:00:42.109245 58668 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0704 00:00:42.109180 58668 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0704 00:00:42.109192 58668 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0704 00:00:42.109172 58668 image.go:134] retrieving image: registry.k8s.io/pause:3.2
I0704 00:00:42.110688 58668 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0704 00:00:42.110781 58668 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0704 00:00:42.110802 58668 image.go:177] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0704 00:00:42.110804 58668 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0704 00:00:42.110688 58668 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0704 00:00:42.110688 58668 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0704 00:00:42.111193 58668 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0704 00:00:42.111193 58668 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0704 00:00:42.245608 58668 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0704 00:00:42.245692 58668 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0704 00:00:42.271622 58668 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0704 00:00:42.275561 58668 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0704 00:00:42.282195 58668 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0704 00:00:42.287075 58668 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0704 00:00:42.294094 58668 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0704 00:00:42.357424 58668 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0704 00:00:42.357477 58668 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0704 00:00:42.357526 58668 ssh_runner.go:195] Run: which crictl
I0704 00:00:42.357426 58668 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0704 00:00:42.357564 58668 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0704 00:00:42.357612 58668 ssh_runner.go:195] Run: which crictl
I0704 00:00:42.469161 58668 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0704 00:00:42.469224 58668 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0704 00:00:42.469235 58668 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0704 00:00:42.469276 58668 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0704 00:00:42.469291 58668 ssh_runner.go:195] Run: which crictl
I0704 00:00:42.469314 58668 ssh_runner.go:195] Run: which crictl
I0704 00:00:42.475133 58668 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0704 00:00:42.475176 58668 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0704 00:00:42.475133 58668 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0704 00:00:42.475199 58668 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0704 00:00:42.475273 58668 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0704 00:00:42.475306 58668 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0704 00:00:42.475223 58668 ssh_runner.go:195] Run: which crictl
I0704 00:00:42.475229 58668 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0704 00:00:42.475359 58668 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0704 00:00:42.475365 58668 ssh_runner.go:195] Run: which crictl
I0704 00:00:42.475317 58668 ssh_runner.go:195] Run: which crictl
I0704 00:00:42.478790 58668 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0704 00:00:42.478845 58668 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0704 00:00:42.494284 58668 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0704 00:00:42.597531 58668 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18998-9396/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0704 00:00:42.597555 58668 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0704 00:00:42.597641 58668 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0704 00:00:42.597698 58668 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18998-9396/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0704 00:00:42.608375 58668 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18998-9396/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0704 00:00:42.622388 58668 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18998-9396/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0704 00:00:42.622417 58668 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18998-9396/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0704 00:00:42.660625 58668 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18998-9396/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0704 00:00:42.660706 58668 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18998-9396/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0704 00:00:43.054517 58668 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0704 00:00:43.202873 58668 cache_images.go:92] duration metric: took 1.09374743s to LoadCachedImages
W0704 00:00:43.202972 58668 out.go:239] X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/18998-9396/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0: no such file or directory
X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/18998-9396/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0: no such file or directory
I0704 00:00:43.202986 58668 kubeadm.go:928] updating node { 192.168.72.59 8443 v1.20.0 crio true true} ...
I0704 00:00:43.203135 58668 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-979033 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.72.59
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-979033 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0704 00:00:43.203223 58668 ssh_runner.go:195] Run: crio config
I0704 00:00:43.253953 58668 cni.go:84] Creating CNI manager for ""
I0704 00:00:43.253977 58668 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0704 00:00:43.253991 58668 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0704 00:00:43.254008 58668 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.72.59 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-979033 NodeName:old-k8s-version-979033 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.72.59"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.72.59 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Stati
cPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0704 00:00:43.254130 58668 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.72.59
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-979033"
kubeletExtraArgs:
node-ip: 192.168.72.59
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.72.59"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0704 00:00:43.254190 58668 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0704 00:00:43.265103 58668 binaries.go:44] Found k8s binaries, skipping transfer
I0704 00:00:43.265192 58668 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0704 00:00:43.276514 58668 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (429 bytes)
I0704 00:00:43.296018 58668 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0704 00:00:43.315316 58668 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2120 bytes)
I0704 00:00:43.336710 58668 ssh_runner.go:195] Run: grep 192.168.72.59 control-plane.minikube.internal$ /etc/hosts
I0704 00:00:43.341342 58668 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.72.59 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0704 00:00:43.355964 58668 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0704 00:00:43.500843 58668 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0704 00:00:43.524631 58668 certs.go:68] Setting up /home/jenkins/minikube-integration/18998-9396/.minikube/profiles/old-k8s-version-979033 for IP: 192.168.72.59
I0704 00:00:43.524652 58668 certs.go:194] generating shared ca certs ...
I0704 00:00:43.524671 58668 certs.go:226] acquiring lock for ca certs: {Name:mkae2a448a2cff5bf43b72af4c17010bf290e802 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0704 00:00:43.524848 58668 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18998-9396/.minikube/ca.key
I0704 00:00:43.524902 58668 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18998-9396/.minikube/proxy-client-ca.key
I0704 00:00:43.524912 58668 certs.go:256] generating profile certs ...
I0704 00:00:43.524973 58668 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/18998-9396/.minikube/profiles/old-k8s-version-979033/client.key
I0704 00:00:43.524990 58668 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18998-9396/.minikube/profiles/old-k8s-version-979033/client.crt with IP's: []
I0704 00:00:43.619765 58668 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18998-9396/.minikube/profiles/old-k8s-version-979033/client.crt ...
I0704 00:00:43.619806 58668 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18998-9396/.minikube/profiles/old-k8s-version-979033/client.crt: {Name:mk13943ef89de34563b29919cad0616fe1b722cc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0704 00:00:43.620047 58668 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18998-9396/.minikube/profiles/old-k8s-version-979033/client.key ...
I0704 00:00:43.620067 58668 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18998-9396/.minikube/profiles/old-k8s-version-979033/client.key: {Name:mkc6d8ee950b14185bbf145e473cc770da0d0701 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0704 00:00:43.620172 58668 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/18998-9396/.minikube/profiles/old-k8s-version-979033/apiserver.key.03500654
I0704 00:00:43.620197 58668 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18998-9396/.minikube/profiles/old-k8s-version-979033/apiserver.crt.03500654 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.72.59]
I0704 00:00:43.891835 58668 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18998-9396/.minikube/profiles/old-k8s-version-979033/apiserver.crt.03500654 ...
I0704 00:00:43.891893 58668 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18998-9396/.minikube/profiles/old-k8s-version-979033/apiserver.crt.03500654: {Name:mkfe335fd2a0295f5a178250d5c91bcad947a780 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0704 00:00:43.892118 58668 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18998-9396/.minikube/profiles/old-k8s-version-979033/apiserver.key.03500654 ...
I0704 00:00:43.892135 58668 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18998-9396/.minikube/profiles/old-k8s-version-979033/apiserver.key.03500654: {Name:mk06732d285a768ca53c049e45b3db597235096e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0704 00:00:43.892249 58668 certs.go:381] copying /home/jenkins/minikube-integration/18998-9396/.minikube/profiles/old-k8s-version-979033/apiserver.crt.03500654 -> /home/jenkins/minikube-integration/18998-9396/.minikube/profiles/old-k8s-version-979033/apiserver.crt
I0704 00:00:43.892354 58668 certs.go:385] copying /home/jenkins/minikube-integration/18998-9396/.minikube/profiles/old-k8s-version-979033/apiserver.key.03500654 -> /home/jenkins/minikube-integration/18998-9396/.minikube/profiles/old-k8s-version-979033/apiserver.key
I0704 00:00:43.892430 58668 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/18998-9396/.minikube/profiles/old-k8s-version-979033/proxy-client.key
I0704 00:00:43.892452 58668 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18998-9396/.minikube/profiles/old-k8s-version-979033/proxy-client.crt with IP's: []
I0704 00:00:44.099004 58668 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18998-9396/.minikube/profiles/old-k8s-version-979033/proxy-client.crt ...
I0704 00:00:44.099034 58668 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18998-9396/.minikube/profiles/old-k8s-version-979033/proxy-client.crt: {Name:mk36429fdd458e014e892ad0f7c7c76835412fb6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0704 00:00:44.099234 58668 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18998-9396/.minikube/profiles/old-k8s-version-979033/proxy-client.key ...
I0704 00:00:44.099250 58668 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18998-9396/.minikube/profiles/old-k8s-version-979033/proxy-client.key: {Name:mke3a67ecf41e139d9d452f615a814e40df9a677 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0704 00:00:44.099464 58668 certs.go:484] found cert: /home/jenkins/minikube-integration/18998-9396/.minikube/certs/16574.pem (1338 bytes)
W0704 00:00:44.099511 58668 certs.go:480] ignoring /home/jenkins/minikube-integration/18998-9396/.minikube/certs/16574_empty.pem, impossibly tiny 0 bytes
I0704 00:00:44.099525 58668 certs.go:484] found cert: /home/jenkins/minikube-integration/18998-9396/.minikube/certs/ca-key.pem (1675 bytes)
I0704 00:00:44.099557 58668 certs.go:484] found cert: /home/jenkins/minikube-integration/18998-9396/.minikube/certs/ca.pem (1078 bytes)
I0704 00:00:44.099586 58668 certs.go:484] found cert: /home/jenkins/minikube-integration/18998-9396/.minikube/certs/cert.pem (1123 bytes)
I0704 00:00:44.099619 58668 certs.go:484] found cert: /home/jenkins/minikube-integration/18998-9396/.minikube/certs/key.pem (1679 bytes)
I0704 00:00:44.099669 58668 certs.go:484] found cert: /home/jenkins/minikube-integration/18998-9396/.minikube/files/etc/ssl/certs/165742.pem (1708 bytes)
I0704 00:00:44.100311 58668 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18998-9396/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0704 00:00:44.131421 58668 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18998-9396/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0704 00:00:44.160085 58668 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18998-9396/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0704 00:00:44.189585 58668 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18998-9396/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0704 00:00:44.221528 58668 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18998-9396/.minikube/profiles/old-k8s-version-979033/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0704 00:00:44.252058 58668 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18998-9396/.minikube/profiles/old-k8s-version-979033/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0704 00:00:44.317570 58668 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18998-9396/.minikube/profiles/old-k8s-version-979033/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0704 00:00:44.380008 58668 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18998-9396/.minikube/profiles/old-k8s-version-979033/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0704 00:00:44.425503 58668 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18998-9396/.minikube/files/etc/ssl/certs/165742.pem --> /usr/share/ca-certificates/165742.pem (1708 bytes)
I0704 00:00:44.458892 58668 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18998-9396/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0704 00:00:44.503812 58668 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18998-9396/.minikube/certs/16574.pem --> /usr/share/ca-certificates/16574.pem (1338 bytes)
I0704 00:00:44.546054 58668 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0704 00:00:44.578740 58668 ssh_runner.go:195] Run: openssl version
I0704 00:00:44.587478 58668 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/165742.pem && ln -fs /usr/share/ca-certificates/165742.pem /etc/ssl/certs/165742.pem"
I0704 00:00:44.613853 58668 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/165742.pem
I0704 00:00:44.621728 58668 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jul 3 23:00 /usr/share/ca-certificates/165742.pem
I0704 00:00:44.621798 58668 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/165742.pem
I0704 00:00:44.630611 58668 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/165742.pem /etc/ssl/certs/3ec20f2e.0"
I0704 00:00:44.645688 58668 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0704 00:00:44.660551 58668 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0704 00:00:44.667386 58668 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jul 3 22:48 /usr/share/ca-certificates/minikubeCA.pem
I0704 00:00:44.667446 58668 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0704 00:00:44.674883 58668 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0704 00:00:44.688293 58668 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/16574.pem && ln -fs /usr/share/ca-certificates/16574.pem /etc/ssl/certs/16574.pem"
I0704 00:00:44.702284 58668 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/16574.pem
I0704 00:00:44.709447 58668 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jul 3 23:00 /usr/share/ca-certificates/16574.pem
I0704 00:00:44.709527 58668 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/16574.pem
I0704 00:00:44.718476 58668 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/16574.pem /etc/ssl/certs/51391683.0"
I0704 00:00:44.734843 58668 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0704 00:00:44.741247 58668 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0704 00:00:44.741307 58668 kubeadm.go:391] StartCluster: {Name:old-k8s-version-979033 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19175/minikube-v1.33.1-1719929171-19175-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719972989-19184@sha256:86cb76941aa00fc70e665895234bda20991d5563e39b8ff07212e31a82ce7fb1 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-979033 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.59 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0704 00:00:44.741403 58668 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0704 00:00:44.741461 58668 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0704 00:00:44.800262 58668 cri.go:89] found id: ""
I0704 00:00:44.800349 58668 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0704 00:00:44.817664 58668 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0704 00:00:44.835091 58668 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0704 00:00:44.852434 58668 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0704 00:00:44.852457 58668 kubeadm.go:156] found existing configuration files:
I0704 00:00:44.852513 58668 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0704 00:00:44.865473 58668 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0704 00:00:44.865546 58668 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0704 00:00:44.879692 58668 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0704 00:00:44.892084 58668 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0704 00:00:44.892149 58668 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0704 00:00:44.905556 58668 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0704 00:00:44.920377 58668 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0704 00:00:44.920449 58668 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0704 00:00:44.936126 58668 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0704 00:00:44.951110 58668 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0704 00:00:44.951174 58668 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0704 00:00:44.965948 58668 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0704 00:00:45.320735 58668 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0704 00:02:44.086037 58668 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0704 00:02:44.087762 58668 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
I0704 00:02:44.087958 58668 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0704 00:02:44.088058 58668 kubeadm.go:309] [preflight] Running pre-flight checks
I0704 00:02:44.088222 58668 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0704 00:02:44.088667 58668 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0704 00:02:44.088980 58668 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0704 00:02:44.089356 58668 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0704 00:02:44.091347 58668 out.go:204] - Generating certificates and keys ...
I0704 00:02:44.091456 58668 kubeadm.go:309] [certs] Using existing ca certificate authority
I0704 00:02:44.091545 58668 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0704 00:02:44.091650 58668 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key
I0704 00:02:44.091735 58668 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key
I0704 00:02:44.091830 58668 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key
I0704 00:02:44.091923 58668 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key
I0704 00:02:44.092010 58668 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key
I0704 00:02:44.092184 58668 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-979033] and IPs [192.168.72.59 127.0.0.1 ::1]
I0704 00:02:44.092264 58668 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key
I0704 00:02:44.092405 58668 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-979033] and IPs [192.168.72.59 127.0.0.1 ::1]
I0704 00:02:44.092492 58668 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key
I0704 00:02:44.092573 58668 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key
I0704 00:02:44.092626 58668 kubeadm.go:309] [certs] Generating "sa" key and public key
I0704 00:02:44.092719 58668 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0704 00:02:44.092794 58668 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0704 00:02:44.092873 58668 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0704 00:02:44.092969 58668 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0704 00:02:44.093048 58668 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0704 00:02:44.093176 58668 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0704 00:02:44.093298 58668 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0704 00:02:44.093365 58668 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0704 00:02:44.093454 58668 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0704 00:02:44.095936 58668 out.go:204] - Booting up control plane ...
I0704 00:02:44.096055 58668 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0704 00:02:44.096155 58668 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0704 00:02:44.096250 58668 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0704 00:02:44.096357 58668 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0704 00:02:44.096584 58668 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0704 00:02:44.096677 58668 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0704 00:02:44.096777 58668 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0704 00:02:44.096984 58668 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0704 00:02:44.097060 58668 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0704 00:02:44.097218 58668 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0704 00:02:44.097319 58668 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0704 00:02:44.097591 58668 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0704 00:02:44.097687 58668 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0704 00:02:44.097880 58668 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0704 00:02:44.097986 58668 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0704 00:02:44.098235 58668 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0704 00:02:44.098262 58668 kubeadm.go:309]
I0704 00:02:44.098326 58668 kubeadm.go:309] Unfortunately, an error has occurred:
I0704 00:02:44.098388 58668 kubeadm.go:309] timed out waiting for the condition
I0704 00:02:44.098397 58668 kubeadm.go:309]
I0704 00:02:44.098452 58668 kubeadm.go:309] This error is likely caused by:
I0704 00:02:44.098508 58668 kubeadm.go:309] - The kubelet is not running
I0704 00:02:44.098606 58668 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0704 00:02:44.098613 58668 kubeadm.go:309]
I0704 00:02:44.098700 58668 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0704 00:02:44.098729 58668 kubeadm.go:309] - 'systemctl status kubelet'
I0704 00:02:44.098760 58668 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0704 00:02:44.098767 58668 kubeadm.go:309]
I0704 00:02:44.098918 58668 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0704 00:02:44.099026 58668 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0704 00:02:44.099039 58668 kubeadm.go:309]
I0704 00:02:44.099153 58668 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0704 00:02:44.099266 58668 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0704 00:02:44.099361 58668 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0704 00:02:44.099458 58668 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0704 00:02:44.099530 58668 kubeadm.go:309]
W0704 00:02:44.099625 58668 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-979033] and IPs [192.168.72.59 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-979033] and IPs [192.168.72.59 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-979033] and IPs [192.168.72.59 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-979033] and IPs [192.168.72.59 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0704 00:02:44.099675 58668 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0704 00:02:46.186954 58668 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (2.087252943s)
I0704 00:02:46.187042 58668 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0704 00:02:46.202298 58668 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0704 00:02:46.212983 58668 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0704 00:02:46.213006 58668 kubeadm.go:156] found existing configuration files:
I0704 00:02:46.213069 58668 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0704 00:02:46.223148 58668 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0704 00:02:46.223216 58668 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0704 00:02:46.234137 58668 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0704 00:02:46.245663 58668 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0704 00:02:46.245754 58668 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0704 00:02:46.256829 58668 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0704 00:02:46.267622 58668 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0704 00:02:46.267716 58668 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0704 00:02:46.278718 58668 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0704 00:02:46.289343 58668 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0704 00:02:46.289412 58668 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0704 00:02:46.300276 58668 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0704 00:02:46.378890 58668 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0704 00:02:46.379058 58668 kubeadm.go:309] [preflight] Running pre-flight checks
I0704 00:02:46.537994 58668 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0704 00:02:46.538133 58668 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0704 00:02:46.538264 58668 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0704 00:02:46.764122 58668 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0704 00:02:46.766061 58668 out.go:204] - Generating certificates and keys ...
I0704 00:02:46.766182 58668 kubeadm.go:309] [certs] Using existing ca certificate authority
I0704 00:02:46.766302 58668 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0704 00:02:46.766430 58668 kubeadm.go:309] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0704 00:02:46.766515 58668 kubeadm.go:309] [certs] Using existing front-proxy-ca certificate authority
I0704 00:02:46.766618 58668 kubeadm.go:309] [certs] Using existing front-proxy-client certificate and key on disk
I0704 00:02:46.766692 58668 kubeadm.go:309] [certs] Using existing etcd/ca certificate authority
I0704 00:02:46.766794 58668 kubeadm.go:309] [certs] Using existing etcd/server certificate and key on disk
I0704 00:02:46.766887 58668 kubeadm.go:309] [certs] Using existing etcd/peer certificate and key on disk
I0704 00:02:46.766994 58668 kubeadm.go:309] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0704 00:02:46.767125 58668 kubeadm.go:309] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0704 00:02:46.767189 58668 kubeadm.go:309] [certs] Using the existing "sa" key
I0704 00:02:46.767285 58668 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0704 00:02:46.948066 58668 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0704 00:02:47.032510 58668 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0704 00:02:47.144262 58668 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0704 00:02:47.231205 58668 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0704 00:02:47.246565 58668 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0704 00:02:47.247779 58668 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0704 00:02:47.247845 58668 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0704 00:02:47.401949 58668 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0704 00:02:47.404143 58668 out.go:204] - Booting up control plane ...
I0704 00:02:47.404275 58668 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0704 00:02:47.408887 58668 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0704 00:02:47.410003 58668 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0704 00:02:47.419072 58668 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0704 00:02:47.422047 58668 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0704 00:03:27.424912 58668 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0704 00:03:27.425045 58668 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0704 00:03:27.425219 58668 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0704 00:03:32.425983 58668 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0704 00:03:32.426257 58668 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0704 00:03:42.426668 58668 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0704 00:03:42.426893 58668 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0704 00:04:02.426487 58668 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0704 00:04:02.426722 58668 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0704 00:04:42.426352 58668 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0704 00:04:42.426585 58668 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0704 00:04:42.426602 58668 kubeadm.go:309]
I0704 00:04:42.426654 58668 kubeadm.go:309] Unfortunately, an error has occurred:
I0704 00:04:42.426715 58668 kubeadm.go:309] timed out waiting for the condition
I0704 00:04:42.426728 58668 kubeadm.go:309]
I0704 00:04:42.426777 58668 kubeadm.go:309] This error is likely caused by:
I0704 00:04:42.426823 58668 kubeadm.go:309] - The kubelet is not running
I0704 00:04:42.426947 58668 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0704 00:04:42.426960 58668 kubeadm.go:309]
I0704 00:04:42.427100 58668 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0704 00:04:42.427162 58668 kubeadm.go:309] - 'systemctl status kubelet'
I0704 00:04:42.427220 58668 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0704 00:04:42.427231 58668 kubeadm.go:309]
I0704 00:04:42.427376 58668 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0704 00:04:42.427496 58668 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0704 00:04:42.427508 58668 kubeadm.go:309]
I0704 00:04:42.427628 58668 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0704 00:04:42.427747 58668 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0704 00:04:42.427855 58668 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0704 00:04:42.427948 58668 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0704 00:04:42.427958 58668 kubeadm.go:309]
I0704 00:04:42.429690 58668 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0704 00:04:42.429810 58668 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0704 00:04:42.429959 58668 kubeadm.go:393] duration metric: took 3m57.688653134s to StartCluster
I0704 00:04:42.429981 58668 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
I0704 00:04:42.430014 58668 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0704 00:04:42.430078 58668 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0704 00:04:42.479399 58668 cri.go:89] found id: ""
I0704 00:04:42.479428 58668 logs.go:276] 0 containers: []
W0704 00:04:42.479438 58668 logs.go:278] No container was found matching "kube-apiserver"
I0704 00:04:42.479445 58668 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0704 00:04:42.479510 58668 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0704 00:04:42.515478 58668 cri.go:89] found id: ""
I0704 00:04:42.515500 58668 logs.go:276] 0 containers: []
W0704 00:04:42.515507 58668 logs.go:278] No container was found matching "etcd"
I0704 00:04:42.515514 58668 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0704 00:04:42.515564 58668 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0704 00:04:42.551390 58668 cri.go:89] found id: ""
I0704 00:04:42.551427 58668 logs.go:276] 0 containers: []
W0704 00:04:42.551437 58668 logs.go:278] No container was found matching "coredns"
I0704 00:04:42.551444 58668 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0704 00:04:42.551509 58668 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0704 00:04:42.587011 58668 cri.go:89] found id: ""
I0704 00:04:42.587033 58668 logs.go:276] 0 containers: []
W0704 00:04:42.587041 58668 logs.go:278] No container was found matching "kube-scheduler"
I0704 00:04:42.587047 58668 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0704 00:04:42.587104 58668 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0704 00:04:42.624127 58668 cri.go:89] found id: ""
I0704 00:04:42.624153 58668 logs.go:276] 0 containers: []
W0704 00:04:42.624162 58668 logs.go:278] No container was found matching "kube-proxy"
I0704 00:04:42.624168 58668 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0704 00:04:42.624214 58668 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0704 00:04:42.659967 58668 cri.go:89] found id: ""
I0704 00:04:42.659989 58668 logs.go:276] 0 containers: []
W0704 00:04:42.659997 58668 logs.go:278] No container was found matching "kube-controller-manager"
I0704 00:04:42.660002 58668 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0704 00:04:42.660060 58668 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0704 00:04:42.697633 58668 cri.go:89] found id: ""
I0704 00:04:42.697656 58668 logs.go:276] 0 containers: []
W0704 00:04:42.697663 58668 logs.go:278] No container was found matching "kindnet"
I0704 00:04:42.697672 58668 logs.go:123] Gathering logs for describe nodes ...
I0704 00:04:42.697683 58668 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0704 00:04:42.814556 58668 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0704 00:04:42.814579 58668 logs.go:123] Gathering logs for CRI-O ...
I0704 00:04:42.814590 58668 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0704 00:04:42.914948 58668 logs.go:123] Gathering logs for container status ...
I0704 00:04:42.914983 58668 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0704 00:04:42.970989 58668 logs.go:123] Gathering logs for kubelet ...
I0704 00:04:42.971019 58668 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0704 00:04:43.022403 58668 logs.go:123] Gathering logs for dmesg ...
I0704 00:04:43.022437 58668 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
W0704 00:04:43.036189 58668 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0704 00:04:43.036226 58668 out.go:239] *
*
W0704 00:04:43.036287 58668 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0704 00:04:43.036312 58668 out.go:239] *
*
W0704 00:04:43.037153 58668 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0704 00:04:43.042522 58668 out.go:177]
W0704 00:04:43.043670 58668 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0704 00:04:43.043718 58668 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0704 00:04:43.043740 58668 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0704 00:04:43.045214 58668 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-979033 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-979033 -n old-k8s-version-979033
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-979033 -n old-k8s-version-979033: exit status 6 (223.215589ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0704 00:04:43.317923 61680 status.go:451] kubeconfig endpoint: get endpoint: "old-k8s-version-979033" does not appear in /home/jenkins/minikube-integration/18998-9396/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-979033" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (296.86s)