=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-179312 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
E0814 00:55:05.518634 16589 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19429-9425/.minikube/profiles/addons-937866/client.crt: no such file or directory" logger="UnhandledError"
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-179312 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m57.114939768s)
-- stdout --
* [old-k8s-version-179312] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=19429
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19429-9425/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19429-9425/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-179312" primary control-plane node in "old-k8s-version-179312" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0814 00:55:03.696355 57577 out.go:291] Setting OutFile to fd 1 ...
I0814 00:55:03.696607 57577 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0814 00:55:03.696617 57577 out.go:304] Setting ErrFile to fd 2...
I0814 00:55:03.696621 57577 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0814 00:55:03.696796 57577 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19429-9425/.minikube/bin
I0814 00:55:03.697350 57577 out.go:298] Setting JSON to false
I0814 00:55:03.698284 57577 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":5850,"bootTime":1723591054,"procs":214,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1066-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0814 00:55:03.698338 57577 start.go:139] virtualization: kvm guest
I0814 00:55:03.700908 57577 out.go:177] * [old-k8s-version-179312] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
I0814 00:55:03.702277 57577 notify.go:220] Checking for updates...
I0814 00:55:03.702283 57577 out.go:177] - MINIKUBE_LOCATION=19429
I0814 00:55:03.703620 57577 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0814 00:55:03.704933 57577 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19429-9425/kubeconfig
I0814 00:55:03.706334 57577 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19429-9425/.minikube
I0814 00:55:03.707535 57577 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0814 00:55:03.708801 57577 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0814 00:55:03.710720 57577 config.go:182] Loaded profile config "cert-expiration-769488": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.0
I0814 00:55:03.710855 57577 config.go:182] Loaded profile config "kubernetes-upgrade-492920": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.0
I0814 00:55:03.710995 57577 config.go:182] Loaded profile config "pause-074686": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.0
I0814 00:55:03.711078 57577 driver.go:392] Setting default libvirt URI to qemu:///system
I0814 00:55:03.745905 57577 out.go:177] * Using the kvm2 driver based on user configuration
I0814 00:55:03.746994 57577 start.go:297] selected driver: kvm2
I0814 00:55:03.747007 57577 start.go:901] validating driver "kvm2" against <nil>
I0814 00:55:03.747018 57577 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0814 00:55:03.747674 57577 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0814 00:55:03.747754 57577 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19429-9425/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0814 00:55:03.762522 57577 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.1
I0814 00:55:03.762566 57577 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0814 00:55:03.762833 57577 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0814 00:55:03.762913 57577 cni.go:84] Creating CNI manager for ""
I0814 00:55:03.762931 57577 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0814 00:55:03.762947 57577 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0814 00:55:03.763015 57577 start.go:340] cluster config:
{Name:old-k8s-version-179312 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723567951-19429@sha256:cdfb2e55e95c0c0e857baca4796fc9879d11f99617f48df875a23169fed0e083 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-179312 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0814 00:55:03.763150 57577 iso.go:125] acquiring lock: {Name:mk654171f0e78c238a265344dbbd1eacb21d0f1b Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0814 00:55:03.764863 57577 out.go:177] * Starting "old-k8s-version-179312" primary control-plane node in "old-k8s-version-179312" cluster
I0814 00:55:03.765919 57577 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0814 00:55:03.765946 57577 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19429-9425/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0814 00:55:03.765959 57577 cache.go:56] Caching tarball of preloaded images
I0814 00:55:03.766029 57577 preload.go:172] Found /home/jenkins/minikube-integration/19429-9425/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0814 00:55:03.766056 57577 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0814 00:55:03.766167 57577 profile.go:143] Saving config to /home/jenkins/minikube-integration/19429-9425/.minikube/profiles/old-k8s-version-179312/config.json ...
I0814 00:55:03.766190 57577 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19429-9425/.minikube/profiles/old-k8s-version-179312/config.json: {Name:mk2a4eedf248d49e32909c6cfca37fd6ec8cf38d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0814 00:55:03.766332 57577 start.go:360] acquireMachinesLock for old-k8s-version-179312: {Name:mk8ab1b491404dd6cc95a37a50c74a14d6d0e4c9 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0814 00:55:31.535320 57577 start.go:364] duration metric: took 27.768940506s to acquireMachinesLock for "old-k8s-version-179312"
I0814 00:55:31.535388 57577 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-179312 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19429/minikube-v1.33.1-1723567878-19429-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723567951-19429@sha256:cdfb2e55e95c0c0e857baca4796fc9879d11f99617f48df875a23169fed0e083 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-179312 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0814 00:55:31.535510 57577 start.go:125] createHost starting for "" (driver="kvm2")
I0814 00:55:31.537882 57577 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0814 00:55:31.538073 57577 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0814 00:55:31.538146 57577 main.go:141] libmachine: Launching plugin server for driver kvm2
I0814 00:55:31.554840 57577 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38325
I0814 00:55:31.555283 57577 main.go:141] libmachine: () Calling .GetVersion
I0814 00:55:31.555885 57577 main.go:141] libmachine: Using API Version 1
I0814 00:55:31.555909 57577 main.go:141] libmachine: () Calling .SetConfigRaw
I0814 00:55:31.556232 57577 main.go:141] libmachine: () Calling .GetMachineName
I0814 00:55:31.556446 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetMachineName
I0814 00:55:31.556600 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .DriverName
I0814 00:55:31.556774 57577 start.go:159] libmachine.API.Create for "old-k8s-version-179312" (driver="kvm2")
I0814 00:55:31.556805 57577 client.go:168] LocalClient.Create starting
I0814 00:55:31.556842 57577 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19429-9425/.minikube/certs/ca.pem
I0814 00:55:31.556880 57577 main.go:141] libmachine: Decoding PEM data...
I0814 00:55:31.556905 57577 main.go:141] libmachine: Parsing certificate...
I0814 00:55:31.556975 57577 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19429-9425/.minikube/certs/cert.pem
I0814 00:55:31.557002 57577 main.go:141] libmachine: Decoding PEM data...
I0814 00:55:31.557022 57577 main.go:141] libmachine: Parsing certificate...
I0814 00:55:31.557054 57577 main.go:141] libmachine: Running pre-create checks...
I0814 00:55:31.557067 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .PreCreateCheck
I0814 00:55:31.557420 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetConfigRaw
I0814 00:55:31.557832 57577 main.go:141] libmachine: Creating machine...
I0814 00:55:31.557848 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .Create
I0814 00:55:31.557980 57577 main.go:141] libmachine: (old-k8s-version-179312) Creating KVM machine...
I0814 00:55:31.559337 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | found existing default KVM network
I0814 00:55:31.560592 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | I0814 00:55:31.560438 57790 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:ff:ea:bc} reservation:<nil>}
I0814 00:55:31.561573 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | I0814 00:55:31.561465 57790 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:8b:d6:4c} reservation:<nil>}
I0814 00:55:31.562797 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | I0814 00:55:31.562719 57790 network.go:206] using free private subnet 192.168.61.0/24: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000338ee0}
I0814 00:55:31.562820 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | created network xml:
I0814 00:55:31.562830 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | <network>
I0814 00:55:31.562841 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | <name>mk-old-k8s-version-179312</name>
I0814 00:55:31.562849 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | <dns enable='no'/>
I0814 00:55:31.562858 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG |
I0814 00:55:31.562867 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | <ip address='192.168.61.1' netmask='255.255.255.0'>
I0814 00:55:31.562876 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | <dhcp>
I0814 00:55:31.562896 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | <range start='192.168.61.2' end='192.168.61.253'/>
I0814 00:55:31.562906 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | </dhcp>
I0814 00:55:31.562913 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | </ip>
I0814 00:55:31.562922 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG |
I0814 00:55:31.562929 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | </network>
I0814 00:55:31.562938 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG |
I0814 00:55:31.568868 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | trying to create private KVM network mk-old-k8s-version-179312 192.168.61.0/24...
I0814 00:55:31.640300 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | private KVM network mk-old-k8s-version-179312 192.168.61.0/24 created
I0814 00:55:31.640336 57577 main.go:141] libmachine: (old-k8s-version-179312) Setting up store path in /home/jenkins/minikube-integration/19429-9425/.minikube/machines/old-k8s-version-179312 ...
I0814 00:55:31.640353 57577 main.go:141] libmachine: (old-k8s-version-179312) Building disk image from file:///home/jenkins/minikube-integration/19429-9425/.minikube/cache/iso/amd64/minikube-v1.33.1-1723567878-19429-amd64.iso
I0814 00:55:31.640370 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | I0814 00:55:31.640303 57790 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19429-9425/.minikube
I0814 00:55:31.640474 57577 main.go:141] libmachine: (old-k8s-version-179312) Downloading /home/jenkins/minikube-integration/19429-9425/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19429-9425/.minikube/cache/iso/amd64/minikube-v1.33.1-1723567878-19429-amd64.iso...
I0814 00:55:31.877025 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | I0814 00:55:31.876886 57790 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19429-9425/.minikube/machines/old-k8s-version-179312/id_rsa...
I0814 00:55:32.089893 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | I0814 00:55:32.089752 57790 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19429-9425/.minikube/machines/old-k8s-version-179312/old-k8s-version-179312.rawdisk...
I0814 00:55:32.089944 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | Writing magic tar header
I0814 00:55:32.089962 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | Writing SSH key tar header
I0814 00:55:32.089976 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | I0814 00:55:32.089892 57790 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19429-9425/.minikube/machines/old-k8s-version-179312 ...
I0814 00:55:32.090023 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19429-9425/.minikube/machines/old-k8s-version-179312
I0814 00:55:32.090071 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19429-9425/.minikube/machines
I0814 00:55:32.090098 57577 main.go:141] libmachine: (old-k8s-version-179312) Setting executable bit set on /home/jenkins/minikube-integration/19429-9425/.minikube/machines/old-k8s-version-179312 (perms=drwx------)
I0814 00:55:32.090113 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19429-9425/.minikube
I0814 00:55:32.090134 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19429-9425
I0814 00:55:32.090145 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0814 00:55:32.090162 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | Checking permissions on dir: /home/jenkins
I0814 00:55:32.090174 57577 main.go:141] libmachine: (old-k8s-version-179312) Setting executable bit set on /home/jenkins/minikube-integration/19429-9425/.minikube/machines (perms=drwxr-xr-x)
I0814 00:55:32.090187 57577 main.go:141] libmachine: (old-k8s-version-179312) Setting executable bit set on /home/jenkins/minikube-integration/19429-9425/.minikube (perms=drwxr-xr-x)
I0814 00:55:32.090199 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | Checking permissions on dir: /home
I0814 00:55:32.090216 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | Skipping /home - not owner
I0814 00:55:32.090233 57577 main.go:141] libmachine: (old-k8s-version-179312) Setting executable bit set on /home/jenkins/minikube-integration/19429-9425 (perms=drwxrwxr-x)
I0814 00:55:32.090246 57577 main.go:141] libmachine: (old-k8s-version-179312) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0814 00:55:32.090270 57577 main.go:141] libmachine: (old-k8s-version-179312) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0814 00:55:32.090283 57577 main.go:141] libmachine: (old-k8s-version-179312) Creating domain...
I0814 00:55:32.091407 57577 main.go:141] libmachine: (old-k8s-version-179312) define libvirt domain using xml:
I0814 00:55:32.091429 57577 main.go:141] libmachine: (old-k8s-version-179312) <domain type='kvm'>
I0814 00:55:32.091442 57577 main.go:141] libmachine: (old-k8s-version-179312) <name>old-k8s-version-179312</name>
I0814 00:55:32.091457 57577 main.go:141] libmachine: (old-k8s-version-179312) <memory unit='MiB'>2200</memory>
I0814 00:55:32.091470 57577 main.go:141] libmachine: (old-k8s-version-179312) <vcpu>2</vcpu>
I0814 00:55:32.091482 57577 main.go:141] libmachine: (old-k8s-version-179312) <features>
I0814 00:55:32.091496 57577 main.go:141] libmachine: (old-k8s-version-179312) <acpi/>
I0814 00:55:32.091532 57577 main.go:141] libmachine: (old-k8s-version-179312) <apic/>
I0814 00:55:32.091546 57577 main.go:141] libmachine: (old-k8s-version-179312) <pae/>
I0814 00:55:32.091554 57577 main.go:141] libmachine: (old-k8s-version-179312)
I0814 00:55:32.091567 57577 main.go:141] libmachine: (old-k8s-version-179312) </features>
I0814 00:55:32.091580 57577 main.go:141] libmachine: (old-k8s-version-179312) <cpu mode='host-passthrough'>
I0814 00:55:32.091623 57577 main.go:141] libmachine: (old-k8s-version-179312)
I0814 00:55:32.091654 57577 main.go:141] libmachine: (old-k8s-version-179312) </cpu>
I0814 00:55:32.091730 57577 main.go:141] libmachine: (old-k8s-version-179312) <os>
I0814 00:55:32.091766 57577 main.go:141] libmachine: (old-k8s-version-179312) <type>hvm</type>
I0814 00:55:32.091781 57577 main.go:141] libmachine: (old-k8s-version-179312) <boot dev='cdrom'/>
I0814 00:55:32.091794 57577 main.go:141] libmachine: (old-k8s-version-179312) <boot dev='hd'/>
I0814 00:55:32.091808 57577 main.go:141] libmachine: (old-k8s-version-179312) <bootmenu enable='no'/>
I0814 00:55:32.091820 57577 main.go:141] libmachine: (old-k8s-version-179312) </os>
I0814 00:55:32.091834 57577 main.go:141] libmachine: (old-k8s-version-179312) <devices>
I0814 00:55:32.091848 57577 main.go:141] libmachine: (old-k8s-version-179312) <disk type='file' device='cdrom'>
I0814 00:55:32.091874 57577 main.go:141] libmachine: (old-k8s-version-179312) <source file='/home/jenkins/minikube-integration/19429-9425/.minikube/machines/old-k8s-version-179312/boot2docker.iso'/>
I0814 00:55:32.091894 57577 main.go:141] libmachine: (old-k8s-version-179312) <target dev='hdc' bus='scsi'/>
I0814 00:55:32.091906 57577 main.go:141] libmachine: (old-k8s-version-179312) <readonly/>
I0814 00:55:32.091919 57577 main.go:141] libmachine: (old-k8s-version-179312) </disk>
I0814 00:55:32.091932 57577 main.go:141] libmachine: (old-k8s-version-179312) <disk type='file' device='disk'>
I0814 00:55:32.091955 57577 main.go:141] libmachine: (old-k8s-version-179312) <driver name='qemu' type='raw' cache='default' io='threads' />
I0814 00:55:32.091984 57577 main.go:141] libmachine: (old-k8s-version-179312) <source file='/home/jenkins/minikube-integration/19429-9425/.minikube/machines/old-k8s-version-179312/old-k8s-version-179312.rawdisk'/>
I0814 00:55:32.091997 57577 main.go:141] libmachine: (old-k8s-version-179312) <target dev='hda' bus='virtio'/>
I0814 00:55:32.092012 57577 main.go:141] libmachine: (old-k8s-version-179312) </disk>
I0814 00:55:32.092030 57577 main.go:141] libmachine: (old-k8s-version-179312) <interface type='network'>
I0814 00:55:32.092046 57577 main.go:141] libmachine: (old-k8s-version-179312) <source network='mk-old-k8s-version-179312'/>
I0814 00:55:32.092059 57577 main.go:141] libmachine: (old-k8s-version-179312) <model type='virtio'/>
I0814 00:55:32.092071 57577 main.go:141] libmachine: (old-k8s-version-179312) </interface>
I0814 00:55:32.092081 57577 main.go:141] libmachine: (old-k8s-version-179312) <interface type='network'>
I0814 00:55:32.092096 57577 main.go:141] libmachine: (old-k8s-version-179312) <source network='default'/>
I0814 00:55:32.092109 57577 main.go:141] libmachine: (old-k8s-version-179312) <model type='virtio'/>
I0814 00:55:32.092123 57577 main.go:141] libmachine: (old-k8s-version-179312) </interface>
I0814 00:55:32.092135 57577 main.go:141] libmachine: (old-k8s-version-179312) <serial type='pty'>
I0814 00:55:32.092149 57577 main.go:141] libmachine: (old-k8s-version-179312) <target port='0'/>
I0814 00:55:32.092162 57577 main.go:141] libmachine: (old-k8s-version-179312) </serial>
I0814 00:55:32.092191 57577 main.go:141] libmachine: (old-k8s-version-179312) <console type='pty'>
I0814 00:55:32.092211 57577 main.go:141] libmachine: (old-k8s-version-179312) <target type='serial' port='0'/>
I0814 00:55:32.092225 57577 main.go:141] libmachine: (old-k8s-version-179312) </console>
I0814 00:55:32.092236 57577 main.go:141] libmachine: (old-k8s-version-179312) <rng model='virtio'>
I0814 00:55:32.092248 57577 main.go:141] libmachine: (old-k8s-version-179312) <backend model='random'>/dev/random</backend>
I0814 00:55:32.092258 57577 main.go:141] libmachine: (old-k8s-version-179312) </rng>
I0814 00:55:32.092270 57577 main.go:141] libmachine: (old-k8s-version-179312)
I0814 00:55:32.092278 57577 main.go:141] libmachine: (old-k8s-version-179312)
I0814 00:55:32.092289 57577 main.go:141] libmachine: (old-k8s-version-179312) </devices>
I0814 00:55:32.092297 57577 main.go:141] libmachine: (old-k8s-version-179312) </domain>
I0814 00:55:32.092307 57577 main.go:141] libmachine: (old-k8s-version-179312)
I0814 00:55:32.098774 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has defined MAC address 52:54:00:ae:96:3d in network default
I0814 00:55:32.099299 57577 main.go:141] libmachine: (old-k8s-version-179312) Ensuring networks are active...
I0814 00:55:32.099339 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has defined MAC address 52:54:00:b2:76:73 in network mk-old-k8s-version-179312
I0814 00:55:32.100028 57577 main.go:141] libmachine: (old-k8s-version-179312) Ensuring network default is active
I0814 00:55:32.100306 57577 main.go:141] libmachine: (old-k8s-version-179312) Ensuring network mk-old-k8s-version-179312 is active
I0814 00:55:32.100943 57577 main.go:141] libmachine: (old-k8s-version-179312) Getting domain xml...
I0814 00:55:32.101591 57577 main.go:141] libmachine: (old-k8s-version-179312) Creating domain...
I0814 00:55:33.472517 57577 main.go:141] libmachine: (old-k8s-version-179312) Waiting to get IP...
I0814 00:55:33.473697 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has defined MAC address 52:54:00:b2:76:73 in network mk-old-k8s-version-179312
I0814 00:55:33.474308 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | unable to find current IP address of domain old-k8s-version-179312 in network mk-old-k8s-version-179312
I0814 00:55:33.474347 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | I0814 00:55:33.474293 57790 retry.go:31] will retry after 304.321693ms: waiting for machine to come up
I0814 00:55:33.780870 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has defined MAC address 52:54:00:b2:76:73 in network mk-old-k8s-version-179312
I0814 00:55:33.781566 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | unable to find current IP address of domain old-k8s-version-179312 in network mk-old-k8s-version-179312
I0814 00:55:33.781594 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | I0814 00:55:33.781527 57790 retry.go:31] will retry after 264.143284ms: waiting for machine to come up
I0814 00:55:34.047100 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has defined MAC address 52:54:00:b2:76:73 in network mk-old-k8s-version-179312
I0814 00:55:34.047634 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | unable to find current IP address of domain old-k8s-version-179312 in network mk-old-k8s-version-179312
I0814 00:55:34.047665 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | I0814 00:55:34.047592 57790 retry.go:31] will retry after 324.712825ms: waiting for machine to come up
I0814 00:55:34.374081 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has defined MAC address 52:54:00:b2:76:73 in network mk-old-k8s-version-179312
I0814 00:55:34.374650 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | unable to find current IP address of domain old-k8s-version-179312 in network mk-old-k8s-version-179312
I0814 00:55:34.374679 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | I0814 00:55:34.374610 57790 retry.go:31] will retry after 526.975097ms: waiting for machine to come up
I0814 00:55:34.903553 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has defined MAC address 52:54:00:b2:76:73 in network mk-old-k8s-version-179312
I0814 00:55:34.904114 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | unable to find current IP address of domain old-k8s-version-179312 in network mk-old-k8s-version-179312
I0814 00:55:34.904141 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | I0814 00:55:34.904078 57790 retry.go:31] will retry after 590.3132ms: waiting for machine to come up
I0814 00:55:35.495952 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has defined MAC address 52:54:00:b2:76:73 in network mk-old-k8s-version-179312
I0814 00:55:35.496344 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | unable to find current IP address of domain old-k8s-version-179312 in network mk-old-k8s-version-179312
I0814 00:55:35.496366 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | I0814 00:55:35.496281 57790 retry.go:31] will retry after 594.301143ms: waiting for machine to come up
I0814 00:55:36.091970 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has defined MAC address 52:54:00:b2:76:73 in network mk-old-k8s-version-179312
I0814 00:55:36.092495 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | unable to find current IP address of domain old-k8s-version-179312 in network mk-old-k8s-version-179312
I0814 00:55:36.092523 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | I0814 00:55:36.092441 57790 retry.go:31] will retry after 1.189840198s: waiting for machine to come up
I0814 00:55:37.283941 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has defined MAC address 52:54:00:b2:76:73 in network mk-old-k8s-version-179312
I0814 00:55:37.284599 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | unable to find current IP address of domain old-k8s-version-179312 in network mk-old-k8s-version-179312
I0814 00:55:37.284619 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | I0814 00:55:37.284552 57790 retry.go:31] will retry after 1.349070391s: waiting for machine to come up
I0814 00:55:38.635003 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has defined MAC address 52:54:00:b2:76:73 in network mk-old-k8s-version-179312
I0814 00:55:38.635604 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | unable to find current IP address of domain old-k8s-version-179312 in network mk-old-k8s-version-179312
I0814 00:55:38.635638 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | I0814 00:55:38.635553 57790 retry.go:31] will retry after 1.613537695s: waiting for machine to come up
I0814 00:55:40.251072 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has defined MAC address 52:54:00:b2:76:73 in network mk-old-k8s-version-179312
I0814 00:55:40.251499 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | unable to find current IP address of domain old-k8s-version-179312 in network mk-old-k8s-version-179312
I0814 00:55:40.251531 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | I0814 00:55:40.251448 57790 retry.go:31] will retry after 1.60089539s: waiting for machine to come up
I0814 00:55:41.854151 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has defined MAC address 52:54:00:b2:76:73 in network mk-old-k8s-version-179312
I0814 00:55:41.854754 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | unable to find current IP address of domain old-k8s-version-179312 in network mk-old-k8s-version-179312
I0814 00:55:41.854782 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | I0814 00:55:41.854702 57790 retry.go:31] will retry after 2.148243714s: waiting for machine to come up
I0814 00:55:44.004437 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has defined MAC address 52:54:00:b2:76:73 in network mk-old-k8s-version-179312
I0814 00:55:44.005072 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | unable to find current IP address of domain old-k8s-version-179312 in network mk-old-k8s-version-179312
I0814 00:55:44.005099 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | I0814 00:55:44.005024 57790 retry.go:31] will retry after 2.619209472s: waiting for machine to come up
I0814 00:55:46.625566 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has defined MAC address 52:54:00:b2:76:73 in network mk-old-k8s-version-179312
I0814 00:55:46.626161 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | unable to find current IP address of domain old-k8s-version-179312 in network mk-old-k8s-version-179312
I0814 00:55:46.626187 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | I0814 00:55:46.626115 57790 retry.go:31] will retry after 3.838715847s: waiting for machine to come up
I0814 00:55:50.469166 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has defined MAC address 52:54:00:b2:76:73 in network mk-old-k8s-version-179312
I0814 00:55:50.469642 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | unable to find current IP address of domain old-k8s-version-179312 in network mk-old-k8s-version-179312
I0814 00:55:50.469666 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | I0814 00:55:50.469604 57790 retry.go:31] will retry after 4.767600404s: waiting for machine to come up
I0814 00:55:55.239239 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has defined MAC address 52:54:00:b2:76:73 in network mk-old-k8s-version-179312
I0814 00:55:55.239811 57577 main.go:141] libmachine: (old-k8s-version-179312) Found IP for machine: 192.168.61.123
I0814 00:55:55.239828 57577 main.go:141] libmachine: (old-k8s-version-179312) Reserving static IP address...
I0814 00:55:55.239838 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has current primary IP address 192.168.61.123 and MAC address 52:54:00:b2:76:73 in network mk-old-k8s-version-179312
I0814 00:55:55.240308 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-179312", mac: "52:54:00:b2:76:73", ip: "192.168.61.123"} in network mk-old-k8s-version-179312
I0814 00:55:55.316696 57577 main.go:141] libmachine: (old-k8s-version-179312) Reserved static IP address: 192.168.61.123
I0814 00:55:55.316730 57577 main.go:141] libmachine: (old-k8s-version-179312) Waiting for SSH to be available...
I0814 00:55:55.316741 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | Getting to WaitForSSH function...
I0814 00:55:55.319399 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has defined MAC address 52:54:00:b2:76:73 in network mk-old-k8s-version-179312
I0814 00:55:55.319812 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b2:76:73", ip: ""} in network mk-old-k8s-version-179312: {Iface:virbr4 ExpiryTime:2024-08-14 01:55:46 +0000 UTC Type:0 Mac:52:54:00:b2:76:73 Iaid: IPaddr:192.168.61.123 Prefix:24 Hostname:minikube Clientid:01:52:54:00:b2:76:73}
I0814 00:55:55.319846 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has defined IP address 192.168.61.123 and MAC address 52:54:00:b2:76:73 in network mk-old-k8s-version-179312
I0814 00:55:55.319928 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | Using SSH client type: external
I0814 00:55:55.319954 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | Using SSH private key: /home/jenkins/minikube-integration/19429-9425/.minikube/machines/old-k8s-version-179312/id_rsa (-rw-------)
I0814 00:55:55.319994 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.61.123 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19429-9425/.minikube/machines/old-k8s-version-179312/id_rsa -p 22] /usr/bin/ssh <nil>}
I0814 00:55:55.320009 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | About to run SSH command:
I0814 00:55:55.320027 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | exit 0
I0814 00:55:55.446445 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | SSH cmd err, output: <nil>:
I0814 00:55:55.446785 57577 main.go:141] libmachine: (old-k8s-version-179312) KVM machine creation complete!
I0814 00:55:55.447112 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetConfigRaw
I0814 00:55:55.447786 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .DriverName
I0814 00:55:55.448016 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .DriverName
I0814 00:55:55.448175 57577 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0814 00:55:55.448192 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetState
I0814 00:55:55.449437 57577 main.go:141] libmachine: Detecting operating system of created instance...
I0814 00:55:55.449454 57577 main.go:141] libmachine: Waiting for SSH to be available...
I0814 00:55:55.449475 57577 main.go:141] libmachine: Getting to WaitForSSH function...
I0814 00:55:55.449483 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetSSHHostname
I0814 00:55:55.452075 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has defined MAC address 52:54:00:b2:76:73 in network mk-old-k8s-version-179312
I0814 00:55:55.452571 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b2:76:73", ip: ""} in network mk-old-k8s-version-179312: {Iface:virbr4 ExpiryTime:2024-08-14 01:55:46 +0000 UTC Type:0 Mac:52:54:00:b2:76:73 Iaid: IPaddr:192.168.61.123 Prefix:24 Hostname:old-k8s-version-179312 Clientid:01:52:54:00:b2:76:73}
I0814 00:55:55.452602 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has defined IP address 192.168.61.123 and MAC address 52:54:00:b2:76:73 in network mk-old-k8s-version-179312
I0814 00:55:55.452762 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetSSHPort
I0814 00:55:55.452922 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetSSHKeyPath
I0814 00:55:55.453092 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetSSHKeyPath
I0814 00:55:55.453215 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetSSHUsername
I0814 00:55:55.453370 57577 main.go:141] libmachine: Using SSH client type: native
I0814 00:55:55.453620 57577 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.61.123 22 <nil> <nil>}
I0814 00:55:55.453635 57577 main.go:141] libmachine: About to run SSH command:
exit 0
I0814 00:55:55.557186 57577 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0814 00:55:55.557209 57577 main.go:141] libmachine: Detecting the provisioner...
I0814 00:55:55.557219 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetSSHHostname
I0814 00:55:55.560097 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has defined MAC address 52:54:00:b2:76:73 in network mk-old-k8s-version-179312
I0814 00:55:55.560604 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b2:76:73", ip: ""} in network mk-old-k8s-version-179312: {Iface:virbr4 ExpiryTime:2024-08-14 01:55:46 +0000 UTC Type:0 Mac:52:54:00:b2:76:73 Iaid: IPaddr:192.168.61.123 Prefix:24 Hostname:old-k8s-version-179312 Clientid:01:52:54:00:b2:76:73}
I0814 00:55:55.560642 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has defined IP address 192.168.61.123 and MAC address 52:54:00:b2:76:73 in network mk-old-k8s-version-179312
I0814 00:55:55.560843 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetSSHPort
I0814 00:55:55.561053 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetSSHKeyPath
I0814 00:55:55.561209 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetSSHKeyPath
I0814 00:55:55.561351 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetSSHUsername
I0814 00:55:55.561599 57577 main.go:141] libmachine: Using SSH client type: native
I0814 00:55:55.561786 57577 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.61.123 22 <nil> <nil>}
I0814 00:55:55.561798 57577 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0814 00:55:55.670388 57577 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0814 00:55:55.670466 57577 main.go:141] libmachine: found compatible host: buildroot
I0814 00:55:55.670476 57577 main.go:141] libmachine: Provisioning with buildroot...
I0814 00:55:55.670484 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetMachineName
I0814 00:55:55.670748 57577 buildroot.go:166] provisioning hostname "old-k8s-version-179312"
I0814 00:55:55.670772 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetMachineName
I0814 00:55:55.670981 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetSSHHostname
I0814 00:55:55.673322 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has defined MAC address 52:54:00:b2:76:73 in network mk-old-k8s-version-179312
I0814 00:55:55.673724 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b2:76:73", ip: ""} in network mk-old-k8s-version-179312: {Iface:virbr4 ExpiryTime:2024-08-14 01:55:46 +0000 UTC Type:0 Mac:52:54:00:b2:76:73 Iaid: IPaddr:192.168.61.123 Prefix:24 Hostname:old-k8s-version-179312 Clientid:01:52:54:00:b2:76:73}
I0814 00:55:55.673752 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has defined IP address 192.168.61.123 and MAC address 52:54:00:b2:76:73 in network mk-old-k8s-version-179312
I0814 00:55:55.673836 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetSSHPort
I0814 00:55:55.673986 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetSSHKeyPath
I0814 00:55:55.674167 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetSSHKeyPath
I0814 00:55:55.674289 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetSSHUsername
I0814 00:55:55.674470 57577 main.go:141] libmachine: Using SSH client type: native
I0814 00:55:55.674643 57577 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.61.123 22 <nil> <nil>}
I0814 00:55:55.674655 57577 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-179312 && echo "old-k8s-version-179312" | sudo tee /etc/hostname
I0814 00:55:55.795046 57577 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-179312
I0814 00:55:55.795087 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetSSHHostname
I0814 00:55:55.798230 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has defined MAC address 52:54:00:b2:76:73 in network mk-old-k8s-version-179312
I0814 00:55:55.798723 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b2:76:73", ip: ""} in network mk-old-k8s-version-179312: {Iface:virbr4 ExpiryTime:2024-08-14 01:55:46 +0000 UTC Type:0 Mac:52:54:00:b2:76:73 Iaid: IPaddr:192.168.61.123 Prefix:24 Hostname:old-k8s-version-179312 Clientid:01:52:54:00:b2:76:73}
I0814 00:55:55.798757 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has defined IP address 192.168.61.123 and MAC address 52:54:00:b2:76:73 in network mk-old-k8s-version-179312
I0814 00:55:55.798954 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetSSHPort
I0814 00:55:55.799167 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetSSHKeyPath
I0814 00:55:55.799377 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetSSHKeyPath
I0814 00:55:55.799538 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetSSHUsername
I0814 00:55:55.799734 57577 main.go:141] libmachine: Using SSH client type: native
I0814 00:55:55.799954 57577 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.61.123 22 <nil> <nil>}
I0814 00:55:55.799981 57577 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-179312' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-179312/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-179312' | sudo tee -a /etc/hosts;
fi
fi
I0814 00:55:55.914402 57577 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0814 00:55:55.914434 57577 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19429-9425/.minikube CaCertPath:/home/jenkins/minikube-integration/19429-9425/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19429-9425/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19429-9425/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19429-9425/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19429-9425/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19429-9425/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19429-9425/.minikube}
I0814 00:55:55.914468 57577 buildroot.go:174] setting up certificates
I0814 00:55:55.914478 57577 provision.go:84] configureAuth start
I0814 00:55:55.914490 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetMachineName
I0814 00:55:55.914774 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetIP
I0814 00:55:55.917526 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has defined MAC address 52:54:00:b2:76:73 in network mk-old-k8s-version-179312
I0814 00:55:55.917875 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b2:76:73", ip: ""} in network mk-old-k8s-version-179312: {Iface:virbr4 ExpiryTime:2024-08-14 01:55:46 +0000 UTC Type:0 Mac:52:54:00:b2:76:73 Iaid: IPaddr:192.168.61.123 Prefix:24 Hostname:old-k8s-version-179312 Clientid:01:52:54:00:b2:76:73}
I0814 00:55:55.917906 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has defined IP address 192.168.61.123 and MAC address 52:54:00:b2:76:73 in network mk-old-k8s-version-179312
I0814 00:55:55.918062 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetSSHHostname
I0814 00:55:55.920417 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has defined MAC address 52:54:00:b2:76:73 in network mk-old-k8s-version-179312
I0814 00:55:55.920799 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b2:76:73", ip: ""} in network mk-old-k8s-version-179312: {Iface:virbr4 ExpiryTime:2024-08-14 01:55:46 +0000 UTC Type:0 Mac:52:54:00:b2:76:73 Iaid: IPaddr:192.168.61.123 Prefix:24 Hostname:old-k8s-version-179312 Clientid:01:52:54:00:b2:76:73}
I0814 00:55:55.920829 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has defined IP address 192.168.61.123 and MAC address 52:54:00:b2:76:73 in network mk-old-k8s-version-179312
I0814 00:55:55.920975 57577 provision.go:143] copyHostCerts
I0814 00:55:55.921043 57577 exec_runner.go:144] found /home/jenkins/minikube-integration/19429-9425/.minikube/key.pem, removing ...
I0814 00:55:55.921058 57577 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19429-9425/.minikube/key.pem
I0814 00:55:55.921129 57577 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19429-9425/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19429-9425/.minikube/key.pem (1675 bytes)
I0814 00:55:55.921242 57577 exec_runner.go:144] found /home/jenkins/minikube-integration/19429-9425/.minikube/ca.pem, removing ...
I0814 00:55:55.921250 57577 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19429-9425/.minikube/ca.pem
I0814 00:55:55.921271 57577 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19429-9425/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19429-9425/.minikube/ca.pem (1082 bytes)
I0814 00:55:55.921337 57577 exec_runner.go:144] found /home/jenkins/minikube-integration/19429-9425/.minikube/cert.pem, removing ...
I0814 00:55:55.921344 57577 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19429-9425/.minikube/cert.pem
I0814 00:55:55.921363 57577 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19429-9425/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19429-9425/.minikube/cert.pem (1123 bytes)
I0814 00:55:55.921409 57577 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19429-9425/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19429-9425/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19429-9425/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-179312 san=[127.0.0.1 192.168.61.123 localhost minikube old-k8s-version-179312]
I0814 00:55:56.053872 57577 provision.go:177] copyRemoteCerts
I0814 00:55:56.053930 57577 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0814 00:55:56.053954 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetSSHHostname
I0814 00:55:56.057254 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has defined MAC address 52:54:00:b2:76:73 in network mk-old-k8s-version-179312
I0814 00:55:56.057603 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b2:76:73", ip: ""} in network mk-old-k8s-version-179312: {Iface:virbr4 ExpiryTime:2024-08-14 01:55:46 +0000 UTC Type:0 Mac:52:54:00:b2:76:73 Iaid: IPaddr:192.168.61.123 Prefix:24 Hostname:old-k8s-version-179312 Clientid:01:52:54:00:b2:76:73}
I0814 00:55:56.057639 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has defined IP address 192.168.61.123 and MAC address 52:54:00:b2:76:73 in network mk-old-k8s-version-179312
I0814 00:55:56.057816 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetSSHPort
I0814 00:55:56.058015 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetSSHKeyPath
I0814 00:55:56.058188 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetSSHUsername
I0814 00:55:56.058352 57577 sshutil.go:53] new ssh client: &{IP:192.168.61.123 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19429-9425/.minikube/machines/old-k8s-version-179312/id_rsa Username:docker}
I0814 00:55:56.139609 57577 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19429-9425/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0814 00:55:56.165593 57577 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19429-9425/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0814 00:55:56.188128 57577 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19429-9425/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0814 00:55:56.209868 57577 provision.go:87] duration metric: took 295.377794ms to configureAuth
I0814 00:55:56.209893 57577 buildroot.go:189] setting minikube options for container-runtime
I0814 00:55:56.210109 57577 config.go:182] Loaded profile config "old-k8s-version-179312": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0814 00:55:56.210217 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetSSHHostname
I0814 00:55:56.212858 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has defined MAC address 52:54:00:b2:76:73 in network mk-old-k8s-version-179312
I0814 00:55:56.213112 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b2:76:73", ip: ""} in network mk-old-k8s-version-179312: {Iface:virbr4 ExpiryTime:2024-08-14 01:55:46 +0000 UTC Type:0 Mac:52:54:00:b2:76:73 Iaid: IPaddr:192.168.61.123 Prefix:24 Hostname:old-k8s-version-179312 Clientid:01:52:54:00:b2:76:73}
I0814 00:55:56.213140 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has defined IP address 192.168.61.123 and MAC address 52:54:00:b2:76:73 in network mk-old-k8s-version-179312
I0814 00:55:56.213288 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetSSHPort
I0814 00:55:56.213441 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetSSHKeyPath
I0814 00:55:56.213623 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetSSHKeyPath
I0814 00:55:56.213790 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetSSHUsername
I0814 00:55:56.213956 57577 main.go:141] libmachine: Using SSH client type: native
I0814 00:55:56.214144 57577 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.61.123 22 <nil> <nil>}
I0814 00:55:56.214158 57577 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0814 00:55:56.471965 57577 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0814 00:55:56.471996 57577 main.go:141] libmachine: Checking connection to Docker...
I0814 00:55:56.472008 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetURL
I0814 00:55:56.473308 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | Using libvirt version 6000000
I0814 00:55:56.475477 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has defined MAC address 52:54:00:b2:76:73 in network mk-old-k8s-version-179312
I0814 00:55:56.475851 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b2:76:73", ip: ""} in network mk-old-k8s-version-179312: {Iface:virbr4 ExpiryTime:2024-08-14 01:55:46 +0000 UTC Type:0 Mac:52:54:00:b2:76:73 Iaid: IPaddr:192.168.61.123 Prefix:24 Hostname:old-k8s-version-179312 Clientid:01:52:54:00:b2:76:73}
I0814 00:55:56.475894 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has defined IP address 192.168.61.123 and MAC address 52:54:00:b2:76:73 in network mk-old-k8s-version-179312
I0814 00:55:56.476065 57577 main.go:141] libmachine: Docker is up and running!
I0814 00:55:56.476083 57577 main.go:141] libmachine: Reticulating splines...
I0814 00:55:56.476090 57577 client.go:171] duration metric: took 24.919275834s to LocalClient.Create
I0814 00:55:56.476115 57577 start.go:167] duration metric: took 24.919342328s to libmachine.API.Create "old-k8s-version-179312"
I0814 00:55:56.476127 57577 start.go:293] postStartSetup for "old-k8s-version-179312" (driver="kvm2")
I0814 00:55:56.476142 57577 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0814 00:55:56.476174 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .DriverName
I0814 00:55:56.476440 57577 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0814 00:55:56.476483 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetSSHHostname
I0814 00:55:56.478785 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has defined MAC address 52:54:00:b2:76:73 in network mk-old-k8s-version-179312
I0814 00:55:56.479119 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b2:76:73", ip: ""} in network mk-old-k8s-version-179312: {Iface:virbr4 ExpiryTime:2024-08-14 01:55:46 +0000 UTC Type:0 Mac:52:54:00:b2:76:73 Iaid: IPaddr:192.168.61.123 Prefix:24 Hostname:old-k8s-version-179312 Clientid:01:52:54:00:b2:76:73}
I0814 00:55:56.479149 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has defined IP address 192.168.61.123 and MAC address 52:54:00:b2:76:73 in network mk-old-k8s-version-179312
I0814 00:55:56.479303 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetSSHPort
I0814 00:55:56.479474 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetSSHKeyPath
I0814 00:55:56.479630 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetSSHUsername
I0814 00:55:56.479764 57577 sshutil.go:53] new ssh client: &{IP:192.168.61.123 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19429-9425/.minikube/machines/old-k8s-version-179312/id_rsa Username:docker}
I0814 00:55:56.559782 57577 ssh_runner.go:195] Run: cat /etc/os-release
I0814 00:55:56.564052 57577 info.go:137] Remote host: Buildroot 2023.02.9
I0814 00:55:56.564080 57577 filesync.go:126] Scanning /home/jenkins/minikube-integration/19429-9425/.minikube/addons for local assets ...
I0814 00:55:56.564191 57577 filesync.go:126] Scanning /home/jenkins/minikube-integration/19429-9425/.minikube/files for local assets ...
I0814 00:55:56.564302 57577 filesync.go:149] local asset: /home/jenkins/minikube-integration/19429-9425/.minikube/files/etc/ssl/certs/165892.pem -> 165892.pem in /etc/ssl/certs
I0814 00:55:56.564407 57577 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0814 00:55:56.573190 57577 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19429-9425/.minikube/files/etc/ssl/certs/165892.pem --> /etc/ssl/certs/165892.pem (1708 bytes)
I0814 00:55:56.598797 57577 start.go:296] duration metric: took 122.651964ms for postStartSetup
I0814 00:55:56.598855 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetConfigRaw
I0814 00:55:56.599510 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetIP
I0814 00:55:56.602510 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has defined MAC address 52:54:00:b2:76:73 in network mk-old-k8s-version-179312
I0814 00:55:56.602913 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b2:76:73", ip: ""} in network mk-old-k8s-version-179312: {Iface:virbr4 ExpiryTime:2024-08-14 01:55:46 +0000 UTC Type:0 Mac:52:54:00:b2:76:73 Iaid: IPaddr:192.168.61.123 Prefix:24 Hostname:old-k8s-version-179312 Clientid:01:52:54:00:b2:76:73}
I0814 00:55:56.602946 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has defined IP address 192.168.61.123 and MAC address 52:54:00:b2:76:73 in network mk-old-k8s-version-179312
I0814 00:55:56.603216 57577 profile.go:143] Saving config to /home/jenkins/minikube-integration/19429-9425/.minikube/profiles/old-k8s-version-179312/config.json ...
I0814 00:55:56.603446 57577 start.go:128] duration metric: took 25.067923008s to createHost
I0814 00:55:56.603469 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetSSHHostname
I0814 00:55:56.606135 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has defined MAC address 52:54:00:b2:76:73 in network mk-old-k8s-version-179312
I0814 00:55:56.606541 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b2:76:73", ip: ""} in network mk-old-k8s-version-179312: {Iface:virbr4 ExpiryTime:2024-08-14 01:55:46 +0000 UTC Type:0 Mac:52:54:00:b2:76:73 Iaid: IPaddr:192.168.61.123 Prefix:24 Hostname:old-k8s-version-179312 Clientid:01:52:54:00:b2:76:73}
I0814 00:55:56.606575 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has defined IP address 192.168.61.123 and MAC address 52:54:00:b2:76:73 in network mk-old-k8s-version-179312
I0814 00:55:56.606669 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetSSHPort
I0814 00:55:56.606856 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetSSHKeyPath
I0814 00:55:56.607073 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetSSHKeyPath
I0814 00:55:56.607221 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetSSHUsername
I0814 00:55:56.607482 57577 main.go:141] libmachine: Using SSH client type: native
I0814 00:55:56.607718 57577 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.61.123 22 <nil> <nil>}
I0814 00:55:56.607735 57577 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0814 00:55:56.717478 57577 main.go:141] libmachine: SSH cmd err, output: <nil>: 1723596956.695296662
I0814 00:55:56.717502 57577 fix.go:216] guest clock: 1723596956.695296662
I0814 00:55:56.717510 57577 fix.go:229] Guest: 2024-08-14 00:55:56.695296662 +0000 UTC Remote: 2024-08-14 00:55:56.603459251 +0000 UTC m=+52.940484989 (delta=91.837411ms)
I0814 00:55:56.717527 57577 fix.go:200] guest clock delta is within tolerance: 91.837411ms
I0814 00:55:56.717532 57577 start.go:83] releasing machines lock for "old-k8s-version-179312", held for 25.182181346s
I0814 00:55:56.717549 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .DriverName
I0814 00:55:56.717793 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetIP
I0814 00:55:56.720883 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has defined MAC address 52:54:00:b2:76:73 in network mk-old-k8s-version-179312
I0814 00:55:56.721354 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b2:76:73", ip: ""} in network mk-old-k8s-version-179312: {Iface:virbr4 ExpiryTime:2024-08-14 01:55:46 +0000 UTC Type:0 Mac:52:54:00:b2:76:73 Iaid: IPaddr:192.168.61.123 Prefix:24 Hostname:old-k8s-version-179312 Clientid:01:52:54:00:b2:76:73}
I0814 00:55:56.721387 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has defined IP address 192.168.61.123 and MAC address 52:54:00:b2:76:73 in network mk-old-k8s-version-179312
I0814 00:55:56.721521 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .DriverName
I0814 00:55:56.721967 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .DriverName
I0814 00:55:56.722158 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .DriverName
I0814 00:55:56.722263 57577 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0814 00:55:56.722317 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetSSHHostname
I0814 00:55:56.722334 57577 ssh_runner.go:195] Run: cat /version.json
I0814 00:55:56.722352 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetSSHHostname
I0814 00:55:56.725323 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has defined MAC address 52:54:00:b2:76:73 in network mk-old-k8s-version-179312
I0814 00:55:56.725361 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has defined MAC address 52:54:00:b2:76:73 in network mk-old-k8s-version-179312
I0814 00:55:56.725667 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b2:76:73", ip: ""} in network mk-old-k8s-version-179312: {Iface:virbr4 ExpiryTime:2024-08-14 01:55:46 +0000 UTC Type:0 Mac:52:54:00:b2:76:73 Iaid: IPaddr:192.168.61.123 Prefix:24 Hostname:old-k8s-version-179312 Clientid:01:52:54:00:b2:76:73}
I0814 00:55:56.725699 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b2:76:73", ip: ""} in network mk-old-k8s-version-179312: {Iface:virbr4 ExpiryTime:2024-08-14 01:55:46 +0000 UTC Type:0 Mac:52:54:00:b2:76:73 Iaid: IPaddr:192.168.61.123 Prefix:24 Hostname:old-k8s-version-179312 Clientid:01:52:54:00:b2:76:73}
I0814 00:55:56.725721 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has defined IP address 192.168.61.123 and MAC address 52:54:00:b2:76:73 in network mk-old-k8s-version-179312
I0814 00:55:56.725779 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has defined IP address 192.168.61.123 and MAC address 52:54:00:b2:76:73 in network mk-old-k8s-version-179312
I0814 00:55:56.725870 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetSSHPort
I0814 00:55:56.726065 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetSSHPort
I0814 00:55:56.726092 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetSSHKeyPath
I0814 00:55:56.726243 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetSSHUsername
I0814 00:55:56.726246 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetSSHKeyPath
I0814 00:55:56.726423 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetSSHUsername
I0814 00:55:56.726463 57577 sshutil.go:53] new ssh client: &{IP:192.168.61.123 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19429-9425/.minikube/machines/old-k8s-version-179312/id_rsa Username:docker}
I0814 00:55:56.726585 57577 sshutil.go:53] new ssh client: &{IP:192.168.61.123 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19429-9425/.minikube/machines/old-k8s-version-179312/id_rsa Username:docker}
I0814 00:55:56.838436 57577 ssh_runner.go:195] Run: systemctl --version
I0814 00:55:56.843828 57577 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0814 00:55:56.996037 57577 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0814 00:55:57.002509 57577 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0814 00:55:57.002586 57577 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0814 00:55:57.017414 57577 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0814 00:55:57.017443 57577 start.go:495] detecting cgroup driver to use...
I0814 00:55:57.017522 57577 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0814 00:55:57.032500 57577 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0814 00:55:57.046374 57577 docker.go:217] disabling cri-docker service (if available) ...
I0814 00:55:57.046440 57577 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0814 00:55:57.058995 57577 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0814 00:55:57.071701 57577 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0814 00:55:57.185591 57577 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0814 00:55:57.343302 57577 docker.go:233] disabling docker service ...
I0814 00:55:57.343381 57577 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0814 00:55:57.357425 57577 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0814 00:55:57.369926 57577 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0814 00:55:57.485395 57577 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0814 00:55:57.607834 57577 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0814 00:55:57.620790 57577 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0814 00:55:57.639473 57577 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0814 00:55:57.639530 57577 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0814 00:55:57.650851 57577 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0814 00:55:57.650914 57577 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0814 00:55:57.661713 57577 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0814 00:55:57.672605 57577 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0814 00:55:57.682102 57577 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0814 00:55:57.691827 57577 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0814 00:55:57.701527 57577 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0814 00:55:57.701584 57577 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0814 00:55:57.713529 57577 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0814 00:55:57.723112 57577 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0814 00:55:57.843393 57577 ssh_runner.go:195] Run: sudo systemctl restart crio
I0814 00:55:57.987763 57577 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0814 00:55:57.987852 57577 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0814 00:55:57.992202 57577 start.go:563] Will wait 60s for crictl version
I0814 00:55:57.992252 57577 ssh_runner.go:195] Run: which crictl
I0814 00:55:57.995701 57577 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0814 00:55:58.038377 57577 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0814 00:55:58.038467 57577 ssh_runner.go:195] Run: crio --version
I0814 00:55:58.066373 57577 ssh_runner.go:195] Run: crio --version
I0814 00:55:58.102857 57577 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0814 00:55:58.104332 57577 main.go:141] libmachine: (old-k8s-version-179312) Calling .GetIP
I0814 00:55:58.107565 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has defined MAC address 52:54:00:b2:76:73 in network mk-old-k8s-version-179312
I0814 00:55:58.107935 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b2:76:73", ip: ""} in network mk-old-k8s-version-179312: {Iface:virbr4 ExpiryTime:2024-08-14 01:55:46 +0000 UTC Type:0 Mac:52:54:00:b2:76:73 Iaid: IPaddr:192.168.61.123 Prefix:24 Hostname:old-k8s-version-179312 Clientid:01:52:54:00:b2:76:73}
I0814 00:55:58.107965 57577 main.go:141] libmachine: (old-k8s-version-179312) DBG | domain old-k8s-version-179312 has defined IP address 192.168.61.123 and MAC address 52:54:00:b2:76:73 in network mk-old-k8s-version-179312
I0814 00:55:58.108208 57577 ssh_runner.go:195] Run: grep 192.168.61.1 host.minikube.internal$ /etc/hosts
I0814 00:55:58.112150 57577 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.61.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0814 00:55:58.126570 57577 kubeadm.go:883] updating cluster {Name:old-k8s-version-179312 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19429/minikube-v1.33.1-1723567878-19429-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723567951-19429@sha256:cdfb2e55e95c0c0e857baca4796fc9879d11f99617f48df875a23169fed0e083 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-179312 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.123 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] M
ountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0814 00:55:58.126722 57577 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0814 00:55:58.126792 57577 ssh_runner.go:195] Run: sudo crictl images --output json
I0814 00:55:58.175458 57577 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0814 00:55:58.175519 57577 ssh_runner.go:195] Run: which lz4
I0814 00:55:58.180536 57577 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0814 00:55:58.195215 57577 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0814 00:55:58.195253 57577 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19429-9425/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0814 00:55:59.699725 57577 crio.go:462] duration metric: took 1.519218747s to copy over tarball
I0814 00:55:59.699806 57577 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0814 00:56:02.368801 57577 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.668952163s)
I0814 00:56:02.368863 57577 crio.go:469] duration metric: took 2.669081459s to extract the tarball
I0814 00:56:02.368878 57577 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0814 00:56:02.411828 57577 ssh_runner.go:195] Run: sudo crictl images --output json
I0814 00:56:02.453872 57577 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0814 00:56:02.453892 57577 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0814 00:56:02.453965 57577 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0814 00:56:02.454002 57577 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0814 00:56:02.454089 57577 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0814 00:56:02.454133 57577 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0814 00:56:02.454003 57577 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0814 00:56:02.454092 57577 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0814 00:56:02.454022 57577 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0814 00:56:02.454100 57577 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0814 00:56:02.455443 57577 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0814 00:56:02.455707 57577 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0814 00:56:02.455716 57577 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0814 00:56:02.455729 57577 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0814 00:56:02.455707 57577 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0814 00:56:02.455712 57577 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0814 00:56:02.455765 57577 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0814 00:56:02.455768 57577 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0814 00:56:02.705688 57577 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0814 00:56:02.708466 57577 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0814 00:56:02.737526 57577 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0814 00:56:02.738442 57577 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0814 00:56:02.741480 57577 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0814 00:56:02.747395 57577 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0814 00:56:02.754786 57577 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0814 00:56:02.835638 57577 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0814 00:56:02.835688 57577 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0814 00:56:02.835698 57577 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0814 00:56:02.835730 57577 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0814 00:56:02.835742 57577 ssh_runner.go:195] Run: which crictl
I0814 00:56:02.835771 57577 ssh_runner.go:195] Run: which crictl
I0814 00:56:02.869410 57577 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0814 00:56:02.869475 57577 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0814 00:56:02.869541 57577 ssh_runner.go:195] Run: which crictl
I0814 00:56:02.876483 57577 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0814 00:56:02.876519 57577 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0814 00:56:02.876558 57577 ssh_runner.go:195] Run: which crictl
I0814 00:56:02.880498 57577 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0814 00:56:02.880530 57577 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0814 00:56:02.880573 57577 ssh_runner.go:195] Run: which crictl
I0814 00:56:02.880627 57577 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0814 00:56:02.880657 57577 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0814 00:56:02.880696 57577 ssh_runner.go:195] Run: which crictl
I0814 00:56:02.890776 57577 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0814 00:56:02.890805 57577 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0814 00:56:02.890830 57577 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0814 00:56:02.890872 57577 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0814 00:56:02.890896 57577 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0814 00:56:02.890912 57577 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0814 00:56:02.890834 57577 ssh_runner.go:195] Run: which crictl
I0814 00:56:02.890951 57577 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0814 00:56:02.890972 57577 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0814 00:56:03.014624 57577 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0814 00:56:03.014687 57577 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0814 00:56:03.014716 57577 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0814 00:56:03.014736 57577 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0814 00:56:03.014749 57577 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0814 00:56:03.014819 57577 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0814 00:56:03.014824 57577 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0814 00:56:03.145922 57577 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0814 00:56:03.176030 57577 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0814 00:56:03.176078 57577 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0814 00:56:03.176090 57577 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0814 00:56:03.176082 57577 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0814 00:56:03.176171 57577 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0814 00:56:03.176242 57577 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0814 00:56:03.241951 57577 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0814 00:56:03.315946 57577 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19429-9425/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0814 00:56:03.328366 57577 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19429-9425/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0814 00:56:03.328402 57577 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19429-9425/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0814 00:56:03.329654 57577 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19429-9425/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0814 00:56:03.329704 57577 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19429-9425/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0814 00:56:03.329726 57577 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19429-9425/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0814 00:56:03.351904 57577 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19429-9425/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0814 00:56:03.356472 57577 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0814 00:56:03.493524 57577 cache_images.go:92] duration metric: took 1.039613467s to LoadCachedImages
W0814 00:56:03.493603 57577 out.go:239] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19429-9425/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19429-9425/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0: no such file or directory
I0814 00:56:03.493616 57577 kubeadm.go:934] updating node { 192.168.61.123 8443 v1.20.0 crio true true} ...
I0814 00:56:03.493756 57577 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-179312 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.61.123
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-179312 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0814 00:56:03.493843 57577 ssh_runner.go:195] Run: crio config
I0814 00:56:03.539755 57577 cni.go:84] Creating CNI manager for ""
I0814 00:56:03.539774 57577 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0814 00:56:03.539782 57577 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0814 00:56:03.539801 57577 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.61.123 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-179312 NodeName:old-k8s-version-179312 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.61.123"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.61.123 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0814 00:56:03.539924 57577 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.61.123
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-179312"
kubeletExtraArgs:
node-ip: 192.168.61.123
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.61.123"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0814 00:56:03.539988 57577 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0814 00:56:03.549861 57577 binaries.go:44] Found k8s binaries, skipping transfer
I0814 00:56:03.549918 57577 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0814 00:56:03.559393 57577 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0814 00:56:03.577657 57577 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0814 00:56:03.594580 57577 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0814 00:56:03.610515 57577 ssh_runner.go:195] Run: grep 192.168.61.123 control-plane.minikube.internal$ /etc/hosts
I0814 00:56:03.614081 57577 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.61.123 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0814 00:56:03.626718 57577 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0814 00:56:03.761957 57577 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0814 00:56:03.781473 57577 certs.go:68] Setting up /home/jenkins/minikube-integration/19429-9425/.minikube/profiles/old-k8s-version-179312 for IP: 192.168.61.123
I0814 00:56:03.781496 57577 certs.go:194] generating shared ca certs ...
I0814 00:56:03.781515 57577 certs.go:226] acquiring lock for ca certs: {Name:mke321171338291cf6d66f3acbfe43d3fabcafa0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0814 00:56:03.781687 57577 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19429-9425/.minikube/ca.key
I0814 00:56:03.781748 57577 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19429-9425/.minikube/proxy-client-ca.key
I0814 00:56:03.781763 57577 certs.go:256] generating profile certs ...
I0814 00:56:03.781890 57577 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19429-9425/.minikube/profiles/old-k8s-version-179312/client.key
I0814 00:56:03.781913 57577 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19429-9425/.minikube/profiles/old-k8s-version-179312/client.crt with IP's: []
I0814 00:56:03.980926 57577 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19429-9425/.minikube/profiles/old-k8s-version-179312/client.crt ...
I0814 00:56:03.980958 57577 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19429-9425/.minikube/profiles/old-k8s-version-179312/client.crt: {Name:mkb74cb566ecc9c5a569a38c531bfcb7e2fa270c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0814 00:56:03.981164 57577 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19429-9425/.minikube/profiles/old-k8s-version-179312/client.key ...
I0814 00:56:03.981183 57577 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19429-9425/.minikube/profiles/old-k8s-version-179312/client.key: {Name:mke071999fcc1c986a35541dcdbecbdb3f0a3c8a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0814 00:56:03.981308 57577 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19429-9425/.minikube/profiles/old-k8s-version-179312/apiserver.key.6e56bf34
I0814 00:56:03.981339 57577 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19429-9425/.minikube/profiles/old-k8s-version-179312/apiserver.crt.6e56bf34 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.61.123]
I0814 00:56:04.228446 57577 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19429-9425/.minikube/profiles/old-k8s-version-179312/apiserver.crt.6e56bf34 ...
I0814 00:56:04.228477 57577 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19429-9425/.minikube/profiles/old-k8s-version-179312/apiserver.crt.6e56bf34: {Name:mk9d5f4661ffb9b248aad154ae065abe7d7ae6e9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0814 00:56:04.281040 57577 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19429-9425/.minikube/profiles/old-k8s-version-179312/apiserver.key.6e56bf34 ...
I0814 00:56:04.281093 57577 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19429-9425/.minikube/profiles/old-k8s-version-179312/apiserver.key.6e56bf34: {Name:mkce44877a313ffbc0e24a02a648d05ef5ad3c8e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0814 00:56:04.281222 57577 certs.go:381] copying /home/jenkins/minikube-integration/19429-9425/.minikube/profiles/old-k8s-version-179312/apiserver.crt.6e56bf34 -> /home/jenkins/minikube-integration/19429-9425/.minikube/profiles/old-k8s-version-179312/apiserver.crt
I0814 00:56:04.281306 57577 certs.go:385] copying /home/jenkins/minikube-integration/19429-9425/.minikube/profiles/old-k8s-version-179312/apiserver.key.6e56bf34 -> /home/jenkins/minikube-integration/19429-9425/.minikube/profiles/old-k8s-version-179312/apiserver.key
I0814 00:56:04.281365 57577 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19429-9425/.minikube/profiles/old-k8s-version-179312/proxy-client.key
I0814 00:56:04.281382 57577 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19429-9425/.minikube/profiles/old-k8s-version-179312/proxy-client.crt with IP's: []
I0814 00:56:04.481463 57577 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19429-9425/.minikube/profiles/old-k8s-version-179312/proxy-client.crt ...
I0814 00:56:04.481502 57577 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19429-9425/.minikube/profiles/old-k8s-version-179312/proxy-client.crt: {Name:mk0a3985392c4b3f9d2dcdb4e600c734b7fbf930 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0814 00:56:04.481712 57577 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19429-9425/.minikube/profiles/old-k8s-version-179312/proxy-client.key ...
I0814 00:56:04.481735 57577 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19429-9425/.minikube/profiles/old-k8s-version-179312/proxy-client.key: {Name:mk6b865d796e5fb66f46f951273d8956076ed788 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0814 00:56:04.481946 57577 certs.go:484] found cert: /home/jenkins/minikube-integration/19429-9425/.minikube/certs/16589.pem (1338 bytes)
W0814 00:56:04.482001 57577 certs.go:480] ignoring /home/jenkins/minikube-integration/19429-9425/.minikube/certs/16589_empty.pem, impossibly tiny 0 bytes
I0814 00:56:04.482019 57577 certs.go:484] found cert: /home/jenkins/minikube-integration/19429-9425/.minikube/certs/ca-key.pem (1679 bytes)
I0814 00:56:04.482099 57577 certs.go:484] found cert: /home/jenkins/minikube-integration/19429-9425/.minikube/certs/ca.pem (1082 bytes)
I0814 00:56:04.482146 57577 certs.go:484] found cert: /home/jenkins/minikube-integration/19429-9425/.minikube/certs/cert.pem (1123 bytes)
I0814 00:56:04.482185 57577 certs.go:484] found cert: /home/jenkins/minikube-integration/19429-9425/.minikube/certs/key.pem (1675 bytes)
I0814 00:56:04.482250 57577 certs.go:484] found cert: /home/jenkins/minikube-integration/19429-9425/.minikube/files/etc/ssl/certs/165892.pem (1708 bytes)
I0814 00:56:04.482832 57577 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19429-9425/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0814 00:56:04.509702 57577 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19429-9425/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0814 00:56:04.531888 57577 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19429-9425/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0814 00:56:04.554315 57577 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19429-9425/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0814 00:56:04.579852 57577 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19429-9425/.minikube/profiles/old-k8s-version-179312/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0814 00:56:04.609152 57577 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19429-9425/.minikube/profiles/old-k8s-version-179312/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0814 00:56:04.640436 57577 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19429-9425/.minikube/profiles/old-k8s-version-179312/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0814 00:56:04.671647 57577 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19429-9425/.minikube/profiles/old-k8s-version-179312/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0814 00:56:04.694331 57577 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19429-9425/.minikube/files/etc/ssl/certs/165892.pem --> /usr/share/ca-certificates/165892.pem (1708 bytes)
I0814 00:56:04.718512 57577 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19429-9425/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0814 00:56:04.740020 57577 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19429-9425/.minikube/certs/16589.pem --> /usr/share/ca-certificates/16589.pem (1338 bytes)
I0814 00:56:04.761453 57577 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0814 00:56:04.776988 57577 ssh_runner.go:195] Run: openssl version
I0814 00:56:04.782382 57577 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/16589.pem && ln -fs /usr/share/ca-certificates/16589.pem /etc/ssl/certs/16589.pem"
I0814 00:56:04.793108 57577 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/16589.pem
I0814 00:56:04.797164 57577 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug 13 23:59 /usr/share/ca-certificates/16589.pem
I0814 00:56:04.797233 57577 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/16589.pem
I0814 00:56:04.802709 57577 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/16589.pem /etc/ssl/certs/51391683.0"
I0814 00:56:04.813098 57577 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/165892.pem && ln -fs /usr/share/ca-certificates/165892.pem /etc/ssl/certs/165892.pem"
I0814 00:56:04.823181 57577 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/165892.pem
I0814 00:56:04.827389 57577 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug 13 23:59 /usr/share/ca-certificates/165892.pem
I0814 00:56:04.827443 57577 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/165892.pem
I0814 00:56:04.832628 57577 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/165892.pem /etc/ssl/certs/3ec20f2e.0"
I0814 00:56:04.842021 57577 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0814 00:56:04.851273 57577 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0814 00:56:04.855213 57577 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug 13 23:48 /usr/share/ca-certificates/minikubeCA.pem
I0814 00:56:04.855261 57577 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0814 00:56:04.860326 57577 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0814 00:56:04.869613 57577 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0814 00:56:04.873244 57577 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0814 00:56:04.873294 57577 kubeadm.go:392] StartCluster: {Name:old-k8s-version-179312 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19429/minikube-v1.33.1-1723567878-19429-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723567951-19429@sha256:cdfb2e55e95c0c0e857baca4796fc9879d11f99617f48df875a23169fed0e083 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-179312 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.123 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0814 00:56:04.873380 57577 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0814 00:56:04.873450 57577 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0814 00:56:04.912777 57577 cri.go:89] found id: ""
I0814 00:56:04.912843 57577 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0814 00:56:04.922011 57577 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0814 00:56:04.930898 57577 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0814 00:56:04.940059 57577 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0814 00:56:04.940084 57577 kubeadm.go:157] found existing configuration files:
I0814 00:56:04.940135 57577 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0814 00:56:04.948755 57577 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0814 00:56:04.948809 57577 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0814 00:56:04.957463 57577 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0814 00:56:04.966129 57577 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0814 00:56:04.966184 57577 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0814 00:56:04.974945 57577 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0814 00:56:04.983517 57577 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0814 00:56:04.983564 57577 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0814 00:56:04.992421 57577 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0814 00:56:05.000852 57577 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0814 00:56:05.000889 57577 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0814 00:56:05.009622 57577 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0814 00:56:05.127686 57577 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0814 00:56:05.127793 57577 kubeadm.go:310] [preflight] Running pre-flight checks
I0814 00:56:05.275570 57577 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0814 00:56:05.275740 57577 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0814 00:56:05.275879 57577 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0814 00:56:05.490496 57577 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0814 00:56:05.576702 57577 out.go:204] - Generating certificates and keys ...
I0814 00:56:05.576822 57577 kubeadm.go:310] [certs] Using existing ca certificate authority
I0814 00:56:05.576887 57577 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0814 00:56:05.594238 57577 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0814 00:56:05.772117 57577 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0814 00:56:06.143054 57577 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0814 00:56:06.312207 57577 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0814 00:56:06.512526 57577 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0814 00:56:06.512805 57577 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-179312] and IPs [192.168.61.123 127.0.0.1 ::1]
I0814 00:56:06.983098 57577 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0814 00:56:06.983245 57577 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-179312] and IPs [192.168.61.123 127.0.0.1 ::1]
I0814 00:56:07.077941 57577 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0814 00:56:07.202800 57577 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0814 00:56:07.506636 57577 kubeadm.go:310] [certs] Generating "sa" key and public key
I0814 00:56:07.506796 57577 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0814 00:56:07.686723 57577 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0814 00:56:07.854134 57577 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0814 00:56:07.917438 57577 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0814 00:56:08.037255 57577 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0814 00:56:08.056640 57577 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0814 00:56:08.058849 57577 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0814 00:56:08.058904 57577 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0814 00:56:08.178154 57577 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0814 00:56:08.180608 57577 out.go:204] - Booting up control plane ...
I0814 00:56:08.180714 57577 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0814 00:56:08.184958 57577 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0814 00:56:08.185903 57577 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0814 00:56:08.186784 57577 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0814 00:56:08.190837 57577 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0814 00:56:48.186493 57577 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0814 00:56:48.187251 57577 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0814 00:56:48.187481 57577 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0814 00:56:53.187782 57577 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0814 00:56:53.188006 57577 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0814 00:57:03.187342 57577 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0814 00:57:03.187609 57577 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0814 00:57:23.187031 57577 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0814 00:57:23.187318 57577 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0814 00:58:03.189250 57577 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0814 00:58:03.189533 57577 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0814 00:58:03.189566 57577 kubeadm.go:310]
I0814 00:58:03.189638 57577 kubeadm.go:310] Unfortunately, an error has occurred:
I0814 00:58:03.189697 57577 kubeadm.go:310] timed out waiting for the condition
I0814 00:58:03.189749 57577 kubeadm.go:310]
I0814 00:58:03.189827 57577 kubeadm.go:310] This error is likely caused by:
I0814 00:58:03.189885 57577 kubeadm.go:310] - The kubelet is not running
I0814 00:58:03.190099 57577 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0814 00:58:03.190115 57577 kubeadm.go:310]
I0814 00:58:03.190263 57577 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0814 00:58:03.190319 57577 kubeadm.go:310] - 'systemctl status kubelet'
I0814 00:58:03.190366 57577 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0814 00:58:03.190378 57577 kubeadm.go:310]
I0814 00:58:03.190524 57577 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0814 00:58:03.190643 57577 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0814 00:58:03.190653 57577 kubeadm.go:310]
I0814 00:58:03.190782 57577 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0814 00:58:03.190904 57577 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0814 00:58:03.191010 57577 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0814 00:58:03.191116 57577 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0814 00:58:03.191127 57577 kubeadm.go:310]
I0814 00:58:03.191570 57577 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0814 00:58:03.191700 57577 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0814 00:58:03.191813 57577 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
W0814 00:58:03.191991 57577 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-179312] and IPs [192.168.61.123 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-179312] and IPs [192.168.61.123 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-179312] and IPs [192.168.61.123 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-179312] and IPs [192.168.61.123 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0814 00:58:03.192047 57577 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0814 00:58:03.960822 57577 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0814 00:58:03.976854 57577 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0814 00:58:03.987718 57577 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0814 00:58:03.987744 57577 kubeadm.go:157] found existing configuration files:
I0814 00:58:03.987794 57577 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0814 00:58:03.998176 57577 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0814 00:58:03.998245 57577 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0814 00:58:04.010827 57577 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0814 00:58:04.022352 57577 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0814 00:58:04.022423 57577 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0814 00:58:04.034666 57577 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0814 00:58:04.046541 57577 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0814 00:58:04.046610 57577 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0814 00:58:04.057194 57577 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0814 00:58:04.067151 57577 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0814 00:58:04.067217 57577 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0814 00:58:04.077412 57577 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0814 00:58:04.153080 57577 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0814 00:58:04.153168 57577 kubeadm.go:310] [preflight] Running pre-flight checks
I0814 00:58:04.312272 57577 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0814 00:58:04.312539 57577 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0814 00:58:04.312788 57577 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0814 00:58:04.497766 57577 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0814 00:58:04.499743 57577 out.go:204] - Generating certificates and keys ...
I0814 00:58:04.499855 57577 kubeadm.go:310] [certs] Using existing ca certificate authority
I0814 00:58:04.499948 57577 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0814 00:58:04.500084 57577 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0814 00:58:04.500184 57577 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0814 00:58:04.500293 57577 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0814 00:58:04.500392 57577 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0814 00:58:04.500674 57577 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0814 00:58:04.501025 57577 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0814 00:58:04.501791 57577 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0814 00:58:04.502600 57577 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0814 00:58:04.502832 57577 kubeadm.go:310] [certs] Using the existing "sa" key
I0814 00:58:04.502906 57577 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0814 00:58:04.685205 57577 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0814 00:58:04.767607 57577 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0814 00:58:04.832792 57577 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0814 00:58:05.036223 57577 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0814 00:58:05.050133 57577 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0814 00:58:05.051115 57577 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0814 00:58:05.051212 57577 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0814 00:58:05.199026 57577 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0814 00:58:05.201019 57577 out.go:204] - Booting up control plane ...
I0814 00:58:05.201157 57577 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0814 00:58:05.210618 57577 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0814 00:58:05.211495 57577 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0814 00:58:05.212262 57577 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0814 00:58:05.214749 57577 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0814 00:58:45.218150 57577 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0814 00:58:45.218693 57577 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0814 00:58:45.218966 57577 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0814 00:58:50.219586 57577 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0814 00:58:50.219811 57577 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0814 00:59:00.220396 57577 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0814 00:59:00.220552 57577 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0814 00:59:20.219468 57577 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0814 00:59:20.219700 57577 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0814 01:00:00.219514 57577 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0814 01:00:00.219757 57577 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0814 01:00:00.219773 57577 kubeadm.go:310]
I0814 01:00:00.219843 57577 kubeadm.go:310] Unfortunately, an error has occurred:
I0814 01:00:00.219900 57577 kubeadm.go:310] timed out waiting for the condition
I0814 01:00:00.219910 57577 kubeadm.go:310]
I0814 01:00:00.219962 57577 kubeadm.go:310] This error is likely caused by:
I0814 01:00:00.220021 57577 kubeadm.go:310] - The kubelet is not running
I0814 01:00:00.220188 57577 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0814 01:00:00.220208 57577 kubeadm.go:310]
I0814 01:00:00.220349 57577 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0814 01:00:00.220408 57577 kubeadm.go:310] - 'systemctl status kubelet'
I0814 01:00:00.220454 57577 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0814 01:00:00.220463 57577 kubeadm.go:310]
I0814 01:00:00.220575 57577 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0814 01:00:00.220696 57577 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0814 01:00:00.220716 57577 kubeadm.go:310]
I0814 01:00:00.220836 57577 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0814 01:00:00.220949 57577 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0814 01:00:00.221060 57577 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0814 01:00:00.221172 57577 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0814 01:00:00.221189 57577 kubeadm.go:310]
I0814 01:00:00.221470 57577 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0814 01:00:00.221628 57577 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0814 01:00:00.221737 57577 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0814 01:00:00.221801 57577 kubeadm.go:394] duration metric: took 3m55.348510296s to StartCluster
I0814 01:00:00.221837 57577 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0814 01:00:00.221889 57577 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0814 01:00:00.260461 57577 cri.go:89] found id: ""
I0814 01:00:00.260483 57577 logs.go:276] 0 containers: []
W0814 01:00:00.260491 57577 logs.go:278] No container was found matching "kube-apiserver"
I0814 01:00:00.260496 57577 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0814 01:00:00.260544 57577 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0814 01:00:00.291841 57577 cri.go:89] found id: ""
I0814 01:00:00.291871 57577 logs.go:276] 0 containers: []
W0814 01:00:00.291882 57577 logs.go:278] No container was found matching "etcd"
I0814 01:00:00.291890 57577 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0814 01:00:00.291948 57577 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0814 01:00:00.322413 57577 cri.go:89] found id: ""
I0814 01:00:00.322440 57577 logs.go:276] 0 containers: []
W0814 01:00:00.322447 57577 logs.go:278] No container was found matching "coredns"
I0814 01:00:00.322453 57577 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0814 01:00:00.322508 57577 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0814 01:00:00.352283 57577 cri.go:89] found id: ""
I0814 01:00:00.352332 57577 logs.go:276] 0 containers: []
W0814 01:00:00.352343 57577 logs.go:278] No container was found matching "kube-scheduler"
I0814 01:00:00.352351 57577 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0814 01:00:00.352421 57577 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0814 01:00:00.382747 57577 cri.go:89] found id: ""
I0814 01:00:00.382774 57577 logs.go:276] 0 containers: []
W0814 01:00:00.382785 57577 logs.go:278] No container was found matching "kube-proxy"
I0814 01:00:00.382792 57577 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0814 01:00:00.382838 57577 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0814 01:00:00.414134 57577 cri.go:89] found id: ""
I0814 01:00:00.414160 57577 logs.go:276] 0 containers: []
W0814 01:00:00.414172 57577 logs.go:278] No container was found matching "kube-controller-manager"
I0814 01:00:00.414181 57577 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0814 01:00:00.414244 57577 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0814 01:00:00.446494 57577 cri.go:89] found id: ""
I0814 01:00:00.446524 57577 logs.go:276] 0 containers: []
W0814 01:00:00.446534 57577 logs.go:278] No container was found matching "kindnet"
I0814 01:00:00.446546 57577 logs.go:123] Gathering logs for container status ...
I0814 01:00:00.446576 57577 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0814 01:00:00.481428 57577 logs.go:123] Gathering logs for kubelet ...
I0814 01:00:00.481457 57577 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0814 01:00:00.532708 57577 logs.go:123] Gathering logs for dmesg ...
I0814 01:00:00.532742 57577 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0814 01:00:00.546279 57577 logs.go:123] Gathering logs for describe nodes ...
I0814 01:00:00.546311 57577 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0814 01:00:00.656441 57577 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0814 01:00:00.656469 57577 logs.go:123] Gathering logs for CRI-O ...
I0814 01:00:00.656484 57577 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
W0814 01:00:00.762261 57577 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0814 01:00:00.762311 57577 out.go:239] *
*
W0814 01:00:00.762367 57577 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0814 01:00:00.762390 57577 out.go:239] *
*
W0814 01:00:00.763142 57577 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0814 01:00:00.766206 57577 out.go:177]
W0814 01:00:00.767331 57577 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0814 01:00:00.767388 57577 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0814 01:00:00.767409 57577 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0814 01:00:00.768868 57577 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-179312 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-179312 -n old-k8s-version-179312
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-179312 -n old-k8s-version-179312: exit status 6 (222.863707ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0814 01:00:01.039276 60760 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-179312" does not appear in /home/jenkins/minikube-integration/19429-9425/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-179312" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (297.40s)