=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-505584 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-505584 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m49.307749222s)
-- stdout --
* [old-k8s-version-505584] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=19446
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19446-13977/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19446-13977/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-505584" primary control-plane node in "old-k8s-version-505584" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0814 17:27:01.372592 72662 out.go:291] Setting OutFile to fd 1 ...
I0814 17:27:01.373175 72662 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0814 17:27:01.373230 72662 out.go:304] Setting ErrFile to fd 2...
I0814 17:27:01.373254 72662 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0814 17:27:01.374024 72662 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19446-13977/.minikube/bin
I0814 17:27:01.374880 72662 out.go:298] Setting JSON to false
I0814 17:27:01.376543 72662 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":7765,"bootTime":1723648656,"procs":300,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1066-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0814 17:27:01.376656 72662 start.go:139] virtualization: kvm guest
I0814 17:27:01.378984 72662 out.go:177] * [old-k8s-version-505584] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
I0814 17:27:01.380358 72662 notify.go:220] Checking for updates...
I0814 17:27:01.380419 72662 out.go:177] - MINIKUBE_LOCATION=19446
I0814 17:27:01.381769 72662 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0814 17:27:01.383059 72662 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19446-13977/kubeconfig
I0814 17:27:01.384238 72662 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19446-13977/.minikube
I0814 17:27:01.385528 72662 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0814 17:27:01.386887 72662 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0814 17:27:01.388699 72662 config.go:182] Loaded profile config "bridge-984053": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.0
I0814 17:27:01.388876 72662 config.go:182] Loaded profile config "calico-984053": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.0
I0814 17:27:01.389000 72662 config.go:182] Loaded profile config "enable-default-cni-984053": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.0
I0814 17:27:01.389137 72662 driver.go:392] Setting default libvirt URI to qemu:///system
I0814 17:27:01.429422 72662 out.go:177] * Using the kvm2 driver based on user configuration
I0814 17:27:01.430793 72662 start.go:297] selected driver: kvm2
I0814 17:27:01.430817 72662 start.go:901] validating driver "kvm2" against <nil>
I0814 17:27:01.430835 72662 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0814 17:27:01.432034 72662 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0814 17:27:01.432169 72662 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19446-13977/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0814 17:27:01.448763 72662 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.1
I0814 17:27:01.448811 72662 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0814 17:27:01.449044 72662 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0814 17:27:01.449119 72662 cni.go:84] Creating CNI manager for ""
I0814 17:27:01.449136 72662 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0814 17:27:01.449149 72662 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0814 17:27:01.449210 72662 start.go:340] cluster config:
{Name:old-k8s-version-505584 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723567951-19429@sha256:cdfb2e55e95c0c0e857baca4796fc9879d11f99617f48df875a23169fed0e083 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-505584 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0814 17:27:01.449326 72662 iso.go:125] acquiring lock: {Name:mk2e55322134d769b164591a68a4ad117a673f97 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0814 17:27:01.451833 72662 out.go:177] * Starting "old-k8s-version-505584" primary control-plane node in "old-k8s-version-505584" cluster
I0814 17:27:01.453140 72662 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0814 17:27:01.453188 72662 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19446-13977/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0814 17:27:01.453197 72662 cache.go:56] Caching tarball of preloaded images
I0814 17:27:01.453295 72662 preload.go:172] Found /home/jenkins/minikube-integration/19446-13977/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0814 17:27:01.453314 72662 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0814 17:27:01.453436 72662 profile.go:143] Saving config to /home/jenkins/minikube-integration/19446-13977/.minikube/profiles/old-k8s-version-505584/config.json ...
I0814 17:27:01.453465 72662 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19446-13977/.minikube/profiles/old-k8s-version-505584/config.json: {Name:mk5825df71623402e58f07d15d62cbfb0fe0c43c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0814 17:27:01.453638 72662 start.go:360] acquireMachinesLock for old-k8s-version-505584: {Name:mk61618450f33ce76e4843d7a1f08ede28bf5692 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0814 17:27:18.267773 72662 start.go:364] duration metric: took 16.814098845s to acquireMachinesLock for "old-k8s-version-505584"
I0814 17:27:18.267851 72662 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-505584 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19429/minikube-v1.33.1-1723567878-19429-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723567951-19429@sha256:cdfb2e55e95c0c0e857baca4796fc9879d11f99617f48df875a23169fed0e083 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-505584 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0814 17:27:18.267958 72662 start.go:125] createHost starting for "" (driver="kvm2")
I0814 17:27:18.269923 72662 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0814 17:27:18.270145 72662 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0814 17:27:18.270197 72662 main.go:141] libmachine: Launching plugin server for driver kvm2
I0814 17:27:18.291442 72662 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39481
I0814 17:27:18.292004 72662 main.go:141] libmachine: () Calling .GetVersion
I0814 17:27:18.292667 72662 main.go:141] libmachine: Using API Version 1
I0814 17:27:18.292699 72662 main.go:141] libmachine: () Calling .SetConfigRaw
I0814 17:27:18.293083 72662 main.go:141] libmachine: () Calling .GetMachineName
I0814 17:27:18.293296 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetMachineName
I0814 17:27:18.293452 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .DriverName
I0814 17:27:18.293650 72662 start.go:159] libmachine.API.Create for "old-k8s-version-505584" (driver="kvm2")
I0814 17:27:18.293694 72662 client.go:168] LocalClient.Create starting
I0814 17:27:18.293740 72662 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19446-13977/.minikube/certs/ca.pem
I0814 17:27:18.293788 72662 main.go:141] libmachine: Decoding PEM data...
I0814 17:27:18.293814 72662 main.go:141] libmachine: Parsing certificate...
I0814 17:27:18.293882 72662 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19446-13977/.minikube/certs/cert.pem
I0814 17:27:18.293910 72662 main.go:141] libmachine: Decoding PEM data...
I0814 17:27:18.293929 72662 main.go:141] libmachine: Parsing certificate...
I0814 17:27:18.293958 72662 main.go:141] libmachine: Running pre-create checks...
I0814 17:27:18.293970 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .PreCreateCheck
I0814 17:27:18.294372 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetConfigRaw
I0814 17:27:18.294870 72662 main.go:141] libmachine: Creating machine...
I0814 17:27:18.294889 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .Create
I0814 17:27:18.295038 72662 main.go:141] libmachine: (old-k8s-version-505584) Creating KVM machine...
I0814 17:27:18.296558 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | found existing default KVM network
I0814 17:27:18.298135 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | I0814 17:27:18.297967 72820 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:38:ba:c5} reservation:<nil>}
I0814 17:27:18.299158 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | I0814 17:27:18.299072 72820 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr3 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:15:0b:d2} reservation:<nil>}
I0814 17:27:18.299994 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | I0814 17:27:18.299904 72820 network.go:211] skipping subnet 192.168.61.0/24 that is taken: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.61.1 IfaceMTU:1500 IfaceMAC:52:54:00:9d:42:61} reservation:<nil>}
I0814 17:27:18.301100 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | I0814 17:27:18.301033 72820 network.go:206] using free private subnet 192.168.72.0/24: &{IP:192.168.72.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.72.0/24 Gateway:192.168.72.1 ClientMin:192.168.72.2 ClientMax:192.168.72.254 Broadcast:192.168.72.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000289aa0}
I0814 17:27:18.301173 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | created network xml:
I0814 17:27:18.301196 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | <network>
I0814 17:27:18.301211 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | <name>mk-old-k8s-version-505584</name>
I0814 17:27:18.301225 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | <dns enable='no'/>
I0814 17:27:18.301252 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG |
I0814 17:27:18.301276 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | <ip address='192.168.72.1' netmask='255.255.255.0'>
I0814 17:27:18.301300 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | <dhcp>
I0814 17:27:18.301310 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | <range start='192.168.72.2' end='192.168.72.253'/>
I0814 17:27:18.301320 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | </dhcp>
I0814 17:27:18.301333 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | </ip>
I0814 17:27:18.301347 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG |
I0814 17:27:18.301358 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | </network>
I0814 17:27:18.301373 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG |
I0814 17:27:18.306478 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | trying to create private KVM network mk-old-k8s-version-505584 192.168.72.0/24...
I0814 17:27:18.387745 72662 main.go:141] libmachine: (old-k8s-version-505584) Setting up store path in /home/jenkins/minikube-integration/19446-13977/.minikube/machines/old-k8s-version-505584 ...
I0814 17:27:18.387782 72662 main.go:141] libmachine: (old-k8s-version-505584) Building disk image from file:///home/jenkins/minikube-integration/19446-13977/.minikube/cache/iso/amd64/minikube-v1.33.1-1723567878-19429-amd64.iso
I0814 17:27:18.387792 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | private KVM network mk-old-k8s-version-505584 192.168.72.0/24 created
I0814 17:27:18.387809 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | I0814 17:27:18.387563 72820 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19446-13977/.minikube
I0814 17:27:18.387828 72662 main.go:141] libmachine: (old-k8s-version-505584) Downloading /home/jenkins/minikube-integration/19446-13977/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19446-13977/.minikube/cache/iso/amd64/minikube-v1.33.1-1723567878-19429-amd64.iso...
I0814 17:27:18.656802 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | I0814 17:27:18.656683 72820 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19446-13977/.minikube/machines/old-k8s-version-505584/id_rsa...
I0814 17:27:18.963742 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | I0814 17:27:18.963604 72820 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19446-13977/.minikube/machines/old-k8s-version-505584/old-k8s-version-505584.rawdisk...
I0814 17:27:18.963777 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | Writing magic tar header
I0814 17:27:18.963798 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | Writing SSH key tar header
I0814 17:27:18.963810 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | I0814 17:27:18.963779 72820 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19446-13977/.minikube/machines/old-k8s-version-505584 ...
I0814 17:27:18.963983 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19446-13977/.minikube/machines/old-k8s-version-505584
I0814 17:27:18.964052 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19446-13977/.minikube/machines
I0814 17:27:18.964080 72662 main.go:141] libmachine: (old-k8s-version-505584) Setting executable bit set on /home/jenkins/minikube-integration/19446-13977/.minikube/machines/old-k8s-version-505584 (perms=drwx------)
I0814 17:27:18.964106 72662 main.go:141] libmachine: (old-k8s-version-505584) Setting executable bit set on /home/jenkins/minikube-integration/19446-13977/.minikube/machines (perms=drwxr-xr-x)
I0814 17:27:18.964116 72662 main.go:141] libmachine: (old-k8s-version-505584) Setting executable bit set on /home/jenkins/minikube-integration/19446-13977/.minikube (perms=drwxr-xr-x)
I0814 17:27:18.964135 72662 main.go:141] libmachine: (old-k8s-version-505584) Setting executable bit set on /home/jenkins/minikube-integration/19446-13977 (perms=drwxrwxr-x)
I0814 17:27:18.964149 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19446-13977/.minikube
I0814 17:27:18.964160 72662 main.go:141] libmachine: (old-k8s-version-505584) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0814 17:27:18.964174 72662 main.go:141] libmachine: (old-k8s-version-505584) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0814 17:27:18.964183 72662 main.go:141] libmachine: (old-k8s-version-505584) Creating domain...
I0814 17:27:18.964199 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19446-13977
I0814 17:27:18.964210 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0814 17:27:18.964220 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | Checking permissions on dir: /home/jenkins
I0814 17:27:18.964229 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | Checking permissions on dir: /home
I0814 17:27:18.964240 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | Skipping /home - not owner
I0814 17:27:18.965286 72662 main.go:141] libmachine: (old-k8s-version-505584) define libvirt domain using xml:
I0814 17:27:18.965310 72662 main.go:141] libmachine: (old-k8s-version-505584) <domain type='kvm'>
I0814 17:27:18.965320 72662 main.go:141] libmachine: (old-k8s-version-505584) <name>old-k8s-version-505584</name>
I0814 17:27:18.965327 72662 main.go:141] libmachine: (old-k8s-version-505584) <memory unit='MiB'>2200</memory>
I0814 17:27:18.965336 72662 main.go:141] libmachine: (old-k8s-version-505584) <vcpu>2</vcpu>
I0814 17:27:18.965347 72662 main.go:141] libmachine: (old-k8s-version-505584) <features>
I0814 17:27:18.965362 72662 main.go:141] libmachine: (old-k8s-version-505584) <acpi/>
I0814 17:27:18.965373 72662 main.go:141] libmachine: (old-k8s-version-505584) <apic/>
I0814 17:27:18.965381 72662 main.go:141] libmachine: (old-k8s-version-505584) <pae/>
I0814 17:27:18.965389 72662 main.go:141] libmachine: (old-k8s-version-505584)
I0814 17:27:18.965407 72662 main.go:141] libmachine: (old-k8s-version-505584) </features>
I0814 17:27:18.965421 72662 main.go:141] libmachine: (old-k8s-version-505584) <cpu mode='host-passthrough'>
I0814 17:27:18.965444 72662 main.go:141] libmachine: (old-k8s-version-505584)
I0814 17:27:18.965455 72662 main.go:141] libmachine: (old-k8s-version-505584) </cpu>
I0814 17:27:18.965464 72662 main.go:141] libmachine: (old-k8s-version-505584) <os>
I0814 17:27:18.965475 72662 main.go:141] libmachine: (old-k8s-version-505584) <type>hvm</type>
I0814 17:27:18.965486 72662 main.go:141] libmachine: (old-k8s-version-505584) <boot dev='cdrom'/>
I0814 17:27:18.965496 72662 main.go:141] libmachine: (old-k8s-version-505584) <boot dev='hd'/>
I0814 17:27:18.965505 72662 main.go:141] libmachine: (old-k8s-version-505584) <bootmenu enable='no'/>
I0814 17:27:18.965515 72662 main.go:141] libmachine: (old-k8s-version-505584) </os>
I0814 17:27:18.965523 72662 main.go:141] libmachine: (old-k8s-version-505584) <devices>
I0814 17:27:18.965536 72662 main.go:141] libmachine: (old-k8s-version-505584) <disk type='file' device='cdrom'>
I0814 17:27:18.965556 72662 main.go:141] libmachine: (old-k8s-version-505584) <source file='/home/jenkins/minikube-integration/19446-13977/.minikube/machines/old-k8s-version-505584/boot2docker.iso'/>
I0814 17:27:18.965567 72662 main.go:141] libmachine: (old-k8s-version-505584) <target dev='hdc' bus='scsi'/>
I0814 17:27:18.965576 72662 main.go:141] libmachine: (old-k8s-version-505584) <readonly/>
I0814 17:27:18.965587 72662 main.go:141] libmachine: (old-k8s-version-505584) </disk>
I0814 17:27:18.965597 72662 main.go:141] libmachine: (old-k8s-version-505584) <disk type='file' device='disk'>
I0814 17:27:18.965609 72662 main.go:141] libmachine: (old-k8s-version-505584) <driver name='qemu' type='raw' cache='default' io='threads' />
I0814 17:27:18.965626 72662 main.go:141] libmachine: (old-k8s-version-505584) <source file='/home/jenkins/minikube-integration/19446-13977/.minikube/machines/old-k8s-version-505584/old-k8s-version-505584.rawdisk'/>
I0814 17:27:18.965636 72662 main.go:141] libmachine: (old-k8s-version-505584) <target dev='hda' bus='virtio'/>
I0814 17:27:18.965643 72662 main.go:141] libmachine: (old-k8s-version-505584) </disk>
I0814 17:27:18.965649 72662 main.go:141] libmachine: (old-k8s-version-505584) <interface type='network'>
I0814 17:27:18.965659 72662 main.go:141] libmachine: (old-k8s-version-505584) <source network='mk-old-k8s-version-505584'/>
I0814 17:27:18.965670 72662 main.go:141] libmachine: (old-k8s-version-505584) <model type='virtio'/>
I0814 17:27:18.965681 72662 main.go:141] libmachine: (old-k8s-version-505584) </interface>
I0814 17:27:18.965692 72662 main.go:141] libmachine: (old-k8s-version-505584) <interface type='network'>
I0814 17:27:18.965702 72662 main.go:141] libmachine: (old-k8s-version-505584) <source network='default'/>
I0814 17:27:18.965712 72662 main.go:141] libmachine: (old-k8s-version-505584) <model type='virtio'/>
I0814 17:27:18.965723 72662 main.go:141] libmachine: (old-k8s-version-505584) </interface>
I0814 17:27:18.965732 72662 main.go:141] libmachine: (old-k8s-version-505584) <serial type='pty'>
I0814 17:27:18.965739 72662 main.go:141] libmachine: (old-k8s-version-505584) <target port='0'/>
I0814 17:27:18.965746 72662 main.go:141] libmachine: (old-k8s-version-505584) </serial>
I0814 17:27:18.965756 72662 main.go:141] libmachine: (old-k8s-version-505584) <console type='pty'>
I0814 17:27:18.965767 72662 main.go:141] libmachine: (old-k8s-version-505584) <target type='serial' port='0'/>
I0814 17:27:18.965776 72662 main.go:141] libmachine: (old-k8s-version-505584) </console>
I0814 17:27:18.965787 72662 main.go:141] libmachine: (old-k8s-version-505584) <rng model='virtio'>
I0814 17:27:18.965797 72662 main.go:141] libmachine: (old-k8s-version-505584) <backend model='random'>/dev/random</backend>
I0814 17:27:18.965807 72662 main.go:141] libmachine: (old-k8s-version-505584) </rng>
I0814 17:27:18.965821 72662 main.go:141] libmachine: (old-k8s-version-505584)
I0814 17:27:18.965831 72662 main.go:141] libmachine: (old-k8s-version-505584)
I0814 17:27:18.965839 72662 main.go:141] libmachine: (old-k8s-version-505584) </devices>
I0814 17:27:18.965849 72662 main.go:141] libmachine: (old-k8s-version-505584) </domain>
I0814 17:27:18.965860 72662 main.go:141] libmachine: (old-k8s-version-505584)
I0814 17:27:18.970010 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has defined MAC address 52:54:00:76:9d:72 in network default
I0814 17:27:18.970711 72662 main.go:141] libmachine: (old-k8s-version-505584) Ensuring networks are active...
I0814 17:27:18.970740 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has defined MAC address 52:54:00:b6:27:ea in network mk-old-k8s-version-505584
I0814 17:27:18.971654 72662 main.go:141] libmachine: (old-k8s-version-505584) Ensuring network default is active
I0814 17:27:18.972163 72662 main.go:141] libmachine: (old-k8s-version-505584) Ensuring network mk-old-k8s-version-505584 is active
I0814 17:27:18.972807 72662 main.go:141] libmachine: (old-k8s-version-505584) Getting domain xml...
I0814 17:27:18.973869 72662 main.go:141] libmachine: (old-k8s-version-505584) Creating domain...
I0814 17:27:20.471683 72662 main.go:141] libmachine: (old-k8s-version-505584) Waiting to get IP...
I0814 17:27:20.472800 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has defined MAC address 52:54:00:b6:27:ea in network mk-old-k8s-version-505584
I0814 17:27:20.473583 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | unable to find current IP address of domain old-k8s-version-505584 in network mk-old-k8s-version-505584
I0814 17:27:20.473610 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | I0814 17:27:20.473559 72820 retry.go:31] will retry after 209.46761ms: waiting for machine to come up
I0814 17:27:20.685292 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has defined MAC address 52:54:00:b6:27:ea in network mk-old-k8s-version-505584
I0814 17:27:20.685828 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | unable to find current IP address of domain old-k8s-version-505584 in network mk-old-k8s-version-505584
I0814 17:27:20.685855 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | I0814 17:27:20.685784 72820 retry.go:31] will retry after 307.040998ms: waiting for machine to come up
I0814 17:27:20.994455 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has defined MAC address 52:54:00:b6:27:ea in network mk-old-k8s-version-505584
I0814 17:27:20.995047 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | unable to find current IP address of domain old-k8s-version-505584 in network mk-old-k8s-version-505584
I0814 17:27:20.995072 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | I0814 17:27:20.995003 72820 retry.go:31] will retry after 362.36242ms: waiting for machine to come up
I0814 17:27:21.358419 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has defined MAC address 52:54:00:b6:27:ea in network mk-old-k8s-version-505584
I0814 17:27:21.358981 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | unable to find current IP address of domain old-k8s-version-505584 in network mk-old-k8s-version-505584
I0814 17:27:21.359010 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | I0814 17:27:21.358934 72820 retry.go:31] will retry after 569.409262ms: waiting for machine to come up
I0814 17:27:21.929869 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has defined MAC address 52:54:00:b6:27:ea in network mk-old-k8s-version-505584
I0814 17:27:21.930492 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | unable to find current IP address of domain old-k8s-version-505584 in network mk-old-k8s-version-505584
I0814 17:27:21.930514 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | I0814 17:27:21.930450 72820 retry.go:31] will retry after 584.091695ms: waiting for machine to come up
I0814 17:27:22.516276 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has defined MAC address 52:54:00:b6:27:ea in network mk-old-k8s-version-505584
I0814 17:27:22.516830 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | unable to find current IP address of domain old-k8s-version-505584 in network mk-old-k8s-version-505584
I0814 17:27:22.516871 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | I0814 17:27:22.516774 72820 retry.go:31] will retry after 689.174354ms: waiting for machine to come up
I0814 17:27:23.207930 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has defined MAC address 52:54:00:b6:27:ea in network mk-old-k8s-version-505584
I0814 17:27:23.208482 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | unable to find current IP address of domain old-k8s-version-505584 in network mk-old-k8s-version-505584
I0814 17:27:23.208513 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | I0814 17:27:23.208429 72820 retry.go:31] will retry after 856.068904ms: waiting for machine to come up
I0814 17:27:24.065960 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has defined MAC address 52:54:00:b6:27:ea in network mk-old-k8s-version-505584
I0814 17:27:24.066594 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | unable to find current IP address of domain old-k8s-version-505584 in network mk-old-k8s-version-505584
I0814 17:27:24.066634 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | I0814 17:27:24.066527 72820 retry.go:31] will retry after 1.279495166s: waiting for machine to come up
I0814 17:27:25.347395 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has defined MAC address 52:54:00:b6:27:ea in network mk-old-k8s-version-505584
I0814 17:27:25.347831 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | unable to find current IP address of domain old-k8s-version-505584 in network mk-old-k8s-version-505584
I0814 17:27:25.347855 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | I0814 17:27:25.347788 72820 retry.go:31] will retry after 1.213890144s: waiting for machine to come up
I0814 17:27:26.563218 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has defined MAC address 52:54:00:b6:27:ea in network mk-old-k8s-version-505584
I0814 17:27:26.563838 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | unable to find current IP address of domain old-k8s-version-505584 in network mk-old-k8s-version-505584
I0814 17:27:26.563866 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | I0814 17:27:26.563783 72820 retry.go:31] will retry after 1.706844197s: waiting for machine to come up
I0814 17:27:28.272622 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has defined MAC address 52:54:00:b6:27:ea in network mk-old-k8s-version-505584
I0814 17:27:28.273206 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | unable to find current IP address of domain old-k8s-version-505584 in network mk-old-k8s-version-505584
I0814 17:27:28.273233 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | I0814 17:27:28.273160 72820 retry.go:31] will retry after 2.407949465s: waiting for machine to come up
I0814 17:27:30.683600 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has defined MAC address 52:54:00:b6:27:ea in network mk-old-k8s-version-505584
I0814 17:27:30.684229 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | unable to find current IP address of domain old-k8s-version-505584 in network mk-old-k8s-version-505584
I0814 17:27:30.684261 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | I0814 17:27:30.684183 72820 retry.go:31] will retry after 2.423354878s: waiting for machine to come up
I0814 17:27:33.108976 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has defined MAC address 52:54:00:b6:27:ea in network mk-old-k8s-version-505584
I0814 17:27:33.109594 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | unable to find current IP address of domain old-k8s-version-505584 in network mk-old-k8s-version-505584
I0814 17:27:33.109616 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | I0814 17:27:33.109549 72820 retry.go:31] will retry after 4.282171923s: waiting for machine to come up
I0814 17:27:37.393949 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has defined MAC address 52:54:00:b6:27:ea in network mk-old-k8s-version-505584
I0814 17:27:37.394446 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | unable to find current IP address of domain old-k8s-version-505584 in network mk-old-k8s-version-505584
I0814 17:27:37.394470 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | I0814 17:27:37.394403 72820 retry.go:31] will retry after 4.108790875s: waiting for machine to come up
I0814 17:27:41.504324 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has defined MAC address 52:54:00:b6:27:ea in network mk-old-k8s-version-505584
I0814 17:27:41.504825 72662 main.go:141] libmachine: (old-k8s-version-505584) Found IP for machine: 192.168.72.49
I0814 17:27:41.504839 72662 main.go:141] libmachine: (old-k8s-version-505584) Reserving static IP address...
I0814 17:27:41.504877 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has current primary IP address 192.168.72.49 and MAC address 52:54:00:b6:27:ea in network mk-old-k8s-version-505584
I0814 17:27:41.505204 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-505584", mac: "52:54:00:b6:27:ea", ip: "192.168.72.49"} in network mk-old-k8s-version-505584
I0814 17:27:41.592230 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | Getting to WaitForSSH function...
I0814 17:27:41.592255 72662 main.go:141] libmachine: (old-k8s-version-505584) Reserved static IP address: 192.168.72.49
I0814 17:27:41.592268 72662 main.go:141] libmachine: (old-k8s-version-505584) Waiting for SSH to be available...
I0814 17:27:41.595820 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has defined MAC address 52:54:00:b6:27:ea in network mk-old-k8s-version-505584
I0814 17:27:41.596254 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b6:27:ea", ip: ""} in network mk-old-k8s-version-505584: {Iface:virbr4 ExpiryTime:2024-08-14 18:27:34 +0000 UTC Type:0 Mac:52:54:00:b6:27:ea Iaid: IPaddr:192.168.72.49 Prefix:24 Hostname:minikube Clientid:01:52:54:00:b6:27:ea}
I0814 17:27:41.596280 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has defined IP address 192.168.72.49 and MAC address 52:54:00:b6:27:ea in network mk-old-k8s-version-505584
I0814 17:27:41.596606 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | Using SSH client type: external
I0814 17:27:41.596644 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | Using SSH private key: /home/jenkins/minikube-integration/19446-13977/.minikube/machines/old-k8s-version-505584/id_rsa (-rw-------)
I0814 17:27:41.596674 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.72.49 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19446-13977/.minikube/machines/old-k8s-version-505584/id_rsa -p 22] /usr/bin/ssh <nil>}
I0814 17:27:41.596686 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | About to run SSH command:
I0814 17:27:41.596701 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | exit 0
I0814 17:27:41.746942 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | SSH cmd err, output: <nil>:
I0814 17:27:41.747462 72662 main.go:141] libmachine: (old-k8s-version-505584) KVM machine creation complete!
I0814 17:27:41.747848 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetConfigRaw
I0814 17:27:41.748355 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .DriverName
I0814 17:27:41.748544 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .DriverName
I0814 17:27:41.748726 72662 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0814 17:27:41.748745 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetState
I0814 17:27:41.750186 72662 main.go:141] libmachine: Detecting operating system of created instance...
I0814 17:27:41.750203 72662 main.go:141] libmachine: Waiting for SSH to be available...
I0814 17:27:41.750211 72662 main.go:141] libmachine: Getting to WaitForSSH function...
I0814 17:27:41.750220 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetSSHHostname
I0814 17:27:41.754414 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has defined MAC address 52:54:00:b6:27:ea in network mk-old-k8s-version-505584
I0814 17:27:41.754866 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b6:27:ea", ip: ""} in network mk-old-k8s-version-505584: {Iface:virbr4 ExpiryTime:2024-08-14 18:27:34 +0000 UTC Type:0 Mac:52:54:00:b6:27:ea Iaid: IPaddr:192.168.72.49 Prefix:24 Hostname:old-k8s-version-505584 Clientid:01:52:54:00:b6:27:ea}
I0814 17:27:41.754890 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has defined IP address 192.168.72.49 and MAC address 52:54:00:b6:27:ea in network mk-old-k8s-version-505584
I0814 17:27:41.755136 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetSSHPort
I0814 17:27:41.755314 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetSSHKeyPath
I0814 17:27:41.755496 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetSSHKeyPath
I0814 17:27:41.755620 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetSSHUsername
I0814 17:27:41.755810 72662 main.go:141] libmachine: Using SSH client type: native
I0814 17:27:41.756067 72662 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.72.49 22 <nil> <nil>}
I0814 17:27:41.756085 72662 main.go:141] libmachine: About to run SSH command:
exit 0
I0814 17:27:41.882890 72662 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0814 17:27:41.882925 72662 main.go:141] libmachine: Detecting the provisioner...
I0814 17:27:41.882937 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetSSHHostname
I0814 17:27:41.886427 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has defined MAC address 52:54:00:b6:27:ea in network mk-old-k8s-version-505584
I0814 17:27:41.886870 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b6:27:ea", ip: ""} in network mk-old-k8s-version-505584: {Iface:virbr4 ExpiryTime:2024-08-14 18:27:34 +0000 UTC Type:0 Mac:52:54:00:b6:27:ea Iaid: IPaddr:192.168.72.49 Prefix:24 Hostname:old-k8s-version-505584 Clientid:01:52:54:00:b6:27:ea}
I0814 17:27:41.886939 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has defined IP address 192.168.72.49 and MAC address 52:54:00:b6:27:ea in network mk-old-k8s-version-505584
I0814 17:27:41.887110 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetSSHPort
I0814 17:27:41.887348 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetSSHKeyPath
I0814 17:27:41.887564 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetSSHKeyPath
I0814 17:27:41.887737 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetSSHUsername
I0814 17:27:41.887906 72662 main.go:141] libmachine: Using SSH client type: native
I0814 17:27:41.888150 72662 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.72.49 22 <nil> <nil>}
I0814 17:27:41.888167 72662 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0814 17:27:42.004868 72662 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0814 17:27:42.004959 72662 main.go:141] libmachine: found compatible host: buildroot
I0814 17:27:42.004976 72662 main.go:141] libmachine: Provisioning with buildroot...
I0814 17:27:42.004995 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetMachineName
I0814 17:27:42.005276 72662 buildroot.go:166] provisioning hostname "old-k8s-version-505584"
I0814 17:27:42.005302 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetMachineName
I0814 17:27:42.005461 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetSSHHostname
I0814 17:27:42.008765 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has defined MAC address 52:54:00:b6:27:ea in network mk-old-k8s-version-505584
I0814 17:27:42.009115 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b6:27:ea", ip: ""} in network mk-old-k8s-version-505584: {Iface:virbr4 ExpiryTime:2024-08-14 18:27:34 +0000 UTC Type:0 Mac:52:54:00:b6:27:ea Iaid: IPaddr:192.168.72.49 Prefix:24 Hostname:old-k8s-version-505584 Clientid:01:52:54:00:b6:27:ea}
I0814 17:27:42.009145 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has defined IP address 192.168.72.49 and MAC address 52:54:00:b6:27:ea in network mk-old-k8s-version-505584
I0814 17:27:42.009409 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetSSHPort
I0814 17:27:42.009584 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetSSHKeyPath
I0814 17:27:42.009739 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetSSHKeyPath
I0814 17:27:42.009874 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetSSHUsername
I0814 17:27:42.010031 72662 main.go:141] libmachine: Using SSH client type: native
I0814 17:27:42.010261 72662 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.72.49 22 <nil> <nil>}
I0814 17:27:42.010282 72662 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-505584 && echo "old-k8s-version-505584" | sudo tee /etc/hostname
I0814 17:27:42.139669 72662 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-505584
I0814 17:27:42.139698 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetSSHHostname
I0814 17:27:42.142968 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has defined MAC address 52:54:00:b6:27:ea in network mk-old-k8s-version-505584
I0814 17:27:42.143407 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b6:27:ea", ip: ""} in network mk-old-k8s-version-505584: {Iface:virbr4 ExpiryTime:2024-08-14 18:27:34 +0000 UTC Type:0 Mac:52:54:00:b6:27:ea Iaid: IPaddr:192.168.72.49 Prefix:24 Hostname:old-k8s-version-505584 Clientid:01:52:54:00:b6:27:ea}
I0814 17:27:42.143430 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has defined IP address 192.168.72.49 and MAC address 52:54:00:b6:27:ea in network mk-old-k8s-version-505584
I0814 17:27:42.143581 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetSSHPort
I0814 17:27:42.143764 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetSSHKeyPath
I0814 17:27:42.143932 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetSSHKeyPath
I0814 17:27:42.144111 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetSSHUsername
I0814 17:27:42.144330 72662 main.go:141] libmachine: Using SSH client type: native
I0814 17:27:42.144486 72662 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.72.49 22 <nil> <nil>}
I0814 17:27:42.144506 72662 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-505584' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-505584/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-505584' | sudo tee -a /etc/hosts;
fi
fi
I0814 17:27:42.267547 72662 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0814 17:27:42.267581 72662 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19446-13977/.minikube CaCertPath:/home/jenkins/minikube-integration/19446-13977/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19446-13977/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19446-13977/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19446-13977/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19446-13977/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19446-13977/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19446-13977/.minikube}
I0814 17:27:42.267617 72662 buildroot.go:174] setting up certificates
I0814 17:27:42.267631 72662 provision.go:84] configureAuth start
I0814 17:27:42.267645 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetMachineName
I0814 17:27:42.267981 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetIP
I0814 17:27:42.271232 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has defined MAC address 52:54:00:b6:27:ea in network mk-old-k8s-version-505584
I0814 17:27:42.271767 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b6:27:ea", ip: ""} in network mk-old-k8s-version-505584: {Iface:virbr4 ExpiryTime:2024-08-14 18:27:34 +0000 UTC Type:0 Mac:52:54:00:b6:27:ea Iaid: IPaddr:192.168.72.49 Prefix:24 Hostname:old-k8s-version-505584 Clientid:01:52:54:00:b6:27:ea}
I0814 17:27:42.271799 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has defined IP address 192.168.72.49 and MAC address 52:54:00:b6:27:ea in network mk-old-k8s-version-505584
I0814 17:27:42.272003 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetSSHHostname
I0814 17:27:42.274920 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has defined MAC address 52:54:00:b6:27:ea in network mk-old-k8s-version-505584
I0814 17:27:42.275339 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b6:27:ea", ip: ""} in network mk-old-k8s-version-505584: {Iface:virbr4 ExpiryTime:2024-08-14 18:27:34 +0000 UTC Type:0 Mac:52:54:00:b6:27:ea Iaid: IPaddr:192.168.72.49 Prefix:24 Hostname:old-k8s-version-505584 Clientid:01:52:54:00:b6:27:ea}
I0814 17:27:42.275379 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has defined IP address 192.168.72.49 and MAC address 52:54:00:b6:27:ea in network mk-old-k8s-version-505584
I0814 17:27:42.275487 72662 provision.go:143] copyHostCerts
I0814 17:27:42.275566 72662 exec_runner.go:144] found /home/jenkins/minikube-integration/19446-13977/.minikube/cert.pem, removing ...
I0814 17:27:42.275580 72662 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19446-13977/.minikube/cert.pem
I0814 17:27:42.275640 72662 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19446-13977/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19446-13977/.minikube/cert.pem (1123 bytes)
I0814 17:27:42.275774 72662 exec_runner.go:144] found /home/jenkins/minikube-integration/19446-13977/.minikube/key.pem, removing ...
I0814 17:27:42.275783 72662 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19446-13977/.minikube/key.pem
I0814 17:27:42.275815 72662 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19446-13977/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19446-13977/.minikube/key.pem (1679 bytes)
I0814 17:27:42.275905 72662 exec_runner.go:144] found /home/jenkins/minikube-integration/19446-13977/.minikube/ca.pem, removing ...
I0814 17:27:42.275911 72662 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19446-13977/.minikube/ca.pem
I0814 17:27:42.275941 72662 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19446-13977/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19446-13977/.minikube/ca.pem (1078 bytes)
I0814 17:27:42.276016 72662 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19446-13977/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19446-13977/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19446-13977/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-505584 san=[127.0.0.1 192.168.72.49 localhost minikube old-k8s-version-505584]
I0814 17:27:42.638488 72662 provision.go:177] copyRemoteCerts
I0814 17:27:42.638570 72662 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0814 17:27:42.638611 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetSSHHostname
I0814 17:27:42.642140 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has defined MAC address 52:54:00:b6:27:ea in network mk-old-k8s-version-505584
I0814 17:27:42.642572 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b6:27:ea", ip: ""} in network mk-old-k8s-version-505584: {Iface:virbr4 ExpiryTime:2024-08-14 18:27:34 +0000 UTC Type:0 Mac:52:54:00:b6:27:ea Iaid: IPaddr:192.168.72.49 Prefix:24 Hostname:old-k8s-version-505584 Clientid:01:52:54:00:b6:27:ea}
I0814 17:27:42.642610 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has defined IP address 192.168.72.49 and MAC address 52:54:00:b6:27:ea in network mk-old-k8s-version-505584
I0814 17:27:42.642799 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetSSHPort
I0814 17:27:42.642949 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetSSHKeyPath
I0814 17:27:42.643069 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetSSHUsername
I0814 17:27:42.643191 72662 sshutil.go:53] new ssh client: &{IP:192.168.72.49 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19446-13977/.minikube/machines/old-k8s-version-505584/id_rsa Username:docker}
I0814 17:27:42.743972 72662 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19446-13977/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0814 17:27:42.774148 72662 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19446-13977/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0814 17:27:42.809662 72662 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19446-13977/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0814 17:27:42.846190 72662 provision.go:87] duration metric: took 578.544897ms to configureAuth
I0814 17:27:42.846225 72662 buildroot.go:189] setting minikube options for container-runtime
I0814 17:27:42.846457 72662 config.go:182] Loaded profile config "old-k8s-version-505584": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0814 17:27:42.846571 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetSSHHostname
I0814 17:27:42.849673 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has defined MAC address 52:54:00:b6:27:ea in network mk-old-k8s-version-505584
I0814 17:27:42.850141 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b6:27:ea", ip: ""} in network mk-old-k8s-version-505584: {Iface:virbr4 ExpiryTime:2024-08-14 18:27:34 +0000 UTC Type:0 Mac:52:54:00:b6:27:ea Iaid: IPaddr:192.168.72.49 Prefix:24 Hostname:old-k8s-version-505584 Clientid:01:52:54:00:b6:27:ea}
I0814 17:27:42.850168 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has defined IP address 192.168.72.49 and MAC address 52:54:00:b6:27:ea in network mk-old-k8s-version-505584
I0814 17:27:42.850483 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetSSHPort
I0814 17:27:42.850701 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetSSHKeyPath
I0814 17:27:42.850841 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetSSHKeyPath
I0814 17:27:42.850949 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetSSHUsername
I0814 17:27:42.851088 72662 main.go:141] libmachine: Using SSH client type: native
I0814 17:27:42.851308 72662 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.72.49 22 <nil> <nil>}
I0814 17:27:42.851348 72662 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0814 17:27:43.221573 72662 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0814 17:27:43.221605 72662 main.go:141] libmachine: Checking connection to Docker...
I0814 17:27:43.221618 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetURL
I0814 17:27:43.223186 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | Using libvirt version 6000000
I0814 17:27:43.226379 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has defined MAC address 52:54:00:b6:27:ea in network mk-old-k8s-version-505584
I0814 17:27:43.226680 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b6:27:ea", ip: ""} in network mk-old-k8s-version-505584: {Iface:virbr4 ExpiryTime:2024-08-14 18:27:34 +0000 UTC Type:0 Mac:52:54:00:b6:27:ea Iaid: IPaddr:192.168.72.49 Prefix:24 Hostname:old-k8s-version-505584 Clientid:01:52:54:00:b6:27:ea}
I0814 17:27:43.226693 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has defined IP address 192.168.72.49 and MAC address 52:54:00:b6:27:ea in network mk-old-k8s-version-505584
I0814 17:27:43.226924 72662 main.go:141] libmachine: Docker is up and running!
I0814 17:27:43.226932 72662 main.go:141] libmachine: Reticulating splines...
I0814 17:27:43.226938 72662 client.go:171] duration metric: took 24.933233946s to LocalClient.Create
I0814 17:27:43.226955 72662 start.go:167] duration metric: took 24.933308387s to libmachine.API.Create "old-k8s-version-505584"
I0814 17:27:43.226961 72662 start.go:293] postStartSetup for "old-k8s-version-505584" (driver="kvm2")
I0814 17:27:43.226971 72662 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0814 17:27:43.226984 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .DriverName
I0814 17:27:43.227517 72662 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0814 17:27:43.227553 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetSSHHostname
I0814 17:27:43.229928 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has defined MAC address 52:54:00:b6:27:ea in network mk-old-k8s-version-505584
I0814 17:27:43.230334 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b6:27:ea", ip: ""} in network mk-old-k8s-version-505584: {Iface:virbr4 ExpiryTime:2024-08-14 18:27:34 +0000 UTC Type:0 Mac:52:54:00:b6:27:ea Iaid: IPaddr:192.168.72.49 Prefix:24 Hostname:old-k8s-version-505584 Clientid:01:52:54:00:b6:27:ea}
I0814 17:27:43.230346 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has defined IP address 192.168.72.49 and MAC address 52:54:00:b6:27:ea in network mk-old-k8s-version-505584
I0814 17:27:43.230666 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetSSHPort
I0814 17:27:43.230806 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetSSHKeyPath
I0814 17:27:43.230888 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetSSHUsername
I0814 17:27:43.230952 72662 sshutil.go:53] new ssh client: &{IP:192.168.72.49 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19446-13977/.minikube/machines/old-k8s-version-505584/id_rsa Username:docker}
I0814 17:27:43.315267 72662 ssh_runner.go:195] Run: cat /etc/os-release
I0814 17:27:43.321222 72662 info.go:137] Remote host: Buildroot 2023.02.9
I0814 17:27:43.321246 72662 filesync.go:126] Scanning /home/jenkins/minikube-integration/19446-13977/.minikube/addons for local assets ...
I0814 17:27:43.321296 72662 filesync.go:126] Scanning /home/jenkins/minikube-integration/19446-13977/.minikube/files for local assets ...
I0814 17:27:43.321402 72662 filesync.go:149] local asset: /home/jenkins/minikube-integration/19446-13977/.minikube/files/etc/ssl/certs/211772.pem -> 211772.pem in /etc/ssl/certs
I0814 17:27:43.321697 72662 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0814 17:27:43.333298 72662 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19446-13977/.minikube/files/etc/ssl/certs/211772.pem --> /etc/ssl/certs/211772.pem (1708 bytes)
I0814 17:27:43.361405 72662 start.go:296] duration metric: took 134.433297ms for postStartSetup
I0814 17:27:43.361462 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetConfigRaw
I0814 17:27:43.362004 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetIP
I0814 17:27:43.365491 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has defined MAC address 52:54:00:b6:27:ea in network mk-old-k8s-version-505584
I0814 17:27:43.366293 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b6:27:ea", ip: ""} in network mk-old-k8s-version-505584: {Iface:virbr4 ExpiryTime:2024-08-14 18:27:34 +0000 UTC Type:0 Mac:52:54:00:b6:27:ea Iaid: IPaddr:192.168.72.49 Prefix:24 Hostname:old-k8s-version-505584 Clientid:01:52:54:00:b6:27:ea}
I0814 17:27:43.366327 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has defined IP address 192.168.72.49 and MAC address 52:54:00:b6:27:ea in network mk-old-k8s-version-505584
I0814 17:27:43.366477 72662 profile.go:143] Saving config to /home/jenkins/minikube-integration/19446-13977/.minikube/profiles/old-k8s-version-505584/config.json ...
I0814 17:27:43.366716 72662 start.go:128] duration metric: took 25.098736237s to createHost
I0814 17:27:43.366750 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetSSHHostname
I0814 17:27:43.370488 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has defined MAC address 52:54:00:b6:27:ea in network mk-old-k8s-version-505584
I0814 17:27:43.370826 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b6:27:ea", ip: ""} in network mk-old-k8s-version-505584: {Iface:virbr4 ExpiryTime:2024-08-14 18:27:34 +0000 UTC Type:0 Mac:52:54:00:b6:27:ea Iaid: IPaddr:192.168.72.49 Prefix:24 Hostname:old-k8s-version-505584 Clientid:01:52:54:00:b6:27:ea}
I0814 17:27:43.370849 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has defined IP address 192.168.72.49 and MAC address 52:54:00:b6:27:ea in network mk-old-k8s-version-505584
I0814 17:27:43.371118 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetSSHPort
I0814 17:27:43.371310 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetSSHKeyPath
I0814 17:27:43.371593 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetSSHKeyPath
I0814 17:27:43.371775 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetSSHUsername
I0814 17:27:43.371954 72662 main.go:141] libmachine: Using SSH client type: native
I0814 17:27:43.372154 72662 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.72.49 22 <nil> <nil>}
I0814 17:27:43.372169 72662 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0814 17:27:43.489037 72662 main.go:141] libmachine: SSH cmd err, output: <nil>: 1723656463.470142926
I0814 17:27:43.489069 72662 fix.go:216] guest clock: 1723656463.470142926
I0814 17:27:43.489079 72662 fix.go:229] Guest: 2024-08-14 17:27:43.470142926 +0000 UTC Remote: 2024-08-14 17:27:43.366729883 +0000 UTC m=+42.038792842 (delta=103.413043ms)
I0814 17:27:43.489107 72662 fix.go:200] guest clock delta is within tolerance: 103.413043ms
I0814 17:27:43.489115 72662 start.go:83] releasing machines lock for "old-k8s-version-505584", held for 25.221306516s
I0814 17:27:43.489141 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .DriverName
I0814 17:27:43.489438 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetIP
I0814 17:27:43.492577 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has defined MAC address 52:54:00:b6:27:ea in network mk-old-k8s-version-505584
I0814 17:27:43.493203 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b6:27:ea", ip: ""} in network mk-old-k8s-version-505584: {Iface:virbr4 ExpiryTime:2024-08-14 18:27:34 +0000 UTC Type:0 Mac:52:54:00:b6:27:ea Iaid: IPaddr:192.168.72.49 Prefix:24 Hostname:old-k8s-version-505584 Clientid:01:52:54:00:b6:27:ea}
I0814 17:27:43.493237 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has defined IP address 192.168.72.49 and MAC address 52:54:00:b6:27:ea in network mk-old-k8s-version-505584
I0814 17:27:43.493405 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .DriverName
I0814 17:27:43.494197 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .DriverName
I0814 17:27:43.494389 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .DriverName
I0814 17:27:43.494473 72662 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0814 17:27:43.494536 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetSSHHostname
I0814 17:27:43.494589 72662 ssh_runner.go:195] Run: cat /version.json
I0814 17:27:43.494616 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetSSHHostname
I0814 17:27:43.498541 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has defined MAC address 52:54:00:b6:27:ea in network mk-old-k8s-version-505584
I0814 17:27:43.498971 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b6:27:ea", ip: ""} in network mk-old-k8s-version-505584: {Iface:virbr4 ExpiryTime:2024-08-14 18:27:34 +0000 UTC Type:0 Mac:52:54:00:b6:27:ea Iaid: IPaddr:192.168.72.49 Prefix:24 Hostname:old-k8s-version-505584 Clientid:01:52:54:00:b6:27:ea}
I0814 17:27:43.498986 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has defined IP address 192.168.72.49 and MAC address 52:54:00:b6:27:ea in network mk-old-k8s-version-505584
I0814 17:27:43.499219 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetSSHPort
I0814 17:27:43.499380 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetSSHKeyPath
I0814 17:27:43.499543 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has defined MAC address 52:54:00:b6:27:ea in network mk-old-k8s-version-505584
I0814 17:27:43.499590 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetSSHUsername
I0814 17:27:43.499761 72662 sshutil.go:53] new ssh client: &{IP:192.168.72.49 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19446-13977/.minikube/machines/old-k8s-version-505584/id_rsa Username:docker}
I0814 17:27:43.499877 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b6:27:ea", ip: ""} in network mk-old-k8s-version-505584: {Iface:virbr4 ExpiryTime:2024-08-14 18:27:34 +0000 UTC Type:0 Mac:52:54:00:b6:27:ea Iaid: IPaddr:192.168.72.49 Prefix:24 Hostname:old-k8s-version-505584 Clientid:01:52:54:00:b6:27:ea}
I0814 17:27:43.499902 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has defined IP address 192.168.72.49 and MAC address 52:54:00:b6:27:ea in network mk-old-k8s-version-505584
I0814 17:27:43.500121 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetSSHPort
I0814 17:27:43.500249 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetSSHKeyPath
I0814 17:27:43.500451 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetSSHUsername
I0814 17:27:43.500593 72662 sshutil.go:53] new ssh client: &{IP:192.168.72.49 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19446-13977/.minikube/machines/old-k8s-version-505584/id_rsa Username:docker}
I0814 17:27:43.623112 72662 ssh_runner.go:195] Run: systemctl --version
I0814 17:27:43.630083 72662 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0814 17:27:43.791248 72662 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0814 17:27:43.799830 72662 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0814 17:27:43.799892 72662 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0814 17:27:43.821668 72662 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0814 17:27:43.821687 72662 start.go:495] detecting cgroup driver to use...
I0814 17:27:43.821736 72662 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0814 17:27:43.842093 72662 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0814 17:27:43.859420 72662 docker.go:217] disabling cri-docker service (if available) ...
I0814 17:27:43.859490 72662 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0814 17:27:43.875756 72662 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0814 17:27:43.893568 72662 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0814 17:27:44.048915 72662 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0814 17:27:44.214972 72662 docker.go:233] disabling docker service ...
I0814 17:27:44.215031 72662 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0814 17:27:44.231855 72662 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0814 17:27:44.245877 72662 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0814 17:27:44.409250 72662 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0814 17:27:44.560155 72662 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0814 17:27:44.576656 72662 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0814 17:27:44.596756 72662 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0814 17:27:44.596810 72662 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0814 17:27:44.607419 72662 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0814 17:27:44.607481 72662 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0814 17:27:44.619146 72662 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0814 17:27:44.630432 72662 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0814 17:27:44.641623 72662 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0814 17:27:44.656514 72662 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0814 17:27:44.667405 72662 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0814 17:27:44.667476 72662 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0814 17:27:44.683548 72662 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0814 17:27:44.699078 72662 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0814 17:27:44.856459 72662 ssh_runner.go:195] Run: sudo systemctl restart crio
I0814 17:27:45.041992 72662 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0814 17:27:45.042063 72662 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0814 17:27:45.048595 72662 start.go:563] Will wait 60s for crictl version
I0814 17:27:45.048653 72662 ssh_runner.go:195] Run: which crictl
I0814 17:27:45.053064 72662 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0814 17:27:45.107036 72662 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0814 17:27:45.107096 72662 ssh_runner.go:195] Run: crio --version
I0814 17:27:45.142156 72662 ssh_runner.go:195] Run: crio --version
I0814 17:27:45.180985 72662 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0814 17:27:45.182230 72662 main.go:141] libmachine: (old-k8s-version-505584) Calling .GetIP
I0814 17:27:45.185084 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has defined MAC address 52:54:00:b6:27:ea in network mk-old-k8s-version-505584
I0814 17:27:45.185608 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:b6:27:ea", ip: ""} in network mk-old-k8s-version-505584: {Iface:virbr4 ExpiryTime:2024-08-14 18:27:34 +0000 UTC Type:0 Mac:52:54:00:b6:27:ea Iaid: IPaddr:192.168.72.49 Prefix:24 Hostname:old-k8s-version-505584 Clientid:01:52:54:00:b6:27:ea}
I0814 17:27:45.185643 72662 main.go:141] libmachine: (old-k8s-version-505584) DBG | domain old-k8s-version-505584 has defined IP address 192.168.72.49 and MAC address 52:54:00:b6:27:ea in network mk-old-k8s-version-505584
I0814 17:27:45.185875 72662 ssh_runner.go:195] Run: grep 192.168.72.1 host.minikube.internal$ /etc/hosts
I0814 17:27:45.190316 72662 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.72.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0814 17:27:45.205920 72662 kubeadm.go:883] updating cluster {Name:old-k8s-version-505584 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19429/minikube-v1.33.1-1723567878-19429-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723567951-19429@sha256:cdfb2e55e95c0c0e857baca4796fc9879d11f99617f48df875a23169fed0e083 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-505584 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.49 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mo
untPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0814 17:27:45.206056 72662 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0814 17:27:45.206111 72662 ssh_runner.go:195] Run: sudo crictl images --output json
I0814 17:27:45.251763 72662 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0814 17:27:45.251840 72662 ssh_runner.go:195] Run: which lz4
I0814 17:27:45.256741 72662 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0814 17:27:45.261510 72662 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0814 17:27:45.261544 72662 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19446-13977/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0814 17:27:47.075483 72662 crio.go:462] duration metric: took 1.818781979s to copy over tarball
I0814 17:27:47.075545 72662 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0814 17:27:50.409110 72662 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.333542737s)
I0814 17:27:50.409141 72662 crio.go:469] duration metric: took 3.333628406s to extract the tarball
I0814 17:27:50.409148 72662 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0814 17:27:50.455649 72662 ssh_runner.go:195] Run: sudo crictl images --output json
I0814 17:27:50.510857 72662 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0814 17:27:50.510884 72662 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0814 17:27:50.510948 72662 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0814 17:27:50.511391 72662 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0814 17:27:50.511410 72662 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0814 17:27:50.511449 72662 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0814 17:27:50.511485 72662 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0814 17:27:50.511513 72662 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0814 17:27:50.511554 72662 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0814 17:27:50.511661 72662 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0814 17:27:50.513319 72662 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0814 17:27:50.513393 72662 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0814 17:27:50.513650 72662 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0814 17:27:50.513320 72662 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0814 17:27:50.513747 72662 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0814 17:27:50.513851 72662 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0814 17:27:50.513948 72662 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0814 17:27:50.514436 72662 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0814 17:27:50.749149 72662 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0814 17:27:50.793819 72662 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0814 17:27:50.793874 72662 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0814 17:27:50.793921 72662 ssh_runner.go:195] Run: which crictl
I0814 17:27:50.798810 72662 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0814 17:27:50.833842 72662 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0814 17:27:50.834878 72662 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0814 17:27:50.857205 72662 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0814 17:27:50.869486 72662 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0814 17:27:50.884244 72662 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0814 17:27:50.900661 72662 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0814 17:27:50.906054 72662 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0814 17:27:50.907478 72662 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0814 17:27:50.931537 72662 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0814 17:27:50.931590 72662 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0814 17:27:50.931645 72662 ssh_runner.go:195] Run: which crictl
I0814 17:27:51.031533 72662 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0814 17:27:51.031572 72662 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0814 17:27:51.031615 72662 ssh_runner.go:195] Run: which crictl
I0814 17:27:51.076296 72662 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0814 17:27:51.076316 72662 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19446-13977/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0814 17:27:51.076359 72662 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0814 17:27:51.076405 72662 ssh_runner.go:195] Run: which crictl
I0814 17:27:51.087121 72662 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0814 17:27:51.087153 72662 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0814 17:27:51.087187 72662 ssh_runner.go:195] Run: which crictl
I0814 17:27:51.087249 72662 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0814 17:27:51.087264 72662 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0814 17:27:51.087279 72662 ssh_runner.go:195] Run: which crictl
I0814 17:27:51.104630 72662 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0814 17:27:51.104671 72662 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0814 17:27:51.104716 72662 ssh_runner.go:195] Run: which crictl
I0814 17:27:51.104777 72662 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0814 17:27:51.104812 72662 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0814 17:27:51.104844 72662 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0814 17:27:51.104890 72662 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0814 17:27:51.104919 72662 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0814 17:27:51.225515 72662 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0814 17:27:51.225644 72662 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0814 17:27:51.225730 72662 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0814 17:27:51.225856 72662 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0814 17:27:51.225955 72662 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0814 17:27:51.226035 72662 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0814 17:27:51.376148 72662 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0814 17:27:51.376198 72662 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0814 17:27:51.376206 72662 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0814 17:27:51.376266 72662 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0814 17:27:51.376315 72662 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0814 17:27:51.376363 72662 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0814 17:27:51.423344 72662 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0814 17:27:51.527408 72662 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19446-13977/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0814 17:27:51.527504 72662 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0814 17:27:51.527522 72662 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19446-13977/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0814 17:27:51.527582 72662 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19446-13977/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0814 17:27:51.527616 72662 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19446-13977/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0814 17:27:51.527664 72662 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19446-13977/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0814 17:27:51.649489 72662 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19446-13977/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0814 17:27:51.649546 72662 cache_images.go:92] duration metric: took 1.138645268s to LoadCachedImages
W0814 17:27:51.649623 72662 out.go:239] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19446-13977/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19446-13977/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2: no such file or directory
I0814 17:27:51.649651 72662 kubeadm.go:934] updating node { 192.168.72.49 8443 v1.20.0 crio true true} ...
I0814 17:27:51.649783 72662 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-505584 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.72.49
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-505584 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0814 17:27:51.649860 72662 ssh_runner.go:195] Run: crio config
I0814 17:27:51.718011 72662 cni.go:84] Creating CNI manager for ""
I0814 17:27:51.718031 72662 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0814 17:27:51.718040 72662 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0814 17:27:51.718057 72662 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.72.49 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-505584 NodeName:old-k8s-version-505584 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.72.49"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.72.49 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Stati
cPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0814 17:27:51.718183 72662 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.72.49
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-505584"
kubeletExtraArgs:
node-ip: 192.168.72.49
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.72.49"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0814 17:27:51.718250 72662 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0814 17:27:51.729151 72662 binaries.go:44] Found k8s binaries, skipping transfer
I0814 17:27:51.729216 72662 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0814 17:27:51.738887 72662 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (429 bytes)
I0814 17:27:51.754773 72662 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0814 17:27:51.772208 72662 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2120 bytes)
I0814 17:27:51.789710 72662 ssh_runner.go:195] Run: grep 192.168.72.49 control-plane.minikube.internal$ /etc/hosts
I0814 17:27:51.794432 72662 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.72.49 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0814 17:27:51.806918 72662 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0814 17:27:51.949741 72662 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0814 17:27:51.968545 72662 certs.go:68] Setting up /home/jenkins/minikube-integration/19446-13977/.minikube/profiles/old-k8s-version-505584 for IP: 192.168.72.49
I0814 17:27:51.968574 72662 certs.go:194] generating shared ca certs ...
I0814 17:27:51.968590 72662 certs.go:226] acquiring lock for ca certs: {Name:mk48ea4eab2c47d5c81779d518bcd8aff8b52d7c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0814 17:27:51.968759 72662 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19446-13977/.minikube/ca.key
I0814 17:27:51.968817 72662 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19446-13977/.minikube/proxy-client-ca.key
I0814 17:27:51.968832 72662 certs.go:256] generating profile certs ...
I0814 17:27:51.968903 72662 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19446-13977/.minikube/profiles/old-k8s-version-505584/client.key
I0814 17:27:51.968937 72662 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19446-13977/.minikube/profiles/old-k8s-version-505584/client.crt with IP's: []
I0814 17:27:52.531417 72662 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19446-13977/.minikube/profiles/old-k8s-version-505584/client.crt ...
I0814 17:27:52.531452 72662 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19446-13977/.minikube/profiles/old-k8s-version-505584/client.crt: {Name:mka6950cb2be8d34fbf4030d1c045410e382c254 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0814 17:27:52.531618 72662 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19446-13977/.minikube/profiles/old-k8s-version-505584/client.key ...
I0814 17:27:52.531634 72662 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19446-13977/.minikube/profiles/old-k8s-version-505584/client.key: {Name:mk6bbdccdbb0dee893da389d32a51b779afc9c13 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0814 17:27:52.531718 72662 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19446-13977/.minikube/profiles/old-k8s-version-505584/apiserver.key.c375770f
I0814 17:27:52.531734 72662 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19446-13977/.minikube/profiles/old-k8s-version-505584/apiserver.crt.c375770f with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.72.49]
I0814 17:27:52.805303 72662 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19446-13977/.minikube/profiles/old-k8s-version-505584/apiserver.crt.c375770f ...
I0814 17:27:52.805344 72662 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19446-13977/.minikube/profiles/old-k8s-version-505584/apiserver.crt.c375770f: {Name:mk4a320eab7abe9d39da8dcb63f7846c2648c0f1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0814 17:27:52.805586 72662 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19446-13977/.minikube/profiles/old-k8s-version-505584/apiserver.key.c375770f ...
I0814 17:27:52.805605 72662 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19446-13977/.minikube/profiles/old-k8s-version-505584/apiserver.key.c375770f: {Name:mk6746c5cbc748dfc8e79501331852d509f9228f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0814 17:27:52.805723 72662 certs.go:381] copying /home/jenkins/minikube-integration/19446-13977/.minikube/profiles/old-k8s-version-505584/apiserver.crt.c375770f -> /home/jenkins/minikube-integration/19446-13977/.minikube/profiles/old-k8s-version-505584/apiserver.crt
I0814 17:27:52.805840 72662 certs.go:385] copying /home/jenkins/minikube-integration/19446-13977/.minikube/profiles/old-k8s-version-505584/apiserver.key.c375770f -> /home/jenkins/minikube-integration/19446-13977/.minikube/profiles/old-k8s-version-505584/apiserver.key
I0814 17:27:52.805915 72662 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19446-13977/.minikube/profiles/old-k8s-version-505584/proxy-client.key
I0814 17:27:52.805939 72662 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19446-13977/.minikube/profiles/old-k8s-version-505584/proxy-client.crt with IP's: []
I0814 17:27:52.982963 72662 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19446-13977/.minikube/profiles/old-k8s-version-505584/proxy-client.crt ...
I0814 17:27:52.982990 72662 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19446-13977/.minikube/profiles/old-k8s-version-505584/proxy-client.crt: {Name:mkd62ff6274f8cc03701ab851fce9c650c61b746 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0814 17:27:52.983123 72662 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19446-13977/.minikube/profiles/old-k8s-version-505584/proxy-client.key ...
I0814 17:27:52.983131 72662 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19446-13977/.minikube/profiles/old-k8s-version-505584/proxy-client.key: {Name:mkbcaffff4bf559bddaae242509311c03ab01786 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0814 17:27:52.983273 72662 certs.go:484] found cert: /home/jenkins/minikube-integration/19446-13977/.minikube/certs/21177.pem (1338 bytes)
W0814 17:27:52.983304 72662 certs.go:480] ignoring /home/jenkins/minikube-integration/19446-13977/.minikube/certs/21177_empty.pem, impossibly tiny 0 bytes
I0814 17:27:52.983311 72662 certs.go:484] found cert: /home/jenkins/minikube-integration/19446-13977/.minikube/certs/ca-key.pem (1679 bytes)
I0814 17:27:52.983377 72662 certs.go:484] found cert: /home/jenkins/minikube-integration/19446-13977/.minikube/certs/ca.pem (1078 bytes)
I0814 17:27:52.983408 72662 certs.go:484] found cert: /home/jenkins/minikube-integration/19446-13977/.minikube/certs/cert.pem (1123 bytes)
I0814 17:27:52.983430 72662 certs.go:484] found cert: /home/jenkins/minikube-integration/19446-13977/.minikube/certs/key.pem (1679 bytes)
I0814 17:27:52.983469 72662 certs.go:484] found cert: /home/jenkins/minikube-integration/19446-13977/.minikube/files/etc/ssl/certs/211772.pem (1708 bytes)
I0814 17:27:52.984093 72662 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19446-13977/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0814 17:27:53.017968 72662 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19446-13977/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0814 17:27:53.051822 72662 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19446-13977/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0814 17:27:53.074881 72662 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19446-13977/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0814 17:27:53.101409 72662 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19446-13977/.minikube/profiles/old-k8s-version-505584/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0814 17:27:53.127782 72662 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19446-13977/.minikube/profiles/old-k8s-version-505584/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0814 17:27:53.154298 72662 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19446-13977/.minikube/profiles/old-k8s-version-505584/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0814 17:27:53.177850 72662 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19446-13977/.minikube/profiles/old-k8s-version-505584/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0814 17:27:53.201585 72662 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19446-13977/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0814 17:27:53.224401 72662 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19446-13977/.minikube/certs/21177.pem --> /usr/share/ca-certificates/21177.pem (1338 bytes)
I0814 17:27:53.248737 72662 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19446-13977/.minikube/files/etc/ssl/certs/211772.pem --> /usr/share/ca-certificates/211772.pem (1708 bytes)
I0814 17:27:53.276893 72662 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0814 17:27:53.299410 72662 ssh_runner.go:195] Run: openssl version
I0814 17:27:53.306856 72662 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/21177.pem && ln -fs /usr/share/ca-certificates/21177.pem /etc/ssl/certs/21177.pem"
I0814 17:27:53.320077 72662 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/21177.pem
I0814 17:27:53.324904 72662 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug 14 16:22 /usr/share/ca-certificates/21177.pem
I0814 17:27:53.324967 72662 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/21177.pem
I0814 17:27:53.330897 72662 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/21177.pem /etc/ssl/certs/51391683.0"
I0814 17:27:53.342461 72662 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/211772.pem && ln -fs /usr/share/ca-certificates/211772.pem /etc/ssl/certs/211772.pem"
I0814 17:27:53.352865 72662 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/211772.pem
I0814 17:27:53.357650 72662 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug 14 16:22 /usr/share/ca-certificates/211772.pem
I0814 17:27:53.357708 72662 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/211772.pem
I0814 17:27:53.364231 72662 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/211772.pem /etc/ssl/certs/3ec20f2e.0"
I0814 17:27:53.376889 72662 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0814 17:27:53.388282 72662 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0814 17:27:53.392495 72662 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug 14 16:10 /usr/share/ca-certificates/minikubeCA.pem
I0814 17:27:53.392564 72662 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0814 17:27:53.397926 72662 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0814 17:27:53.408229 72662 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0814 17:27:53.411990 72662 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0814 17:27:53.412054 72662 kubeadm.go:392] StartCluster: {Name:old-k8s-version-505584 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19429/minikube-v1.33.1-1723567878-19429-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723567951-19429@sha256:cdfb2e55e95c0c0e857baca4796fc9879d11f99617f48df875a23169fed0e083 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-505584 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.49 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0814 17:27:53.412124 72662 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0814 17:27:53.412163 72662 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0814 17:27:53.460105 72662 cri.go:89] found id: ""
I0814 17:27:53.460182 72662 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0814 17:27:53.472352 72662 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0814 17:27:53.486285 72662 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0814 17:27:53.518476 72662 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0814 17:27:53.518502 72662 kubeadm.go:157] found existing configuration files:
I0814 17:27:53.518573 72662 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0814 17:27:53.530768 72662 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0814 17:27:53.530833 72662 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0814 17:27:53.541222 72662 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0814 17:27:53.553223 72662 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0814 17:27:53.553293 72662 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0814 17:27:53.564999 72662 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0814 17:27:53.583032 72662 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0814 17:27:53.583114 72662 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0814 17:27:53.598484 72662 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0814 17:27:53.609365 72662 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0814 17:27:53.609423 72662 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0814 17:27:53.627847 72662 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0814 17:27:53.794609 72662 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0814 17:27:53.794691 72662 kubeadm.go:310] [preflight] Running pre-flight checks
I0814 17:27:53.973374 72662 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0814 17:27:53.973512 72662 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0814 17:27:53.973662 72662 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0814 17:27:54.157516 72662 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0814 17:27:54.159931 72662 out.go:204] - Generating certificates and keys ...
I0814 17:27:54.160028 72662 kubeadm.go:310] [certs] Using existing ca certificate authority
I0814 17:27:54.160120 72662 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0814 17:27:54.586225 72662 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0814 17:27:54.682159 72662 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0814 17:27:54.998263 72662 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0814 17:27:55.202222 72662 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0814 17:27:55.307668 72662 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0814 17:27:55.307931 72662 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-505584] and IPs [192.168.72.49 127.0.0.1 ::1]
I0814 17:27:55.404115 72662 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0814 17:27:55.404421 72662 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-505584] and IPs [192.168.72.49 127.0.0.1 ::1]
I0814 17:27:55.486494 72662 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0814 17:27:55.595705 72662 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0814 17:27:55.736109 72662 kubeadm.go:310] [certs] Generating "sa" key and public key
I0814 17:27:55.736546 72662 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0814 17:27:56.161714 72662 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0814 17:27:56.399073 72662 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0814 17:27:56.726851 72662 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0814 17:27:57.116751 72662 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0814 17:27:57.135674 72662 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0814 17:27:57.137146 72662 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0814 17:27:57.137361 72662 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0814 17:27:57.324060 72662 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0814 17:27:57.325988 72662 out.go:204] - Booting up control plane ...
I0814 17:27:57.326111 72662 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0814 17:27:57.339831 72662 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0814 17:27:57.343296 72662 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0814 17:27:57.343420 72662 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0814 17:27:57.347265 72662 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0814 17:28:37.344974 72662 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0814 17:28:37.345148 72662 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0814 17:28:37.345430 72662 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0814 17:28:42.346185 72662 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0814 17:28:42.346379 72662 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0814 17:28:52.346771 72662 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0814 17:28:52.346978 72662 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0814 17:29:12.348151 72662 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0814 17:29:12.348426 72662 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0814 17:29:52.349053 72662 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0814 17:29:52.349473 72662 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0814 17:29:52.349502 72662 kubeadm.go:310]
I0814 17:29:52.349577 72662 kubeadm.go:310] Unfortunately, an error has occurred:
I0814 17:29:52.349676 72662 kubeadm.go:310] timed out waiting for the condition
I0814 17:29:52.349691 72662 kubeadm.go:310]
I0814 17:29:52.349776 72662 kubeadm.go:310] This error is likely caused by:
I0814 17:29:52.349860 72662 kubeadm.go:310] - The kubelet is not running
I0814 17:29:52.350129 72662 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0814 17:29:52.350158 72662 kubeadm.go:310]
I0814 17:29:52.350399 72662 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0814 17:29:52.350491 72662 kubeadm.go:310] - 'systemctl status kubelet'
I0814 17:29:52.350576 72662 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0814 17:29:52.350588 72662 kubeadm.go:310]
I0814 17:29:52.350847 72662 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0814 17:29:52.351001 72662 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0814 17:29:52.351015 72662 kubeadm.go:310]
I0814 17:29:52.351507 72662 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0814 17:29:52.351716 72662 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0814 17:29:52.351904 72662 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0814 17:29:52.352091 72662 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0814 17:29:52.352122 72662 kubeadm.go:310]
I0814 17:29:52.352503 72662 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0814 17:29:52.352618 72662 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0814 17:29:52.352791 72662 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
W0814 17:29:52.352845 72662 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-505584] and IPs [192.168.72.49 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-505584] and IPs [192.168.72.49 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-505584] and IPs [192.168.72.49 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-505584] and IPs [192.168.72.49 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0814 17:29:52.352893 72662 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0814 17:29:53.347294 72662 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0814 17:29:53.361259 72662 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0814 17:29:53.370419 72662 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0814 17:29:53.370442 72662 kubeadm.go:157] found existing configuration files:
I0814 17:29:53.370495 72662 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0814 17:29:53.379060 72662 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0814 17:29:53.379121 72662 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0814 17:29:53.387615 72662 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0814 17:29:53.396049 72662 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0814 17:29:53.396099 72662 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0814 17:29:53.404861 72662 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0814 17:29:53.413527 72662 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0814 17:29:53.413578 72662 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0814 17:29:53.423650 72662 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0814 17:29:53.432946 72662 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0814 17:29:53.432995 72662 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0814 17:29:53.442805 72662 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0814 17:29:53.646573 72662 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0814 17:31:50.045667 72662 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0814 17:31:50.045790 72662 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0814 17:31:50.047209 72662 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0814 17:31:50.047277 72662 kubeadm.go:310] [preflight] Running pre-flight checks
I0814 17:31:50.047402 72662 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0814 17:31:50.047535 72662 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0814 17:31:50.047662 72662 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0814 17:31:50.047760 72662 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0814 17:31:50.049488 72662 out.go:204] - Generating certificates and keys ...
I0814 17:31:50.049566 72662 kubeadm.go:310] [certs] Using existing ca certificate authority
I0814 17:31:50.049631 72662 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0814 17:31:50.049715 72662 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0814 17:31:50.049790 72662 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0814 17:31:50.049870 72662 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0814 17:31:50.049933 72662 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0814 17:31:50.050001 72662 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0814 17:31:50.050089 72662 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0814 17:31:50.050187 72662 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0814 17:31:50.050276 72662 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0814 17:31:50.050330 72662 kubeadm.go:310] [certs] Using the existing "sa" key
I0814 17:31:50.050379 72662 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0814 17:31:50.050426 72662 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0814 17:31:50.050504 72662 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0814 17:31:50.050618 72662 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0814 17:31:50.050697 72662 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0814 17:31:50.050848 72662 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0814 17:31:50.050990 72662 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0814 17:31:50.051055 72662 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0814 17:31:50.051151 72662 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0814 17:31:50.052358 72662 out.go:204] - Booting up control plane ...
I0814 17:31:50.052441 72662 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0814 17:31:50.052504 72662 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0814 17:31:50.052569 72662 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0814 17:31:50.052636 72662 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0814 17:31:50.052772 72662 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0814 17:31:50.052820 72662 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0814 17:31:50.052877 72662 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0814 17:31:50.053045 72662 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0814 17:31:50.053103 72662 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0814 17:31:50.053330 72662 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0814 17:31:50.053436 72662 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0814 17:31:50.053691 72662 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0814 17:31:50.053753 72662 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0814 17:31:50.053919 72662 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0814 17:31:50.053988 72662 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0814 17:31:50.054157 72662 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0814 17:31:50.054168 72662 kubeadm.go:310]
I0814 17:31:50.054204 72662 kubeadm.go:310] Unfortunately, an error has occurred:
I0814 17:31:50.054238 72662 kubeadm.go:310] timed out waiting for the condition
I0814 17:31:50.054251 72662 kubeadm.go:310]
I0814 17:31:50.054294 72662 kubeadm.go:310] This error is likely caused by:
I0814 17:31:50.054324 72662 kubeadm.go:310] - The kubelet is not running
I0814 17:31:50.054423 72662 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0814 17:31:50.054431 72662 kubeadm.go:310]
I0814 17:31:50.054518 72662 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0814 17:31:50.054547 72662 kubeadm.go:310] - 'systemctl status kubelet'
I0814 17:31:50.054576 72662 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0814 17:31:50.054582 72662 kubeadm.go:310]
I0814 17:31:50.054674 72662 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0814 17:31:50.054743 72662 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0814 17:31:50.054749 72662 kubeadm.go:310]
I0814 17:31:50.054836 72662 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0814 17:31:50.054924 72662 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0814 17:31:50.055010 72662 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0814 17:31:50.055075 72662 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0814 17:31:50.055088 72662 kubeadm.go:310]
I0814 17:31:50.055135 72662 kubeadm.go:394] duration metric: took 3m56.643087939s to StartCluster
I0814 17:31:50.055173 72662 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0814 17:31:50.055228 72662 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0814 17:31:50.093729 72662 cri.go:89] found id: ""
I0814 17:31:50.093756 72662 logs.go:276] 0 containers: []
W0814 17:31:50.093766 72662 logs.go:278] No container was found matching "kube-apiserver"
I0814 17:31:50.093774 72662 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0814 17:31:50.093838 72662 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0814 17:31:50.124777 72662 cri.go:89] found id: ""
I0814 17:31:50.124814 72662 logs.go:276] 0 containers: []
W0814 17:31:50.124825 72662 logs.go:278] No container was found matching "etcd"
I0814 17:31:50.124833 72662 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0814 17:31:50.124889 72662 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0814 17:31:50.156802 72662 cri.go:89] found id: ""
I0814 17:31:50.156832 72662 logs.go:276] 0 containers: []
W0814 17:31:50.156844 72662 logs.go:278] No container was found matching "coredns"
I0814 17:31:50.156852 72662 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0814 17:31:50.156900 72662 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0814 17:31:50.187764 72662 cri.go:89] found id: ""
I0814 17:31:50.187797 72662 logs.go:276] 0 containers: []
W0814 17:31:50.187809 72662 logs.go:278] No container was found matching "kube-scheduler"
I0814 17:31:50.187817 72662 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0814 17:31:50.187867 72662 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0814 17:31:50.219830 72662 cri.go:89] found id: ""
I0814 17:31:50.219865 72662 logs.go:276] 0 containers: []
W0814 17:31:50.219874 72662 logs.go:278] No container was found matching "kube-proxy"
I0814 17:31:50.219881 72662 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0814 17:31:50.219931 72662 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0814 17:31:50.251107 72662 cri.go:89] found id: ""
I0814 17:31:50.251133 72662 logs.go:276] 0 containers: []
W0814 17:31:50.251143 72662 logs.go:278] No container was found matching "kube-controller-manager"
I0814 17:31:50.251149 72662 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0814 17:31:50.251199 72662 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0814 17:31:50.285694 72662 cri.go:89] found id: ""
I0814 17:31:50.285730 72662 logs.go:276] 0 containers: []
W0814 17:31:50.285740 72662 logs.go:278] No container was found matching "kindnet"
I0814 17:31:50.285752 72662 logs.go:123] Gathering logs for CRI-O ...
I0814 17:31:50.285768 72662 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0814 17:31:50.385313 72662 logs.go:123] Gathering logs for container status ...
I0814 17:31:50.385359 72662 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0814 17:31:50.421906 72662 logs.go:123] Gathering logs for kubelet ...
I0814 17:31:50.421939 72662 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0814 17:31:50.475561 72662 logs.go:123] Gathering logs for dmesg ...
I0814 17:31:50.475597 72662 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0814 17:31:50.497635 72662 logs.go:123] Gathering logs for describe nodes ...
I0814 17:31:50.497676 72662 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0814 17:31:50.621268 72662 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
W0814 17:31:50.621311 72662 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0814 17:31:50.621351 72662 out.go:239] *
*
W0814 17:31:50.621402 72662 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0814 17:31:50.621424 72662 out.go:239] *
*
W0814 17:31:50.622258 72662 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0814 17:31:50.625018 72662 out.go:177]
W0814 17:31:50.626121 72662 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0814 17:31:50.626184 72662 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0814 17:31:50.626217 72662 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0814 17:31:50.627756 72662 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-505584 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-505584 -n old-k8s-version-505584
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-505584 -n old-k8s-version-505584: exit status 6 (214.524735ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0814 17:31:50.881895 79238 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-505584" does not appear in /home/jenkins/minikube-integration/19446-13977/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-505584" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (289.57s)