=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-188043 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-188043 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m55.275814519s)
-- stdout --
* [old-k8s-version-188043] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=19337
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19337-3845/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19337-3845/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-188043" primary control-plane node in "old-k8s-version-188043" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0729 11:37:44.467382 62801 out.go:291] Setting OutFile to fd 1 ...
I0729 11:37:44.467517 62801 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0729 11:37:44.467529 62801 out.go:304] Setting ErrFile to fd 2...
I0729 11:37:44.467535 62801 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0729 11:37:44.467788 62801 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19337-3845/.minikube/bin
I0729 11:37:44.468447 62801 out.go:298] Setting JSON to false
I0729 11:37:44.469572 62801 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-10","uptime":4810,"bootTime":1722248254,"procs":356,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1062-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0729 11:37:44.469635 62801 start.go:139] virtualization: kvm guest
I0729 11:37:44.471938 62801 out.go:177] * [old-k8s-version-188043] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
I0729 11:37:44.473622 62801 notify.go:220] Checking for updates...
I0729 11:37:44.473625 62801 out.go:177] - MINIKUBE_LOCATION=19337
I0729 11:37:44.475351 62801 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0729 11:37:44.476888 62801 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19337-3845/kubeconfig
I0729 11:37:44.478441 62801 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19337-3845/.minikube
I0729 11:37:44.479729 62801 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0729 11:37:44.481218 62801 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0729 11:37:44.483196 62801 config.go:182] Loaded profile config "bridge-184479": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3
I0729 11:37:44.483320 62801 config.go:182] Loaded profile config "enable-default-cni-184479": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3
I0729 11:37:44.483425 62801 config.go:182] Loaded profile config "flannel-184479": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3
I0729 11:37:44.483536 62801 driver.go:392] Setting default libvirt URI to qemu:///system
I0729 11:37:44.523035 62801 out.go:177] * Using the kvm2 driver based on user configuration
I0729 11:37:44.524362 62801 start.go:297] selected driver: kvm2
I0729 11:37:44.524377 62801 start.go:901] validating driver "kvm2" against <nil>
I0729 11:37:44.524393 62801 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0729 11:37:44.525450 62801 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0729 11:37:44.525555 62801 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19337-3845/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0729 11:37:44.542605 62801 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.1
I0729 11:37:44.542664 62801 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0729 11:37:44.542988 62801 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0729 11:37:44.543019 62801 cni.go:84] Creating CNI manager for ""
I0729 11:37:44.543026 62801 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0729 11:37:44.543039 62801 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0729 11:37:44.543099 62801 start.go:340] cluster config:
{Name:old-k8s-version-188043 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-188043 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0729 11:37:44.543189 62801 iso.go:125] acquiring lock: {Name:mkfc7ba7ca67cc52aa65b4f99222d1f891c3ec47 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0729 11:37:44.545078 62801 out.go:177] * Starting "old-k8s-version-188043" primary control-plane node in "old-k8s-version-188043" cluster
I0729 11:37:44.546725 62801 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0729 11:37:44.546770 62801 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19337-3845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0729 11:37:44.546781 62801 cache.go:56] Caching tarball of preloaded images
I0729 11:37:44.546917 62801 preload.go:172] Found /home/jenkins/minikube-integration/19337-3845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0729 11:37:44.546931 62801 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0729 11:37:44.547042 62801 profile.go:143] Saving config to /home/jenkins/minikube-integration/19337-3845/.minikube/profiles/old-k8s-version-188043/config.json ...
I0729 11:37:44.547069 62801 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19337-3845/.minikube/profiles/old-k8s-version-188043/config.json: {Name:mk199d555658bbb4bbc6505ef9f8fdfe0542314e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 11:37:44.547234 62801 start.go:360] acquireMachinesLock for old-k8s-version-188043: {Name:mka8aac8533d9522bdb868559ea7715123a1a351 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0729 11:38:06.799819 62801 start.go:364] duration metric: took 22.252547749s to acquireMachinesLock for "old-k8s-version-188043"
I0729 11:38:06.799884 62801 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-188043 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19319/minikube-v1.33.1-1721690939-19319-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-188043 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0729 11:38:06.800026 62801 start.go:125] createHost starting for "" (driver="kvm2")
I0729 11:38:06.802365 62801 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0729 11:38:06.802586 62801 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0729 11:38:06.802642 62801 main.go:141] libmachine: Launching plugin server for driver kvm2
I0729 11:38:06.822399 62801 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40401
I0729 11:38:06.822819 62801 main.go:141] libmachine: () Calling .GetVersion
I0729 11:38:06.823500 62801 main.go:141] libmachine: Using API Version 1
I0729 11:38:06.823544 62801 main.go:141] libmachine: () Calling .SetConfigRaw
I0729 11:38:06.823861 62801 main.go:141] libmachine: () Calling .GetMachineName
I0729 11:38:06.824062 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetMachineName
I0729 11:38:06.824225 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .DriverName
I0729 11:38:06.824371 62801 start.go:159] libmachine.API.Create for "old-k8s-version-188043" (driver="kvm2")
I0729 11:38:06.824408 62801 client.go:168] LocalClient.Create starting
I0729 11:38:06.824442 62801 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19337-3845/.minikube/certs/ca.pem
I0729 11:38:06.824478 62801 main.go:141] libmachine: Decoding PEM data...
I0729 11:38:06.824495 62801 main.go:141] libmachine: Parsing certificate...
I0729 11:38:06.824538 62801 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19337-3845/.minikube/certs/cert.pem
I0729 11:38:06.824555 62801 main.go:141] libmachine: Decoding PEM data...
I0729 11:38:06.824565 62801 main.go:141] libmachine: Parsing certificate...
I0729 11:38:06.824580 62801 main.go:141] libmachine: Running pre-create checks...
I0729 11:38:06.824588 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .PreCreateCheck
I0729 11:38:06.824994 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetConfigRaw
I0729 11:38:06.825390 62801 main.go:141] libmachine: Creating machine...
I0729 11:38:06.825404 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .Create
I0729 11:38:06.825524 62801 main.go:141] libmachine: (old-k8s-version-188043) Creating KVM machine...
I0729 11:38:06.826890 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | found existing default KVM network
I0729 11:38:06.828116 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | I0729 11:38:06.827934 63062 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:65:1f:02} reservation:<nil>}
I0729 11:38:06.829304 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | I0729 11:38:06.829215 63062 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr3 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:24:8b:80} reservation:<nil>}
I0729 11:38:06.830308 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | I0729 11:38:06.830210 63062 network.go:211] skipping subnet 192.168.61.0/24 that is taken: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.61.1 IfaceMTU:1500 IfaceMAC:52:54:00:5b:d5:72} reservation:<nil>}
I0729 11:38:06.831596 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | I0729 11:38:06.831517 63062 network.go:206] using free private subnet 192.168.72.0/24: &{IP:192.168.72.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.72.0/24 Gateway:192.168.72.1 ClientMin:192.168.72.2 ClientMax:192.168.72.254 Broadcast:192.168.72.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000289a90}
I0729 11:38:06.831646 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | created network xml:
I0729 11:38:06.831679 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | <network>
I0729 11:38:06.831693 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | <name>mk-old-k8s-version-188043</name>
I0729 11:38:06.831701 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | <dns enable='no'/>
I0729 11:38:06.831706 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG |
I0729 11:38:06.831714 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | <ip address='192.168.72.1' netmask='255.255.255.0'>
I0729 11:38:06.831725 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | <dhcp>
I0729 11:38:06.831737 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | <range start='192.168.72.2' end='192.168.72.253'/>
I0729 11:38:06.831746 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | </dhcp>
I0729 11:38:06.831764 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | </ip>
I0729 11:38:06.831775 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG |
I0729 11:38:06.831785 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | </network>
I0729 11:38:06.831797 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG |
I0729 11:38:06.837379 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | trying to create private KVM network mk-old-k8s-version-188043 192.168.72.0/24...
I0729 11:38:06.914177 62801 main.go:141] libmachine: (old-k8s-version-188043) Setting up store path in /home/jenkins/minikube-integration/19337-3845/.minikube/machines/old-k8s-version-188043 ...
I0729 11:38:06.914210 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | private KVM network mk-old-k8s-version-188043 192.168.72.0/24 created
I0729 11:38:06.914224 62801 main.go:141] libmachine: (old-k8s-version-188043) Building disk image from file:///home/jenkins/minikube-integration/19337-3845/.minikube/cache/iso/amd64/minikube-v1.33.1-1721690939-19319-amd64.iso
I0729 11:38:06.914267 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | I0729 11:38:06.914093 63062 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19337-3845/.minikube
I0729 11:38:06.914322 62801 main.go:141] libmachine: (old-k8s-version-188043) Downloading /home/jenkins/minikube-integration/19337-3845/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19337-3845/.minikube/cache/iso/amd64/minikube-v1.33.1-1721690939-19319-amd64.iso...
I0729 11:38:07.157363 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | I0729 11:38:07.157250 63062 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19337-3845/.minikube/machines/old-k8s-version-188043/id_rsa...
I0729 11:38:07.250307 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | I0729 11:38:07.250179 63062 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19337-3845/.minikube/machines/old-k8s-version-188043/old-k8s-version-188043.rawdisk...
I0729 11:38:07.250335 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | Writing magic tar header
I0729 11:38:07.250353 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | Writing SSH key tar header
I0729 11:38:07.250439 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | I0729 11:38:07.250359 63062 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19337-3845/.minikube/machines/old-k8s-version-188043 ...
I0729 11:38:07.250474 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19337-3845/.minikube/machines/old-k8s-version-188043
I0729 11:38:07.250536 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19337-3845/.minikube/machines
I0729 11:38:07.250563 62801 main.go:141] libmachine: (old-k8s-version-188043) Setting executable bit set on /home/jenkins/minikube-integration/19337-3845/.minikube/machines/old-k8s-version-188043 (perms=drwx------)
I0729 11:38:07.250572 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19337-3845/.minikube
I0729 11:38:07.250582 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19337-3845
I0729 11:38:07.250591 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0729 11:38:07.250598 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | Checking permissions on dir: /home/jenkins
I0729 11:38:07.250605 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | Checking permissions on dir: /home
I0729 11:38:07.250613 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | Skipping /home - not owner
I0729 11:38:07.250627 62801 main.go:141] libmachine: (old-k8s-version-188043) Setting executable bit set on /home/jenkins/minikube-integration/19337-3845/.minikube/machines (perms=drwxr-xr-x)
I0729 11:38:07.250642 62801 main.go:141] libmachine: (old-k8s-version-188043) Setting executable bit set on /home/jenkins/minikube-integration/19337-3845/.minikube (perms=drwxr-xr-x)
I0729 11:38:07.250655 62801 main.go:141] libmachine: (old-k8s-version-188043) Setting executable bit set on /home/jenkins/minikube-integration/19337-3845 (perms=drwxrwxr-x)
I0729 11:38:07.250682 62801 main.go:141] libmachine: (old-k8s-version-188043) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0729 11:38:07.250738 62801 main.go:141] libmachine: (old-k8s-version-188043) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0729 11:38:07.250756 62801 main.go:141] libmachine: (old-k8s-version-188043) Creating domain...
I0729 11:38:07.251878 62801 main.go:141] libmachine: (old-k8s-version-188043) define libvirt domain using xml:
I0729 11:38:07.251905 62801 main.go:141] libmachine: (old-k8s-version-188043) <domain type='kvm'>
I0729 11:38:07.251917 62801 main.go:141] libmachine: (old-k8s-version-188043) <name>old-k8s-version-188043</name>
I0729 11:38:07.251925 62801 main.go:141] libmachine: (old-k8s-version-188043) <memory unit='MiB'>2200</memory>
I0729 11:38:07.251936 62801 main.go:141] libmachine: (old-k8s-version-188043) <vcpu>2</vcpu>
I0729 11:38:07.251946 62801 main.go:141] libmachine: (old-k8s-version-188043) <features>
I0729 11:38:07.251978 62801 main.go:141] libmachine: (old-k8s-version-188043) <acpi/>
I0729 11:38:07.252008 62801 main.go:141] libmachine: (old-k8s-version-188043) <apic/>
I0729 11:38:07.252022 62801 main.go:141] libmachine: (old-k8s-version-188043) <pae/>
I0729 11:38:07.252034 62801 main.go:141] libmachine: (old-k8s-version-188043)
I0729 11:38:07.252046 62801 main.go:141] libmachine: (old-k8s-version-188043) </features>
I0729 11:38:07.252056 62801 main.go:141] libmachine: (old-k8s-version-188043) <cpu mode='host-passthrough'>
I0729 11:38:07.252068 62801 main.go:141] libmachine: (old-k8s-version-188043)
I0729 11:38:07.252078 62801 main.go:141] libmachine: (old-k8s-version-188043) </cpu>
I0729 11:38:07.252086 62801 main.go:141] libmachine: (old-k8s-version-188043) <os>
I0729 11:38:07.252096 62801 main.go:141] libmachine: (old-k8s-version-188043) <type>hvm</type>
I0729 11:38:07.252125 62801 main.go:141] libmachine: (old-k8s-version-188043) <boot dev='cdrom'/>
I0729 11:38:07.252147 62801 main.go:141] libmachine: (old-k8s-version-188043) <boot dev='hd'/>
I0729 11:38:07.252163 62801 main.go:141] libmachine: (old-k8s-version-188043) <bootmenu enable='no'/>
I0729 11:38:07.252174 62801 main.go:141] libmachine: (old-k8s-version-188043) </os>
I0729 11:38:07.252193 62801 main.go:141] libmachine: (old-k8s-version-188043) <devices>
I0729 11:38:07.252205 62801 main.go:141] libmachine: (old-k8s-version-188043) <disk type='file' device='cdrom'>
I0729 11:38:07.252222 62801 main.go:141] libmachine: (old-k8s-version-188043) <source file='/home/jenkins/minikube-integration/19337-3845/.minikube/machines/old-k8s-version-188043/boot2docker.iso'/>
I0729 11:38:07.252237 62801 main.go:141] libmachine: (old-k8s-version-188043) <target dev='hdc' bus='scsi'/>
I0729 11:38:07.252249 62801 main.go:141] libmachine: (old-k8s-version-188043) <readonly/>
I0729 11:38:07.252259 62801 main.go:141] libmachine: (old-k8s-version-188043) </disk>
I0729 11:38:07.252272 62801 main.go:141] libmachine: (old-k8s-version-188043) <disk type='file' device='disk'>
I0729 11:38:07.252284 62801 main.go:141] libmachine: (old-k8s-version-188043) <driver name='qemu' type='raw' cache='default' io='threads' />
I0729 11:38:07.252300 62801 main.go:141] libmachine: (old-k8s-version-188043) <source file='/home/jenkins/minikube-integration/19337-3845/.minikube/machines/old-k8s-version-188043/old-k8s-version-188043.rawdisk'/>
I0729 11:38:07.252315 62801 main.go:141] libmachine: (old-k8s-version-188043) <target dev='hda' bus='virtio'/>
I0729 11:38:07.252326 62801 main.go:141] libmachine: (old-k8s-version-188043) </disk>
I0729 11:38:07.252337 62801 main.go:141] libmachine: (old-k8s-version-188043) <interface type='network'>
I0729 11:38:07.252351 62801 main.go:141] libmachine: (old-k8s-version-188043) <source network='mk-old-k8s-version-188043'/>
I0729 11:38:07.252361 62801 main.go:141] libmachine: (old-k8s-version-188043) <model type='virtio'/>
I0729 11:38:07.252374 62801 main.go:141] libmachine: (old-k8s-version-188043) </interface>
I0729 11:38:07.252388 62801 main.go:141] libmachine: (old-k8s-version-188043) <interface type='network'>
I0729 11:38:07.252401 62801 main.go:141] libmachine: (old-k8s-version-188043) <source network='default'/>
I0729 11:38:07.252411 62801 main.go:141] libmachine: (old-k8s-version-188043) <model type='virtio'/>
I0729 11:38:07.252423 62801 main.go:141] libmachine: (old-k8s-version-188043) </interface>
I0729 11:38:07.252432 62801 main.go:141] libmachine: (old-k8s-version-188043) <serial type='pty'>
I0729 11:38:07.252443 62801 main.go:141] libmachine: (old-k8s-version-188043) <target port='0'/>
I0729 11:38:07.252452 62801 main.go:141] libmachine: (old-k8s-version-188043) </serial>
I0729 11:38:07.252463 62801 main.go:141] libmachine: (old-k8s-version-188043) <console type='pty'>
I0729 11:38:07.252474 62801 main.go:141] libmachine: (old-k8s-version-188043) <target type='serial' port='0'/>
I0729 11:38:07.252484 62801 main.go:141] libmachine: (old-k8s-version-188043) </console>
I0729 11:38:07.252507 62801 main.go:141] libmachine: (old-k8s-version-188043) <rng model='virtio'>
I0729 11:38:07.252536 62801 main.go:141] libmachine: (old-k8s-version-188043) <backend model='random'>/dev/random</backend>
I0729 11:38:07.252554 62801 main.go:141] libmachine: (old-k8s-version-188043) </rng>
I0729 11:38:07.252566 62801 main.go:141] libmachine: (old-k8s-version-188043)
I0729 11:38:07.252576 62801 main.go:141] libmachine: (old-k8s-version-188043)
I0729 11:38:07.252586 62801 main.go:141] libmachine: (old-k8s-version-188043) </devices>
I0729 11:38:07.252590 62801 main.go:141] libmachine: (old-k8s-version-188043) </domain>
I0729 11:38:07.252619 62801 main.go:141] libmachine: (old-k8s-version-188043)
I0729 11:38:07.257031 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has defined MAC address 52:54:00:03:0e:bc in network default
I0729 11:38:07.257725 62801 main.go:141] libmachine: (old-k8s-version-188043) Ensuring networks are active...
I0729 11:38:07.257755 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has defined MAC address 52:54:00:0b:d7:0d in network mk-old-k8s-version-188043
I0729 11:38:07.258540 62801 main.go:141] libmachine: (old-k8s-version-188043) Ensuring network default is active
I0729 11:38:07.258936 62801 main.go:141] libmachine: (old-k8s-version-188043) Ensuring network mk-old-k8s-version-188043 is active
I0729 11:38:07.259642 62801 main.go:141] libmachine: (old-k8s-version-188043) Getting domain xml...
I0729 11:38:07.260681 62801 main.go:141] libmachine: (old-k8s-version-188043) Creating domain...
I0729 11:38:08.695775 62801 main.go:141] libmachine: (old-k8s-version-188043) Waiting to get IP...
I0729 11:38:08.696485 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has defined MAC address 52:54:00:0b:d7:0d in network mk-old-k8s-version-188043
I0729 11:38:08.696999 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | unable to find current IP address of domain old-k8s-version-188043 in network mk-old-k8s-version-188043
I0729 11:38:08.697025 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | I0729 11:38:08.696970 63062 retry.go:31] will retry after 300.784515ms: waiting for machine to come up
I0729 11:38:08.999840 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has defined MAC address 52:54:00:0b:d7:0d in network mk-old-k8s-version-188043
I0729 11:38:09.000378 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | unable to find current IP address of domain old-k8s-version-188043 in network mk-old-k8s-version-188043
I0729 11:38:09.000410 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | I0729 11:38:09.000335 63062 retry.go:31] will retry after 287.835559ms: waiting for machine to come up
I0729 11:38:09.289767 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has defined MAC address 52:54:00:0b:d7:0d in network mk-old-k8s-version-188043
I0729 11:38:09.290680 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | unable to find current IP address of domain old-k8s-version-188043 in network mk-old-k8s-version-188043
I0729 11:38:09.290728 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | I0729 11:38:09.290655 63062 retry.go:31] will retry after 482.787423ms: waiting for machine to come up
I0729 11:38:09.775249 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has defined MAC address 52:54:00:0b:d7:0d in network mk-old-k8s-version-188043
I0729 11:38:09.775838 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | unable to find current IP address of domain old-k8s-version-188043 in network mk-old-k8s-version-188043
I0729 11:38:09.775881 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | I0729 11:38:09.775779 63062 retry.go:31] will retry after 528.438047ms: waiting for machine to come up
I0729 11:38:10.305686 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has defined MAC address 52:54:00:0b:d7:0d in network mk-old-k8s-version-188043
I0729 11:38:10.306362 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | unable to find current IP address of domain old-k8s-version-188043 in network mk-old-k8s-version-188043
I0729 11:38:10.306399 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | I0729 11:38:10.306278 63062 retry.go:31] will retry after 526.52016ms: waiting for machine to come up
I0729 11:38:10.834641 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has defined MAC address 52:54:00:0b:d7:0d in network mk-old-k8s-version-188043
I0729 11:38:10.835139 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | unable to find current IP address of domain old-k8s-version-188043 in network mk-old-k8s-version-188043
I0729 11:38:10.835187 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | I0729 11:38:10.835098 63062 retry.go:31] will retry after 704.754339ms: waiting for machine to come up
I0729 11:38:11.541194 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has defined MAC address 52:54:00:0b:d7:0d in network mk-old-k8s-version-188043
I0729 11:38:11.541778 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | unable to find current IP address of domain old-k8s-version-188043 in network mk-old-k8s-version-188043
I0729 11:38:11.541800 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | I0729 11:38:11.541720 63062 retry.go:31] will retry after 767.808693ms: waiting for machine to come up
I0729 11:38:12.310906 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has defined MAC address 52:54:00:0b:d7:0d in network mk-old-k8s-version-188043
I0729 11:38:12.311467 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | unable to find current IP address of domain old-k8s-version-188043 in network mk-old-k8s-version-188043
I0729 11:38:12.311497 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | I0729 11:38:12.311422 63062 retry.go:31] will retry after 1.238280592s: waiting for machine to come up
I0729 11:38:13.551994 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has defined MAC address 52:54:00:0b:d7:0d in network mk-old-k8s-version-188043
I0729 11:38:13.552549 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | unable to find current IP address of domain old-k8s-version-188043 in network mk-old-k8s-version-188043
I0729 11:38:13.552571 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | I0729 11:38:13.552512 63062 retry.go:31] will retry after 1.282272251s: waiting for machine to come up
I0729 11:38:14.835953 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has defined MAC address 52:54:00:0b:d7:0d in network mk-old-k8s-version-188043
I0729 11:38:14.836543 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | unable to find current IP address of domain old-k8s-version-188043 in network mk-old-k8s-version-188043
I0729 11:38:14.836572 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | I0729 11:38:14.836497 63062 retry.go:31] will retry after 1.806982876s: waiting for machine to come up
I0729 11:38:16.644737 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has defined MAC address 52:54:00:0b:d7:0d in network mk-old-k8s-version-188043
I0729 11:38:16.645173 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | unable to find current IP address of domain old-k8s-version-188043 in network mk-old-k8s-version-188043
I0729 11:38:16.645197 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | I0729 11:38:16.645145 63062 retry.go:31] will retry after 2.168367856s: waiting for machine to come up
I0729 11:38:18.816051 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has defined MAC address 52:54:00:0b:d7:0d in network mk-old-k8s-version-188043
I0729 11:38:18.816727 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | unable to find current IP address of domain old-k8s-version-188043 in network mk-old-k8s-version-188043
I0729 11:38:18.816758 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | I0729 11:38:18.816667 63062 retry.go:31] will retry after 2.379927043s: waiting for machine to come up
I0729 11:38:21.199255 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has defined MAC address 52:54:00:0b:d7:0d in network mk-old-k8s-version-188043
I0729 11:38:21.199834 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | unable to find current IP address of domain old-k8s-version-188043 in network mk-old-k8s-version-188043
I0729 11:38:21.199871 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | I0729 11:38:21.199781 63062 retry.go:31] will retry after 4.452327139s: waiting for machine to come up
I0729 11:38:25.656188 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has defined MAC address 52:54:00:0b:d7:0d in network mk-old-k8s-version-188043
I0729 11:38:25.656716 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | unable to find current IP address of domain old-k8s-version-188043 in network mk-old-k8s-version-188043
I0729 11:38:25.656750 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | I0729 11:38:25.656706 63062 retry.go:31] will retry after 4.963978904s: waiting for machine to come up
I0729 11:38:30.623711 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has defined MAC address 52:54:00:0b:d7:0d in network mk-old-k8s-version-188043
I0729 11:38:30.624261 62801 main.go:141] libmachine: (old-k8s-version-188043) Found IP for machine: 192.168.72.61
I0729 11:38:30.624285 62801 main.go:141] libmachine: (old-k8s-version-188043) Reserving static IP address...
I0729 11:38:30.624298 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has current primary IP address 192.168.72.61 and MAC address 52:54:00:0b:d7:0d in network mk-old-k8s-version-188043
I0729 11:38:30.624679 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-188043", mac: "52:54:00:0b:d7:0d", ip: "192.168.72.61"} in network mk-old-k8s-version-188043
I0729 11:38:30.708435 62801 main.go:141] libmachine: (old-k8s-version-188043) Reserved static IP address: 192.168.72.61
I0729 11:38:30.708467 62801 main.go:141] libmachine: (old-k8s-version-188043) Waiting for SSH to be available...
I0729 11:38:30.708478 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | Getting to WaitForSSH function...
I0729 11:38:30.711385 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has defined MAC address 52:54:00:0b:d7:0d in network mk-old-k8s-version-188043
I0729 11:38:30.711922 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:d7:0d", ip: ""} in network mk-old-k8s-version-188043: {Iface:virbr4 ExpiryTime:2024-07-29 12:38:23 +0000 UTC Type:0 Mac:52:54:00:0b:d7:0d Iaid: IPaddr:192.168.72.61 Prefix:24 Hostname:minikube Clientid:01:52:54:00:0b:d7:0d}
I0729 11:38:30.711949 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has defined IP address 192.168.72.61 and MAC address 52:54:00:0b:d7:0d in network mk-old-k8s-version-188043
I0729 11:38:30.712132 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | Using SSH client type: external
I0729 11:38:30.712159 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | Using SSH private key: /home/jenkins/minikube-integration/19337-3845/.minikube/machines/old-k8s-version-188043/id_rsa (-rw-------)
I0729 11:38:30.712189 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.72.61 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19337-3845/.minikube/machines/old-k8s-version-188043/id_rsa -p 22] /usr/bin/ssh <nil>}
I0729 11:38:30.712203 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | About to run SSH command:
I0729 11:38:30.712252 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | exit 0
I0729 11:38:30.839110 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | SSH cmd err, output: <nil>:
I0729 11:38:30.839396 62801 main.go:141] libmachine: (old-k8s-version-188043) KVM machine creation complete!
I0729 11:38:30.839835 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetConfigRaw
I0729 11:38:30.840473 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .DriverName
I0729 11:38:30.840672 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .DriverName
I0729 11:38:30.840827 62801 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0729 11:38:30.840839 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetState
I0729 11:38:30.842126 62801 main.go:141] libmachine: Detecting operating system of created instance...
I0729 11:38:30.842148 62801 main.go:141] libmachine: Waiting for SSH to be available...
I0729 11:38:30.842156 62801 main.go:141] libmachine: Getting to WaitForSSH function...
I0729 11:38:30.842168 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetSSHHostname
I0729 11:38:30.844596 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has defined MAC address 52:54:00:0b:d7:0d in network mk-old-k8s-version-188043
I0729 11:38:30.845021 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:d7:0d", ip: ""} in network mk-old-k8s-version-188043: {Iface:virbr4 ExpiryTime:2024-07-29 12:38:23 +0000 UTC Type:0 Mac:52:54:00:0b:d7:0d Iaid: IPaddr:192.168.72.61 Prefix:24 Hostname:old-k8s-version-188043 Clientid:01:52:54:00:0b:d7:0d}
I0729 11:38:30.845051 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has defined IP address 192.168.72.61 and MAC address 52:54:00:0b:d7:0d in network mk-old-k8s-version-188043
I0729 11:38:30.845241 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetSSHPort
I0729 11:38:30.845403 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetSSHKeyPath
I0729 11:38:30.845551 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetSSHKeyPath
I0729 11:38:30.845713 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetSSHUsername
I0729 11:38:30.845883 62801 main.go:141] libmachine: Using SSH client type: native
I0729 11:38:30.846075 62801 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.72.61 22 <nil> <nil>}
I0729 11:38:30.846085 62801 main.go:141] libmachine: About to run SSH command:
exit 0
I0729 11:38:30.954093 62801 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0729 11:38:30.954119 62801 main.go:141] libmachine: Detecting the provisioner...
I0729 11:38:30.954129 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetSSHHostname
I0729 11:38:30.957031 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has defined MAC address 52:54:00:0b:d7:0d in network mk-old-k8s-version-188043
I0729 11:38:30.957416 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:d7:0d", ip: ""} in network mk-old-k8s-version-188043: {Iface:virbr4 ExpiryTime:2024-07-29 12:38:23 +0000 UTC Type:0 Mac:52:54:00:0b:d7:0d Iaid: IPaddr:192.168.72.61 Prefix:24 Hostname:old-k8s-version-188043 Clientid:01:52:54:00:0b:d7:0d}
I0729 11:38:30.957439 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has defined IP address 192.168.72.61 and MAC address 52:54:00:0b:d7:0d in network mk-old-k8s-version-188043
I0729 11:38:30.957651 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetSSHPort
I0729 11:38:30.957854 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetSSHKeyPath
I0729 11:38:30.958032 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetSSHKeyPath
I0729 11:38:30.958197 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetSSHUsername
I0729 11:38:30.958360 62801 main.go:141] libmachine: Using SSH client type: native
I0729 11:38:30.958555 62801 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.72.61 22 <nil> <nil>}
I0729 11:38:30.958567 62801 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0729 11:38:31.063534 62801 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0729 11:38:31.063605 62801 main.go:141] libmachine: found compatible host: buildroot
I0729 11:38:31.063618 62801 main.go:141] libmachine: Provisioning with buildroot...
I0729 11:38:31.063632 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetMachineName
I0729 11:38:31.063960 62801 buildroot.go:166] provisioning hostname "old-k8s-version-188043"
I0729 11:38:31.063991 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetMachineName
I0729 11:38:31.064178 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetSSHHostname
I0729 11:38:31.066857 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has defined MAC address 52:54:00:0b:d7:0d in network mk-old-k8s-version-188043
I0729 11:38:31.067241 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:d7:0d", ip: ""} in network mk-old-k8s-version-188043: {Iface:virbr4 ExpiryTime:2024-07-29 12:38:23 +0000 UTC Type:0 Mac:52:54:00:0b:d7:0d Iaid: IPaddr:192.168.72.61 Prefix:24 Hostname:old-k8s-version-188043 Clientid:01:52:54:00:0b:d7:0d}
I0729 11:38:31.067269 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has defined IP address 192.168.72.61 and MAC address 52:54:00:0b:d7:0d in network mk-old-k8s-version-188043
I0729 11:38:31.067466 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetSSHPort
I0729 11:38:31.067646 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetSSHKeyPath
I0729 11:38:31.067784 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetSSHKeyPath
I0729 11:38:31.067996 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetSSHUsername
I0729 11:38:31.068172 62801 main.go:141] libmachine: Using SSH client type: native
I0729 11:38:31.068345 62801 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.72.61 22 <nil> <nil>}
I0729 11:38:31.068356 62801 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-188043 && echo "old-k8s-version-188043" | sudo tee /etc/hostname
I0729 11:38:31.186358 62801 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-188043
I0729 11:38:31.186390 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetSSHHostname
I0729 11:38:31.189318 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has defined MAC address 52:54:00:0b:d7:0d in network mk-old-k8s-version-188043
I0729 11:38:31.189596 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:d7:0d", ip: ""} in network mk-old-k8s-version-188043: {Iface:virbr4 ExpiryTime:2024-07-29 12:38:23 +0000 UTC Type:0 Mac:52:54:00:0b:d7:0d Iaid: IPaddr:192.168.72.61 Prefix:24 Hostname:old-k8s-version-188043 Clientid:01:52:54:00:0b:d7:0d}
I0729 11:38:31.189636 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has defined IP address 192.168.72.61 and MAC address 52:54:00:0b:d7:0d in network mk-old-k8s-version-188043
I0729 11:38:31.189773 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetSSHPort
I0729 11:38:31.189970 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetSSHKeyPath
I0729 11:38:31.190115 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetSSHKeyPath
I0729 11:38:31.190318 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetSSHUsername
I0729 11:38:31.190524 62801 main.go:141] libmachine: Using SSH client type: native
I0729 11:38:31.190777 62801 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.72.61 22 <nil> <nil>}
I0729 11:38:31.190797 62801 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-188043' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-188043/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-188043' | sudo tee -a /etc/hosts;
fi
fi
I0729 11:38:31.308524 62801 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0729 11:38:31.308557 62801 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19337-3845/.minikube CaCertPath:/home/jenkins/minikube-integration/19337-3845/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19337-3845/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19337-3845/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19337-3845/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19337-3845/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19337-3845/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19337-3845/.minikube}
I0729 11:38:31.308613 62801 buildroot.go:174] setting up certificates
I0729 11:38:31.308629 62801 provision.go:84] configureAuth start
I0729 11:38:31.308647 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetMachineName
I0729 11:38:31.308933 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetIP
I0729 11:38:31.311916 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has defined MAC address 52:54:00:0b:d7:0d in network mk-old-k8s-version-188043
I0729 11:38:31.312275 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:d7:0d", ip: ""} in network mk-old-k8s-version-188043: {Iface:virbr4 ExpiryTime:2024-07-29 12:38:23 +0000 UTC Type:0 Mac:52:54:00:0b:d7:0d Iaid: IPaddr:192.168.72.61 Prefix:24 Hostname:old-k8s-version-188043 Clientid:01:52:54:00:0b:d7:0d}
I0729 11:38:31.312295 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has defined IP address 192.168.72.61 and MAC address 52:54:00:0b:d7:0d in network mk-old-k8s-version-188043
I0729 11:38:31.312435 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetSSHHostname
I0729 11:38:31.314922 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has defined MAC address 52:54:00:0b:d7:0d in network mk-old-k8s-version-188043
I0729 11:38:31.315341 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:d7:0d", ip: ""} in network mk-old-k8s-version-188043: {Iface:virbr4 ExpiryTime:2024-07-29 12:38:23 +0000 UTC Type:0 Mac:52:54:00:0b:d7:0d Iaid: IPaddr:192.168.72.61 Prefix:24 Hostname:old-k8s-version-188043 Clientid:01:52:54:00:0b:d7:0d}
I0729 11:38:31.315370 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has defined IP address 192.168.72.61 and MAC address 52:54:00:0b:d7:0d in network mk-old-k8s-version-188043
I0729 11:38:31.315464 62801 provision.go:143] copyHostCerts
I0729 11:38:31.315530 62801 exec_runner.go:144] found /home/jenkins/minikube-integration/19337-3845/.minikube/ca.pem, removing ...
I0729 11:38:31.315542 62801 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19337-3845/.minikube/ca.pem
I0729 11:38:31.315606 62801 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19337-3845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19337-3845/.minikube/ca.pem (1082 bytes)
I0729 11:38:31.315829 62801 exec_runner.go:144] found /home/jenkins/minikube-integration/19337-3845/.minikube/cert.pem, removing ...
I0729 11:38:31.315841 62801 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19337-3845/.minikube/cert.pem
I0729 11:38:31.315869 62801 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19337-3845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19337-3845/.minikube/cert.pem (1123 bytes)
I0729 11:38:31.315960 62801 exec_runner.go:144] found /home/jenkins/minikube-integration/19337-3845/.minikube/key.pem, removing ...
I0729 11:38:31.315969 62801 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19337-3845/.minikube/key.pem
I0729 11:38:31.315996 62801 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19337-3845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19337-3845/.minikube/key.pem (1675 bytes)
I0729 11:38:31.316074 62801 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19337-3845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19337-3845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19337-3845/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-188043 san=[127.0.0.1 192.168.72.61 localhost minikube old-k8s-version-188043]
I0729 11:38:31.458968 62801 provision.go:177] copyRemoteCerts
I0729 11:38:31.459032 62801 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0729 11:38:31.459059 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetSSHHostname
I0729 11:38:31.461856 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has defined MAC address 52:54:00:0b:d7:0d in network mk-old-k8s-version-188043
I0729 11:38:31.462237 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:d7:0d", ip: ""} in network mk-old-k8s-version-188043: {Iface:virbr4 ExpiryTime:2024-07-29 12:38:23 +0000 UTC Type:0 Mac:52:54:00:0b:d7:0d Iaid: IPaddr:192.168.72.61 Prefix:24 Hostname:old-k8s-version-188043 Clientid:01:52:54:00:0b:d7:0d}
I0729 11:38:31.462258 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has defined IP address 192.168.72.61 and MAC address 52:54:00:0b:d7:0d in network mk-old-k8s-version-188043
I0729 11:38:31.462489 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetSSHPort
I0729 11:38:31.462670 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetSSHKeyPath
I0729 11:38:31.462869 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetSSHUsername
I0729 11:38:31.463061 62801 sshutil.go:53] new ssh client: &{IP:192.168.72.61 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19337-3845/.minikube/machines/old-k8s-version-188043/id_rsa Username:docker}
I0729 11:38:31.549741 62801 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19337-3845/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0729 11:38:31.577710 62801 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19337-3845/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0729 11:38:31.604467 62801 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19337-3845/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0729 11:38:31.629441 62801 provision.go:87] duration metric: took 320.79709ms to configureAuth
I0729 11:38:31.629474 62801 buildroot.go:189] setting minikube options for container-runtime
I0729 11:38:31.629679 62801 config.go:182] Loaded profile config "old-k8s-version-188043": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0729 11:38:31.629785 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetSSHHostname
I0729 11:38:31.632961 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has defined MAC address 52:54:00:0b:d7:0d in network mk-old-k8s-version-188043
I0729 11:38:31.633383 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:d7:0d", ip: ""} in network mk-old-k8s-version-188043: {Iface:virbr4 ExpiryTime:2024-07-29 12:38:23 +0000 UTC Type:0 Mac:52:54:00:0b:d7:0d Iaid: IPaddr:192.168.72.61 Prefix:24 Hostname:old-k8s-version-188043 Clientid:01:52:54:00:0b:d7:0d}
I0729 11:38:31.633415 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has defined IP address 192.168.72.61 and MAC address 52:54:00:0b:d7:0d in network mk-old-k8s-version-188043
I0729 11:38:31.633590 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetSSHPort
I0729 11:38:31.633793 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetSSHKeyPath
I0729 11:38:31.633994 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetSSHKeyPath
I0729 11:38:31.634197 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetSSHUsername
I0729 11:38:31.634360 62801 main.go:141] libmachine: Using SSH client type: native
I0729 11:38:31.634586 62801 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.72.61 22 <nil> <nil>}
I0729 11:38:31.634612 62801 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0729 11:38:31.912134 62801 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0729 11:38:31.912176 62801 main.go:141] libmachine: Checking connection to Docker...
I0729 11:38:31.912188 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetURL
I0729 11:38:31.913789 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | Using libvirt version 6000000
I0729 11:38:31.915968 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has defined MAC address 52:54:00:0b:d7:0d in network mk-old-k8s-version-188043
I0729 11:38:31.916357 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:d7:0d", ip: ""} in network mk-old-k8s-version-188043: {Iface:virbr4 ExpiryTime:2024-07-29 12:38:23 +0000 UTC Type:0 Mac:52:54:00:0b:d7:0d Iaid: IPaddr:192.168.72.61 Prefix:24 Hostname:old-k8s-version-188043 Clientid:01:52:54:00:0b:d7:0d}
I0729 11:38:31.916400 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has defined IP address 192.168.72.61 and MAC address 52:54:00:0b:d7:0d in network mk-old-k8s-version-188043
I0729 11:38:31.916571 62801 main.go:141] libmachine: Docker is up and running!
I0729 11:38:31.916590 62801 main.go:141] libmachine: Reticulating splines...
I0729 11:38:31.916598 62801 client.go:171] duration metric: took 25.092179513s to LocalClient.Create
I0729 11:38:31.916625 62801 start.go:167] duration metric: took 25.092254609s to libmachine.API.Create "old-k8s-version-188043"
I0729 11:38:31.916636 62801 start.go:293] postStartSetup for "old-k8s-version-188043" (driver="kvm2")
I0729 11:38:31.916650 62801 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0729 11:38:31.916673 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .DriverName
I0729 11:38:31.917033 62801 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0729 11:38:31.917057 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetSSHHostname
I0729 11:38:31.919178 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has defined MAC address 52:54:00:0b:d7:0d in network mk-old-k8s-version-188043
I0729 11:38:31.919502 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:d7:0d", ip: ""} in network mk-old-k8s-version-188043: {Iface:virbr4 ExpiryTime:2024-07-29 12:38:23 +0000 UTC Type:0 Mac:52:54:00:0b:d7:0d Iaid: IPaddr:192.168.72.61 Prefix:24 Hostname:old-k8s-version-188043 Clientid:01:52:54:00:0b:d7:0d}
I0729 11:38:31.919520 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has defined IP address 192.168.72.61 and MAC address 52:54:00:0b:d7:0d in network mk-old-k8s-version-188043
I0729 11:38:31.919636 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetSSHPort
I0729 11:38:31.919873 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetSSHKeyPath
I0729 11:38:31.920064 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetSSHUsername
I0729 11:38:31.920280 62801 sshutil.go:53] new ssh client: &{IP:192.168.72.61 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19337-3845/.minikube/machines/old-k8s-version-188043/id_rsa Username:docker}
I0729 11:38:32.001884 62801 ssh_runner.go:195] Run: cat /etc/os-release
I0729 11:38:32.006943 62801 info.go:137] Remote host: Buildroot 2023.02.9
I0729 11:38:32.006971 62801 filesync.go:126] Scanning /home/jenkins/minikube-integration/19337-3845/.minikube/addons for local assets ...
I0729 11:38:32.007030 62801 filesync.go:126] Scanning /home/jenkins/minikube-integration/19337-3845/.minikube/files for local assets ...
I0729 11:38:32.007129 62801 filesync.go:149] local asset: /home/jenkins/minikube-integration/19337-3845/.minikube/files/etc/ssl/certs/110642.pem -> 110642.pem in /etc/ssl/certs
I0729 11:38:32.007250 62801 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0729 11:38:32.017978 62801 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19337-3845/.minikube/files/etc/ssl/certs/110642.pem --> /etc/ssl/certs/110642.pem (1708 bytes)
I0729 11:38:32.043733 62801 start.go:296] duration metric: took 127.084726ms for postStartSetup
I0729 11:38:32.043801 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetConfigRaw
I0729 11:38:32.044419 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetIP
I0729 11:38:32.047126 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has defined MAC address 52:54:00:0b:d7:0d in network mk-old-k8s-version-188043
I0729 11:38:32.047569 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:d7:0d", ip: ""} in network mk-old-k8s-version-188043: {Iface:virbr4 ExpiryTime:2024-07-29 12:38:23 +0000 UTC Type:0 Mac:52:54:00:0b:d7:0d Iaid: IPaddr:192.168.72.61 Prefix:24 Hostname:old-k8s-version-188043 Clientid:01:52:54:00:0b:d7:0d}
I0729 11:38:32.047592 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has defined IP address 192.168.72.61 and MAC address 52:54:00:0b:d7:0d in network mk-old-k8s-version-188043
I0729 11:38:32.047835 62801 profile.go:143] Saving config to /home/jenkins/minikube-integration/19337-3845/.minikube/profiles/old-k8s-version-188043/config.json ...
I0729 11:38:32.048103 62801 start.go:128] duration metric: took 25.248061019s to createHost
I0729 11:38:32.048133 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetSSHHostname
I0729 11:38:32.050460 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has defined MAC address 52:54:00:0b:d7:0d in network mk-old-k8s-version-188043
I0729 11:38:32.050807 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:d7:0d", ip: ""} in network mk-old-k8s-version-188043: {Iface:virbr4 ExpiryTime:2024-07-29 12:38:23 +0000 UTC Type:0 Mac:52:54:00:0b:d7:0d Iaid: IPaddr:192.168.72.61 Prefix:24 Hostname:old-k8s-version-188043 Clientid:01:52:54:00:0b:d7:0d}
I0729 11:38:32.050837 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has defined IP address 192.168.72.61 and MAC address 52:54:00:0b:d7:0d in network mk-old-k8s-version-188043
I0729 11:38:32.051005 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetSSHPort
I0729 11:38:32.051189 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetSSHKeyPath
I0729 11:38:32.051357 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetSSHKeyPath
I0729 11:38:32.051539 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetSSHUsername
I0729 11:38:32.051719 62801 main.go:141] libmachine: Using SSH client type: native
I0729 11:38:32.051905 62801 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.72.61 22 <nil> <nil>}
I0729 11:38:32.051920 62801 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0729 11:38:32.155793 62801 main.go:141] libmachine: SSH cmd err, output: <nil>: 1722253112.126415584
I0729 11:38:32.155823 62801 fix.go:216] guest clock: 1722253112.126415584
I0729 11:38:32.155832 62801 fix.go:229] Guest: 2024-07-29 11:38:32.126415584 +0000 UTC Remote: 2024-07-29 11:38:32.048119938 +0000 UTC m=+47.616274364 (delta=78.295646ms)
I0729 11:38:32.155868 62801 fix.go:200] guest clock delta is within tolerance: 78.295646ms
I0729 11:38:32.155872 62801 start.go:83] releasing machines lock for "old-k8s-version-188043", held for 25.356022984s
I0729 11:38:32.155906 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .DriverName
I0729 11:38:32.156233 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetIP
I0729 11:38:32.158961 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has defined MAC address 52:54:00:0b:d7:0d in network mk-old-k8s-version-188043
I0729 11:38:32.159384 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:d7:0d", ip: ""} in network mk-old-k8s-version-188043: {Iface:virbr4 ExpiryTime:2024-07-29 12:38:23 +0000 UTC Type:0 Mac:52:54:00:0b:d7:0d Iaid: IPaddr:192.168.72.61 Prefix:24 Hostname:old-k8s-version-188043 Clientid:01:52:54:00:0b:d7:0d}
I0729 11:38:32.159412 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has defined IP address 192.168.72.61 and MAC address 52:54:00:0b:d7:0d in network mk-old-k8s-version-188043
I0729 11:38:32.159596 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .DriverName
I0729 11:38:32.160258 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .DriverName
I0729 11:38:32.160436 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .DriverName
I0729 11:38:32.160538 62801 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0729 11:38:32.160574 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetSSHHostname
I0729 11:38:32.160670 62801 ssh_runner.go:195] Run: cat /version.json
I0729 11:38:32.160695 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetSSHHostname
I0729 11:38:32.163658 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has defined MAC address 52:54:00:0b:d7:0d in network mk-old-k8s-version-188043
I0729 11:38:32.163755 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has defined MAC address 52:54:00:0b:d7:0d in network mk-old-k8s-version-188043
I0729 11:38:32.164008 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:d7:0d", ip: ""} in network mk-old-k8s-version-188043: {Iface:virbr4 ExpiryTime:2024-07-29 12:38:23 +0000 UTC Type:0 Mac:52:54:00:0b:d7:0d Iaid: IPaddr:192.168.72.61 Prefix:24 Hostname:old-k8s-version-188043 Clientid:01:52:54:00:0b:d7:0d}
I0729 11:38:32.164036 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has defined IP address 192.168.72.61 and MAC address 52:54:00:0b:d7:0d in network mk-old-k8s-version-188043
I0729 11:38:32.164193 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:d7:0d", ip: ""} in network mk-old-k8s-version-188043: {Iface:virbr4 ExpiryTime:2024-07-29 12:38:23 +0000 UTC Type:0 Mac:52:54:00:0b:d7:0d Iaid: IPaddr:192.168.72.61 Prefix:24 Hostname:old-k8s-version-188043 Clientid:01:52:54:00:0b:d7:0d}
I0729 11:38:32.164223 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has defined IP address 192.168.72.61 and MAC address 52:54:00:0b:d7:0d in network mk-old-k8s-version-188043
I0729 11:38:32.164347 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetSSHPort
I0729 11:38:32.164559 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetSSHKeyPath
I0729 11:38:32.164583 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetSSHPort
I0729 11:38:32.164768 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetSSHKeyPath
I0729 11:38:32.164784 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetSSHUsername
I0729 11:38:32.164965 62801 sshutil.go:53] new ssh client: &{IP:192.168.72.61 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19337-3845/.minikube/machines/old-k8s-version-188043/id_rsa Username:docker}
I0729 11:38:32.164989 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetSSHUsername
I0729 11:38:32.165130 62801 sshutil.go:53] new ssh client: &{IP:192.168.72.61 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19337-3845/.minikube/machines/old-k8s-version-188043/id_rsa Username:docker}
I0729 11:38:32.269751 62801 ssh_runner.go:195] Run: systemctl --version
I0729 11:38:32.278551 62801 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0729 11:38:32.441148 62801 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0729 11:38:32.447850 62801 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0729 11:38:32.447930 62801 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0729 11:38:32.467385 62801 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0729 11:38:32.467414 62801 start.go:495] detecting cgroup driver to use...
I0729 11:38:32.467493 62801 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0729 11:38:32.499891 62801 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0729 11:38:32.517433 62801 docker.go:217] disabling cri-docker service (if available) ...
I0729 11:38:32.517493 62801 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0729 11:38:32.534825 62801 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0729 11:38:32.550772 62801 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0729 11:38:32.695171 62801 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0729 11:38:32.866406 62801 docker.go:233] disabling docker service ...
I0729 11:38:32.866470 62801 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0729 11:38:32.882446 62801 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0729 11:38:32.896705 62801 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0729 11:38:33.042067 62801 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0729 11:38:33.173892 62801 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0729 11:38:33.190130 62801 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0729 11:38:33.211672 62801 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0729 11:38:33.211745 62801 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0729 11:38:33.225297 62801 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0729 11:38:33.225376 62801 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0729 11:38:33.237265 62801 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0729 11:38:33.252282 62801 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0729 11:38:33.265603 62801 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0729 11:38:33.281760 62801 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0729 11:38:33.293872 62801 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0729 11:38:33.293943 62801 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0729 11:38:33.313005 62801 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0729 11:38:33.326904 62801 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0729 11:38:33.464345 62801 ssh_runner.go:195] Run: sudo systemctl restart crio
I0729 11:38:33.621426 62801 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0729 11:38:33.621490 62801 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0729 11:38:33.626889 62801 start.go:563] Will wait 60s for crictl version
I0729 11:38:33.626953 62801 ssh_runner.go:195] Run: which crictl
I0729 11:38:33.631456 62801 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0729 11:38:33.682100 62801 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0729 11:38:33.682204 62801 ssh_runner.go:195] Run: crio --version
I0729 11:38:33.712961 62801 ssh_runner.go:195] Run: crio --version
I0729 11:38:33.749862 62801 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0729 11:38:33.751183 62801 main.go:141] libmachine: (old-k8s-version-188043) Calling .GetIP
I0729 11:38:33.754245 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has defined MAC address 52:54:00:0b:d7:0d in network mk-old-k8s-version-188043
I0729 11:38:33.754828 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:d7:0d", ip: ""} in network mk-old-k8s-version-188043: {Iface:virbr4 ExpiryTime:2024-07-29 12:38:23 +0000 UTC Type:0 Mac:52:54:00:0b:d7:0d Iaid: IPaddr:192.168.72.61 Prefix:24 Hostname:old-k8s-version-188043 Clientid:01:52:54:00:0b:d7:0d}
I0729 11:38:33.754861 62801 main.go:141] libmachine: (old-k8s-version-188043) DBG | domain old-k8s-version-188043 has defined IP address 192.168.72.61 and MAC address 52:54:00:0b:d7:0d in network mk-old-k8s-version-188043
I0729 11:38:33.755116 62801 ssh_runner.go:195] Run: grep 192.168.72.1 host.minikube.internal$ /etc/hosts
I0729 11:38:33.760770 62801 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.72.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0729 11:38:33.779558 62801 kubeadm.go:883] updating cluster {Name:old-k8s-version-188043 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19319/minikube-v1.33.1-1721690939-19319-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-188043 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.61 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mo
untPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0729 11:38:33.779663 62801 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0729 11:38:33.779714 62801 ssh_runner.go:195] Run: sudo crictl images --output json
I0729 11:38:33.834772 62801 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0729 11:38:33.834863 62801 ssh_runner.go:195] Run: which lz4
I0729 11:38:33.840621 62801 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0729 11:38:33.845477 62801 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0729 11:38:33.845514 62801 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19337-3845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0729 11:38:35.622975 62801 crio.go:462] duration metric: took 1.782385507s to copy over tarball
I0729 11:38:35.623066 62801 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0729 11:38:38.612974 62801 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.989870393s)
I0729 11:38:38.613007 62801 crio.go:469] duration metric: took 2.989997798s to extract the tarball
I0729 11:38:38.613022 62801 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0729 11:38:38.662751 62801 ssh_runner.go:195] Run: sudo crictl images --output json
I0729 11:38:38.713512 62801 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0729 11:38:38.713539 62801 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0729 11:38:38.713621 62801 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0729 11:38:38.713665 62801 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0729 11:38:38.713708 62801 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0729 11:38:38.713907 62801 image.go:134] retrieving image: registry.k8s.io/pause:3.2
I0729 11:38:38.713927 62801 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0729 11:38:38.714022 62801 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0729 11:38:38.713907 62801 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0729 11:38:38.714152 62801 image.go:134] retrieving image: registry.k8s.io/coredns:1.7.0
I0729 11:38:38.715088 62801 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0729 11:38:38.715257 62801 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0729 11:38:38.715451 62801 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0729 11:38:38.715587 62801 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0729 11:38:38.715854 62801 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0729 11:38:38.716019 62801 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0729 11:38:38.716118 62801 image.go:177] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0729 11:38:38.716190 62801 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0729 11:38:38.863001 62801 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0729 11:38:38.864993 62801 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0729 11:38:38.867121 62801 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0729 11:38:38.872402 62801 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0729 11:38:38.895856 62801 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0729 11:38:38.904143 62801 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0729 11:38:38.948374 62801 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0729 11:38:38.985422 62801 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0729 11:38:38.985487 62801 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0729 11:38:38.985546 62801 ssh_runner.go:195] Run: which crictl
I0729 11:38:39.027836 62801 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0729 11:38:39.027892 62801 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0729 11:38:39.027953 62801 ssh_runner.go:195] Run: which crictl
I0729 11:38:39.044195 62801 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0729 11:38:39.044246 62801 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0729 11:38:39.044272 62801 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0729 11:38:39.044343 62801 ssh_runner.go:195] Run: which crictl
I0729 11:38:39.044279 62801 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0729 11:38:39.044418 62801 ssh_runner.go:195] Run: which crictl
I0729 11:38:39.070580 62801 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0729 11:38:39.070635 62801 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0729 11:38:39.070690 62801 ssh_runner.go:195] Run: which crictl
I0729 11:38:39.088806 62801 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0729 11:38:39.088868 62801 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0729 11:38:39.088913 62801 ssh_runner.go:195] Run: which crictl
I0729 11:38:39.094359 62801 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0729 11:38:39.094413 62801 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0729 11:38:39.094451 62801 ssh_runner.go:195] Run: which crictl
I0729 11:38:39.094467 62801 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0729 11:38:39.094479 62801 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0729 11:38:39.094479 62801 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0729 11:38:39.094525 62801 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0729 11:38:39.094538 62801 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0729 11:38:39.094588 62801 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0729 11:38:39.105598 62801 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0729 11:38:39.283728 62801 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19337-3845/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0729 11:38:39.283778 62801 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19337-3845/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0729 11:38:39.283793 62801 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19337-3845/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0729 11:38:39.283801 62801 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19337-3845/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0729 11:38:39.283875 62801 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19337-3845/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0729 11:38:39.283910 62801 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19337-3845/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0729 11:38:39.284477 62801 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19337-3845/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0729 11:38:39.669015 62801 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0729 11:38:39.811433 62801 cache_images.go:92] duration metric: took 1.09786514s to LoadCachedImages
W0729 11:38:39.811603 62801 out.go:239] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19337-3845/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19337-3845/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0: no such file or directory
I0729 11:38:39.811728 62801 kubeadm.go:934] updating node { 192.168.72.61 8443 v1.20.0 crio true true} ...
I0729 11:38:39.811854 62801 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-188043 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.72.61
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-188043 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0729 11:38:39.811942 62801 ssh_runner.go:195] Run: crio config
I0729 11:38:39.877158 62801 cni.go:84] Creating CNI manager for ""
I0729 11:38:39.877177 62801 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0729 11:38:39.877185 62801 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0729 11:38:39.877201 62801 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.72.61 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-188043 NodeName:old-k8s-version-188043 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.72.61"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.72.61 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Stati
cPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0729 11:38:39.877308 62801 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.72.61
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-188043"
kubeletExtraArgs:
node-ip: 192.168.72.61
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.72.61"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0729 11:38:39.877367 62801 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0729 11:38:39.887739 62801 binaries.go:44] Found k8s binaries, skipping transfer
I0729 11:38:39.887815 62801 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0729 11:38:39.897332 62801 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (429 bytes)
I0729 11:38:39.916806 62801 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0729 11:38:39.935282 62801 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2120 bytes)
I0729 11:38:39.954106 62801 ssh_runner.go:195] Run: grep 192.168.72.61 control-plane.minikube.internal$ /etc/hosts
I0729 11:38:39.958460 62801 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.72.61 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0729 11:38:39.972124 62801 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0729 11:38:40.112271 62801 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0729 11:38:40.131176 62801 certs.go:68] Setting up /home/jenkins/minikube-integration/19337-3845/.minikube/profiles/old-k8s-version-188043 for IP: 192.168.72.61
I0729 11:38:40.131199 62801 certs.go:194] generating shared ca certs ...
I0729 11:38:40.131218 62801 certs.go:226] acquiring lock for ca certs: {Name:mk81eab08bc9d89e797c2c52fbc03f1193fd667f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 11:38:40.131397 62801 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19337-3845/.minikube/ca.key
I0729 11:38:40.131473 62801 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19337-3845/.minikube/proxy-client-ca.key
I0729 11:38:40.131488 62801 certs.go:256] generating profile certs ...
I0729 11:38:40.131554 62801 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19337-3845/.minikube/profiles/old-k8s-version-188043/client.key
I0729 11:38:40.131572 62801 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19337-3845/.minikube/profiles/old-k8s-version-188043/client.crt with IP's: []
I0729 11:38:40.301365 62801 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19337-3845/.minikube/profiles/old-k8s-version-188043/client.crt ...
I0729 11:38:40.301397 62801 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19337-3845/.minikube/profiles/old-k8s-version-188043/client.crt: {Name:mk97f4b73d42e9611a67a87d9328e8b179138777 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 11:38:40.301617 62801 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19337-3845/.minikube/profiles/old-k8s-version-188043/client.key ...
I0729 11:38:40.301638 62801 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19337-3845/.minikube/profiles/old-k8s-version-188043/client.key: {Name:mk4fe023242dc9807d48d20040f2be3e04500a55 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 11:38:40.301750 62801 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19337-3845/.minikube/profiles/old-k8s-version-188043/apiserver.key.2bbdfef4
I0729 11:38:40.301770 62801 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19337-3845/.minikube/profiles/old-k8s-version-188043/apiserver.crt.2bbdfef4 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.72.61]
I0729 11:38:40.505027 62801 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19337-3845/.minikube/profiles/old-k8s-version-188043/apiserver.crt.2bbdfef4 ...
I0729 11:38:40.505060 62801 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19337-3845/.minikube/profiles/old-k8s-version-188043/apiserver.crt.2bbdfef4: {Name:mk3e5029e48b4142ca93531d63f37864bf3a73fe Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 11:38:40.505237 62801 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19337-3845/.minikube/profiles/old-k8s-version-188043/apiserver.key.2bbdfef4 ...
I0729 11:38:40.505259 62801 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19337-3845/.minikube/profiles/old-k8s-version-188043/apiserver.key.2bbdfef4: {Name:mk020a3079911987752b4c51af3a7526c507f691 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 11:38:40.505371 62801 certs.go:381] copying /home/jenkins/minikube-integration/19337-3845/.minikube/profiles/old-k8s-version-188043/apiserver.crt.2bbdfef4 -> /home/jenkins/minikube-integration/19337-3845/.minikube/profiles/old-k8s-version-188043/apiserver.crt
I0729 11:38:40.505480 62801 certs.go:385] copying /home/jenkins/minikube-integration/19337-3845/.minikube/profiles/old-k8s-version-188043/apiserver.key.2bbdfef4 -> /home/jenkins/minikube-integration/19337-3845/.minikube/profiles/old-k8s-version-188043/apiserver.key
I0729 11:38:40.505565 62801 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19337-3845/.minikube/profiles/old-k8s-version-188043/proxy-client.key
I0729 11:38:40.505591 62801 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19337-3845/.minikube/profiles/old-k8s-version-188043/proxy-client.crt with IP's: []
I0729 11:38:40.953444 62801 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19337-3845/.minikube/profiles/old-k8s-version-188043/proxy-client.crt ...
I0729 11:38:40.953478 62801 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19337-3845/.minikube/profiles/old-k8s-version-188043/proxy-client.crt: {Name:mk0f5e5d82bc59dee6182447414aed0a12ec8401 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 11:38:40.953673 62801 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19337-3845/.minikube/profiles/old-k8s-version-188043/proxy-client.key ...
I0729 11:38:40.953691 62801 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19337-3845/.minikube/profiles/old-k8s-version-188043/proxy-client.key: {Name:mk900d3d556892c3571dd18ce874d3fb1b09e543 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 11:38:40.953906 62801 certs.go:484] found cert: /home/jenkins/minikube-integration/19337-3845/.minikube/certs/11064.pem (1338 bytes)
W0729 11:38:40.953956 62801 certs.go:480] ignoring /home/jenkins/minikube-integration/19337-3845/.minikube/certs/11064_empty.pem, impossibly tiny 0 bytes
I0729 11:38:40.953970 62801 certs.go:484] found cert: /home/jenkins/minikube-integration/19337-3845/.minikube/certs/ca-key.pem (1675 bytes)
I0729 11:38:40.954005 62801 certs.go:484] found cert: /home/jenkins/minikube-integration/19337-3845/.minikube/certs/ca.pem (1082 bytes)
I0729 11:38:40.954036 62801 certs.go:484] found cert: /home/jenkins/minikube-integration/19337-3845/.minikube/certs/cert.pem (1123 bytes)
I0729 11:38:40.954068 62801 certs.go:484] found cert: /home/jenkins/minikube-integration/19337-3845/.minikube/certs/key.pem (1675 bytes)
I0729 11:38:40.954122 62801 certs.go:484] found cert: /home/jenkins/minikube-integration/19337-3845/.minikube/files/etc/ssl/certs/110642.pem (1708 bytes)
I0729 11:38:40.954755 62801 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19337-3845/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0729 11:38:40.990066 62801 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19337-3845/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0729 11:38:41.035429 62801 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19337-3845/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0729 11:38:41.073392 62801 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19337-3845/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0729 11:38:41.111643 62801 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19337-3845/.minikube/profiles/old-k8s-version-188043/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0729 11:38:41.141364 62801 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19337-3845/.minikube/profiles/old-k8s-version-188043/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0729 11:38:41.167999 62801 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19337-3845/.minikube/profiles/old-k8s-version-188043/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0729 11:38:41.199324 62801 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19337-3845/.minikube/profiles/old-k8s-version-188043/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0729 11:38:41.228344 62801 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19337-3845/.minikube/files/etc/ssl/certs/110642.pem --> /usr/share/ca-certificates/110642.pem (1708 bytes)
I0729 11:38:41.261012 62801 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19337-3845/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0729 11:38:41.290256 62801 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19337-3845/.minikube/certs/11064.pem --> /usr/share/ca-certificates/11064.pem (1338 bytes)
I0729 11:38:41.319526 62801 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0729 11:38:41.343711 62801 ssh_runner.go:195] Run: openssl version
I0729 11:38:41.352398 62801 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0729 11:38:41.369311 62801 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0729 11:38:41.375879 62801 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jul 29 10:23 /usr/share/ca-certificates/minikubeCA.pem
I0729 11:38:41.375952 62801 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0729 11:38:41.384900 62801 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0729 11:38:41.400813 62801 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11064.pem && ln -fs /usr/share/ca-certificates/11064.pem /etc/ssl/certs/11064.pem"
I0729 11:38:41.417332 62801 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11064.pem
I0729 11:38:41.423694 62801 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jul 29 10:34 /usr/share/ca-certificates/11064.pem
I0729 11:38:41.423774 62801 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11064.pem
I0729 11:38:41.431871 62801 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/11064.pem /etc/ssl/certs/51391683.0"
I0729 11:38:41.448281 62801 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/110642.pem && ln -fs /usr/share/ca-certificates/110642.pem /etc/ssl/certs/110642.pem"
I0729 11:38:41.464927 62801 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/110642.pem
I0729 11:38:41.471062 62801 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jul 29 10:34 /usr/share/ca-certificates/110642.pem
I0729 11:38:41.471140 62801 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/110642.pem
I0729 11:38:41.479180 62801 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/110642.pem /etc/ssl/certs/3ec20f2e.0"
I0729 11:38:41.495258 62801 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0729 11:38:41.500179 62801 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0729 11:38:41.500244 62801 kubeadm.go:392] StartCluster: {Name:old-k8s-version-188043 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19319/minikube-v1.33.1-1721690939-19319-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-188043 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.61 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0729 11:38:41.500338 62801 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0729 11:38:41.500406 62801 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0729 11:38:41.547600 62801 cri.go:89] found id: ""
I0729 11:38:41.547677 62801 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0729 11:38:41.560224 62801 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0729 11:38:41.572733 62801 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0729 11:38:41.584046 62801 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0729 11:38:41.584083 62801 kubeadm.go:157] found existing configuration files:
I0729 11:38:41.584151 62801 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0729 11:38:41.596412 62801 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0729 11:38:41.596479 62801 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0729 11:38:41.609214 62801 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0729 11:38:41.620929 62801 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0729 11:38:41.621016 62801 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0729 11:38:41.633167 62801 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0729 11:38:41.646691 62801 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0729 11:38:41.646951 62801 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0729 11:38:41.661194 62801 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0729 11:38:41.673948 62801 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0729 11:38:41.674080 62801 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0729 11:38:41.684984 62801 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0729 11:38:41.870568 62801 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0729 11:38:41.870653 62801 kubeadm.go:310] [preflight] Running pre-flight checks
I0729 11:38:42.038435 62801 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0729 11:38:42.038577 62801 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0729 11:38:42.038732 62801 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0729 11:38:42.288804 62801 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0729 11:38:42.292240 62801 out.go:204] - Generating certificates and keys ...
I0729 11:38:42.292676 62801 kubeadm.go:310] [certs] Using existing ca certificate authority
I0729 11:38:42.292811 62801 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0729 11:38:42.364642 62801 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0729 11:38:42.757452 62801 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0729 11:38:42.873114 62801 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0729 11:38:43.228217 62801 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0729 11:38:43.378899 62801 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0729 11:38:43.379779 62801 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-188043] and IPs [192.168.72.61 127.0.0.1 ::1]
I0729 11:38:43.473850 62801 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0729 11:38:43.474223 62801 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-188043] and IPs [192.168.72.61 127.0.0.1 ::1]
I0729 11:38:43.672677 62801 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0729 11:38:44.093865 62801 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0729 11:38:44.623738 62801 kubeadm.go:310] [certs] Generating "sa" key and public key
I0729 11:38:44.624037 62801 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0729 11:38:44.781780 62801 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0729 11:38:45.047826 62801 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0729 11:38:45.139020 62801 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0729 11:38:45.252432 62801 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0729 11:38:45.296723 62801 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0729 11:38:45.296853 62801 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0729 11:38:45.296914 62801 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0729 11:38:45.501446 62801 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0729 11:38:45.503452 62801 out.go:204] - Booting up control plane ...
I0729 11:38:45.503588 62801 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0729 11:38:45.514772 62801 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0729 11:38:45.517362 62801 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0729 11:38:45.518285 62801 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0729 11:38:45.532323 62801 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0729 11:39:25.525221 62801 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0729 11:39:25.538447 62801 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0729 11:39:25.538686 62801 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0729 11:39:30.538716 62801 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0729 11:39:30.539007 62801 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0729 11:39:40.538576 62801 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0729 11:39:40.538845 62801 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0729 11:40:00.538477 62801 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0729 11:40:00.538683 62801 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0729 11:40:40.540039 62801 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0729 11:40:40.540260 62801 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0729 11:40:40.540272 62801 kubeadm.go:310]
I0729 11:40:40.540305 62801 kubeadm.go:310] Unfortunately, an error has occurred:
I0729 11:40:40.540340 62801 kubeadm.go:310] timed out waiting for the condition
I0729 11:40:40.540346 62801 kubeadm.go:310]
I0729 11:40:40.540378 62801 kubeadm.go:310] This error is likely caused by:
I0729 11:40:40.540426 62801 kubeadm.go:310] - The kubelet is not running
I0729 11:40:40.540579 62801 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0729 11:40:40.540605 62801 kubeadm.go:310]
I0729 11:40:40.540745 62801 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0729 11:40:40.540786 62801 kubeadm.go:310] - 'systemctl status kubelet'
I0729 11:40:40.540832 62801 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0729 11:40:40.540844 62801 kubeadm.go:310]
I0729 11:40:40.541006 62801 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0729 11:40:40.541092 62801 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0729 11:40:40.541100 62801 kubeadm.go:310]
I0729 11:40:40.541194 62801 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0729 11:40:40.541282 62801 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0729 11:40:40.541360 62801 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0729 11:40:40.541431 62801 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0729 11:40:40.541443 62801 kubeadm.go:310]
I0729 11:40:40.542050 62801 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0729 11:40:40.542198 62801 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0729 11:40:40.542273 62801 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
W0729 11:40:40.542391 62801 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-188043] and IPs [192.168.72.61 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-188043] and IPs [192.168.72.61 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-188043] and IPs [192.168.72.61 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-188043] and IPs [192.168.72.61 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0729 11:40:40.542443 62801 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0729 11:40:42.517886 62801 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (1.975411697s)
I0729 11:40:42.517979 62801 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0729 11:40:42.535377 62801 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0729 11:40:42.545535 62801 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0729 11:40:42.545558 62801 kubeadm.go:157] found existing configuration files:
I0729 11:40:42.545600 62801 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0729 11:40:42.555001 62801 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0729 11:40:42.555060 62801 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0729 11:40:42.564904 62801 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0729 11:40:42.574522 62801 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0729 11:40:42.574633 62801 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0729 11:40:42.586210 62801 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0729 11:40:42.596972 62801 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0729 11:40:42.597045 62801 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0729 11:40:42.607126 62801 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0729 11:40:42.617261 62801 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0729 11:40:42.617328 62801 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0729 11:40:42.627820 62801 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0729 11:40:42.708741 62801 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0729 11:40:42.708826 62801 kubeadm.go:310] [preflight] Running pre-flight checks
I0729 11:40:42.880490 62801 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0729 11:40:42.880629 62801 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0729 11:40:42.880751 62801 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0729 11:40:43.085917 62801 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0729 11:40:43.088974 62801 out.go:204] - Generating certificates and keys ...
I0729 11:40:43.089103 62801 kubeadm.go:310] [certs] Using existing ca certificate authority
I0729 11:40:43.089195 62801 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0729 11:40:43.089301 62801 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0729 11:40:43.089381 62801 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0729 11:40:43.089465 62801 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0729 11:40:43.089528 62801 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0729 11:40:43.089609 62801 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0729 11:40:43.089681 62801 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0729 11:40:43.090212 62801 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0729 11:40:43.090624 62801 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0729 11:40:43.090843 62801 kubeadm.go:310] [certs] Using the existing "sa" key
I0729 11:40:43.090930 62801 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0729 11:40:43.282427 62801 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0729 11:40:43.639332 62801 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0729 11:40:43.811506 62801 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0729 11:40:43.885780 62801 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0729 11:40:43.902900 62801 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0729 11:40:43.903996 62801 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0729 11:40:43.904044 62801 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0729 11:40:44.063352 62801 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0729 11:40:44.065384 62801 out.go:204] - Booting up control plane ...
I0729 11:40:44.065516 62801 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0729 11:40:44.072602 62801 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0729 11:40:44.072711 62801 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0729 11:40:44.073464 62801 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0729 11:40:44.075810 62801 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0729 11:41:24.078382 62801 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0729 11:41:24.078765 62801 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0729 11:41:24.079032 62801 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0729 11:41:29.079540 62801 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0729 11:41:29.079765 62801 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0729 11:41:39.080241 62801 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0729 11:41:39.080502 62801 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0729 11:41:59.079481 62801 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0729 11:41:59.079731 62801 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0729 11:42:39.079416 62801 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0729 11:42:39.079618 62801 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0729 11:42:39.079628 62801 kubeadm.go:310]
I0729 11:42:39.079668 62801 kubeadm.go:310] Unfortunately, an error has occurred:
I0729 11:42:39.079713 62801 kubeadm.go:310] timed out waiting for the condition
I0729 11:42:39.079723 62801 kubeadm.go:310]
I0729 11:42:39.079757 62801 kubeadm.go:310] This error is likely caused by:
I0729 11:42:39.079792 62801 kubeadm.go:310] - The kubelet is not running
I0729 11:42:39.079939 62801 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0729 11:42:39.079953 62801 kubeadm.go:310]
I0729 11:42:39.080101 62801 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0729 11:42:39.080136 62801 kubeadm.go:310] - 'systemctl status kubelet'
I0729 11:42:39.080181 62801 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0729 11:42:39.080191 62801 kubeadm.go:310]
I0729 11:42:39.080366 62801 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0729 11:42:39.080482 62801 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0729 11:42:39.080498 62801 kubeadm.go:310]
I0729 11:42:39.080613 62801 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0729 11:42:39.080708 62801 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0729 11:42:39.080802 62801 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0729 11:42:39.080932 62801 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0729 11:42:39.080966 62801 kubeadm.go:310]
I0729 11:42:39.081863 62801 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0729 11:42:39.081965 62801 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0729 11:42:39.082053 62801 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0729 11:42:39.082116 62801 kubeadm.go:394] duration metric: took 3m57.581877975s to StartCluster
I0729 11:42:39.082188 62801 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0729 11:42:39.082248 62801 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0729 11:42:39.124552 62801 cri.go:89] found id: ""
I0729 11:42:39.124584 62801 logs.go:276] 0 containers: []
W0729 11:42:39.124594 62801 logs.go:278] No container was found matching "kube-apiserver"
I0729 11:42:39.124600 62801 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0729 11:42:39.124679 62801 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0729 11:42:39.160466 62801 cri.go:89] found id: ""
I0729 11:42:39.160494 62801 logs.go:276] 0 containers: []
W0729 11:42:39.160502 62801 logs.go:278] No container was found matching "etcd"
I0729 11:42:39.160516 62801 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0729 11:42:39.160589 62801 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0729 11:42:39.195258 62801 cri.go:89] found id: ""
I0729 11:42:39.195289 62801 logs.go:276] 0 containers: []
W0729 11:42:39.195301 62801 logs.go:278] No container was found matching "coredns"
I0729 11:42:39.195309 62801 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0729 11:42:39.195375 62801 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0729 11:42:39.231951 62801 cri.go:89] found id: ""
I0729 11:42:39.231978 62801 logs.go:276] 0 containers: []
W0729 11:42:39.231985 62801 logs.go:278] No container was found matching "kube-scheduler"
I0729 11:42:39.231990 62801 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0729 11:42:39.232048 62801 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0729 11:42:39.266854 62801 cri.go:89] found id: ""
I0729 11:42:39.266877 62801 logs.go:276] 0 containers: []
W0729 11:42:39.266885 62801 logs.go:278] No container was found matching "kube-proxy"
I0729 11:42:39.266890 62801 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0729 11:42:39.266950 62801 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0729 11:42:39.305583 62801 cri.go:89] found id: ""
I0729 11:42:39.305610 62801 logs.go:276] 0 containers: []
W0729 11:42:39.305618 62801 logs.go:278] No container was found matching "kube-controller-manager"
I0729 11:42:39.305624 62801 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0729 11:42:39.305685 62801 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0729 11:42:39.340805 62801 cri.go:89] found id: ""
I0729 11:42:39.340833 62801 logs.go:276] 0 containers: []
W0729 11:42:39.340842 62801 logs.go:278] No container was found matching "kindnet"
I0729 11:42:39.340851 62801 logs.go:123] Gathering logs for container status ...
I0729 11:42:39.340862 62801 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0729 11:42:39.395029 62801 logs.go:123] Gathering logs for kubelet ...
I0729 11:42:39.395060 62801 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0729 11:42:39.451495 62801 logs.go:123] Gathering logs for dmesg ...
I0729 11:42:39.451533 62801 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0729 11:42:39.471788 62801 logs.go:123] Gathering logs for describe nodes ...
I0729 11:42:39.471817 62801 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0729 11:42:39.593021 62801 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0729 11:42:39.593050 62801 logs.go:123] Gathering logs for CRI-O ...
I0729 11:42:39.593063 62801 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
W0729 11:42:39.692335 62801 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0729 11:42:39.692385 62801 out.go:239] *
*
W0729 11:42:39.692453 62801 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0729 11:42:39.692482 62801 out.go:239] *
*
W0729 11:42:39.693322 62801 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0729 11:42:39.696297 62801 out.go:177]
W0729 11:42:39.697413 62801 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0729 11:42:39.697459 62801 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0729 11:42:39.697487 62801 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0729 11:42:39.699065 62801 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-188043 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-188043 -n old-k8s-version-188043
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-188043 -n old-k8s-version-188043: exit status 6 (222.196014ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0729 11:42:39.968757 69510 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-188043" does not appear in /home/jenkins/minikube-integration/19337-3845/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-188043" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (295.56s)