=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-909137 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-909137 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m32.023280005s)
-- stdout --
* [old-k8s-version-909137] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=18429
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/18429-1106816/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/18429-1106816/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-909137" primary control-plane node in "old-k8s-version-909137" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0318 13:38:44.059533 1154224 out.go:291] Setting OutFile to fd 1 ...
I0318 13:38:44.059658 1154224 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0318 13:38:44.059669 1154224 out.go:304] Setting ErrFile to fd 2...
I0318 13:38:44.059674 1154224 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0318 13:38:44.059849 1154224 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18429-1106816/.minikube/bin
I0318 13:38:44.060526 1154224 out.go:298] Setting JSON to false
I0318 13:38:44.061596 1154224 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-10","uptime":19271,"bootTime":1710749853,"procs":218,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1053-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0318 13:38:44.061665 1154224 start.go:139] virtualization: kvm guest
I0318 13:38:44.063825 1154224 out.go:177] * [old-k8s-version-909137] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
I0318 13:38:44.065303 1154224 out.go:177] - MINIKUBE_LOCATION=18429
I0318 13:38:44.066580 1154224 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0318 13:38:44.065340 1154224 notify.go:220] Checking for updates...
I0318 13:38:44.069130 1154224 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18429-1106816/kubeconfig
I0318 13:38:44.070522 1154224 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18429-1106816/.minikube
I0318 13:38:44.071641 1154224 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0318 13:38:44.072776 1154224 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0318 13:38:44.074305 1154224 config.go:182] Loaded profile config "cert-expiration-537883": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0318 13:38:44.074430 1154224 config.go:182] Loaded profile config "kubernetes-upgrade-599578": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.29.0-rc.2
I0318 13:38:44.074600 1154224 config.go:182] Loaded profile config "pause-760389": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0318 13:38:44.074726 1154224 driver.go:392] Setting default libvirt URI to qemu:///system
I0318 13:38:44.116708 1154224 out.go:177] * Using the kvm2 driver based on user configuration
I0318 13:38:44.118080 1154224 start.go:297] selected driver: kvm2
I0318 13:38:44.118099 1154224 start.go:901] validating driver "kvm2" against <nil>
I0318 13:38:44.118110 1154224 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0318 13:38:44.118820 1154224 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0318 13:38:44.118906 1154224 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/18429-1106816/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0318 13:38:44.135243 1154224 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.32.0
I0318 13:38:44.135291 1154224 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0318 13:38:44.135512 1154224 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0318 13:38:44.135587 1154224 cni.go:84] Creating CNI manager for ""
I0318 13:38:44.135610 1154224 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0318 13:38:44.135623 1154224 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0318 13:38:44.135710 1154224 start.go:340] cluster config:
{Name:old-k8s-version-909137 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-909137 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0318 13:38:44.135855 1154224 iso.go:125] acquiring lock: {Name:mke5f9989ad60de6f54f25c411af7da9f3932a4d Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0318 13:38:44.138585 1154224 out.go:177] * Starting "old-k8s-version-909137" primary control-plane node in "old-k8s-version-909137" cluster
I0318 13:38:44.139921 1154224 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0318 13:38:44.139977 1154224 preload.go:147] Found local preload: /home/jenkins/minikube-integration/18429-1106816/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0318 13:38:44.139989 1154224 cache.go:56] Caching tarball of preloaded images
I0318 13:38:44.140063 1154224 preload.go:173] Found /home/jenkins/minikube-integration/18429-1106816/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0318 13:38:44.140076 1154224 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0318 13:38:44.140184 1154224 profile.go:142] Saving config to /home/jenkins/minikube-integration/18429-1106816/.minikube/profiles/old-k8s-version-909137/config.json ...
I0318 13:38:44.140208 1154224 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18429-1106816/.minikube/profiles/old-k8s-version-909137/config.json: {Name:mk778ed3e00301bfc3f00d260272d8c81e783af5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0318 13:38:44.140400 1154224 start.go:360] acquireMachinesLock for old-k8s-version-909137: {Name:mk0b1a2e71faf079d0c16c4e1393bdff17be3dfd Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0318 13:38:44.140445 1154224 start.go:364] duration metric: took 26.354µs to acquireMachinesLock for "old-k8s-version-909137"
I0318 13:38:44.140469 1154224 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-909137 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17991/minikube-v1.32.1-1710520390-17991-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-909137 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0318 13:38:44.140546 1154224 start.go:125] createHost starting for "" (driver="kvm2")
I0318 13:38:44.142419 1154224 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0318 13:38:44.142559 1154224 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0318 13:38:44.142601 1154224 main.go:141] libmachine: Launching plugin server for driver kvm2
I0318 13:38:44.157225 1154224 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45127
I0318 13:38:44.157683 1154224 main.go:141] libmachine: () Calling .GetVersion
I0318 13:38:44.158272 1154224 main.go:141] libmachine: Using API Version 1
I0318 13:38:44.158320 1154224 main.go:141] libmachine: () Calling .SetConfigRaw
I0318 13:38:44.158637 1154224 main.go:141] libmachine: () Calling .GetMachineName
I0318 13:38:44.158891 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetMachineName
I0318 13:38:44.159059 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .DriverName
I0318 13:38:44.159249 1154224 start.go:159] libmachine.API.Create for "old-k8s-version-909137" (driver="kvm2")
I0318 13:38:44.159280 1154224 client.go:168] LocalClient.Create starting
I0318 13:38:44.159318 1154224 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18429-1106816/.minikube/certs/ca.pem
I0318 13:38:44.159370 1154224 main.go:141] libmachine: Decoding PEM data...
I0318 13:38:44.159391 1154224 main.go:141] libmachine: Parsing certificate...
I0318 13:38:44.159468 1154224 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18429-1106816/.minikube/certs/cert.pem
I0318 13:38:44.159505 1154224 main.go:141] libmachine: Decoding PEM data...
I0318 13:38:44.159522 1154224 main.go:141] libmachine: Parsing certificate...
I0318 13:38:44.159557 1154224 main.go:141] libmachine: Running pre-create checks...
I0318 13:38:44.159568 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .PreCreateCheck
I0318 13:38:44.159992 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetConfigRaw
I0318 13:38:44.160544 1154224 main.go:141] libmachine: Creating machine...
I0318 13:38:44.160569 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .Create
I0318 13:38:44.160726 1154224 main.go:141] libmachine: (old-k8s-version-909137) Creating KVM machine...
I0318 13:38:44.161896 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | found existing default KVM network
I0318 13:38:44.163111 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | I0318 13:38:44.162966 1154246 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:e0:7b:bf} reservation:<nil>}
I0318 13:38:44.164013 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | I0318 13:38:44.163917 1154246 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:43:1f:81} reservation:<nil>}
I0318 13:38:44.165055 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | I0318 13:38:44.164953 1154246 network.go:211] skipping subnet 192.168.61.0/24 that is taken: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName:virbr3 IfaceIPv4:192.168.61.1 IfaceMTU:1500 IfaceMAC:52:54:00:6d:3c:f3} reservation:<nil>}
I0318 13:38:44.166149 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | I0318 13:38:44.166056 1154246 network.go:206] using free private subnet 192.168.72.0/24: &{IP:192.168.72.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.72.0/24 Gateway:192.168.72.1 ClientMin:192.168.72.2 ClientMax:192.168.72.254 Broadcast:192.168.72.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0002f7170}
I0318 13:38:44.166181 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | created network xml:
I0318 13:38:44.166197 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | <network>
I0318 13:38:44.166211 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | <name>mk-old-k8s-version-909137</name>
I0318 13:38:44.166219 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | <dns enable='no'/>
I0318 13:38:44.166225 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG |
I0318 13:38:44.166237 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | <ip address='192.168.72.1' netmask='255.255.255.0'>
I0318 13:38:44.166250 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | <dhcp>
I0318 13:38:44.166263 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | <range start='192.168.72.2' end='192.168.72.253'/>
I0318 13:38:44.166274 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | </dhcp>
I0318 13:38:44.166288 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | </ip>
I0318 13:38:44.166299 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG |
I0318 13:38:44.166312 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | </network>
I0318 13:38:44.166318 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG |
I0318 13:38:44.171680 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | trying to create private KVM network mk-old-k8s-version-909137 192.168.72.0/24...
I0318 13:38:44.240741 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | private KVM network mk-old-k8s-version-909137 192.168.72.0/24 created
I0318 13:38:44.240779 1154224 main.go:141] libmachine: (old-k8s-version-909137) Setting up store path in /home/jenkins/minikube-integration/18429-1106816/.minikube/machines/old-k8s-version-909137 ...
I0318 13:38:44.240803 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | I0318 13:38:44.240740 1154246 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/18429-1106816/.minikube
I0318 13:38:44.240823 1154224 main.go:141] libmachine: (old-k8s-version-909137) Building disk image from file:///home/jenkins/minikube-integration/18429-1106816/.minikube/cache/iso/amd64/minikube-v1.32.1-1710520390-17991-amd64.iso
I0318 13:38:44.240902 1154224 main.go:141] libmachine: (old-k8s-version-909137) Downloading /home/jenkins/minikube-integration/18429-1106816/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/18429-1106816/.minikube/cache/iso/amd64/minikube-v1.32.1-1710520390-17991-amd64.iso...
I0318 13:38:44.490680 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | I0318 13:38:44.490559 1154246 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/18429-1106816/.minikube/machines/old-k8s-version-909137/id_rsa...
I0318 13:38:44.607447 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | I0318 13:38:44.607325 1154246 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/18429-1106816/.minikube/machines/old-k8s-version-909137/old-k8s-version-909137.rawdisk...
I0318 13:38:44.607481 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | Writing magic tar header
I0318 13:38:44.607501 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | Writing SSH key tar header
I0318 13:38:44.607566 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | I0318 13:38:44.607495 1154246 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/18429-1106816/.minikube/machines/old-k8s-version-909137 ...
I0318 13:38:44.607677 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18429-1106816/.minikube/machines/old-k8s-version-909137
I0318 13:38:44.607720 1154224 main.go:141] libmachine: (old-k8s-version-909137) Setting executable bit set on /home/jenkins/minikube-integration/18429-1106816/.minikube/machines/old-k8s-version-909137 (perms=drwx------)
I0318 13:38:44.607738 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18429-1106816/.minikube/machines
I0318 13:38:44.607757 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18429-1106816/.minikube
I0318 13:38:44.607770 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18429-1106816
I0318 13:38:44.607796 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0318 13:38:44.607813 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | Checking permissions on dir: /home/jenkins
I0318 13:38:44.607828 1154224 main.go:141] libmachine: (old-k8s-version-909137) Setting executable bit set on /home/jenkins/minikube-integration/18429-1106816/.minikube/machines (perms=drwxr-xr-x)
I0318 13:38:44.607843 1154224 main.go:141] libmachine: (old-k8s-version-909137) Setting executable bit set on /home/jenkins/minikube-integration/18429-1106816/.minikube (perms=drwxr-xr-x)
I0318 13:38:44.607855 1154224 main.go:141] libmachine: (old-k8s-version-909137) Setting executable bit set on /home/jenkins/minikube-integration/18429-1106816 (perms=drwxrwxr-x)
I0318 13:38:44.607865 1154224 main.go:141] libmachine: (old-k8s-version-909137) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0318 13:38:44.607876 1154224 main.go:141] libmachine: (old-k8s-version-909137) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0318 13:38:44.607887 1154224 main.go:141] libmachine: (old-k8s-version-909137) Creating domain...
I0318 13:38:44.607916 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | Checking permissions on dir: /home
I0318 13:38:44.607942 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | Skipping /home - not owner
I0318 13:38:44.609038 1154224 main.go:141] libmachine: (old-k8s-version-909137) define libvirt domain using xml:
I0318 13:38:44.609064 1154224 main.go:141] libmachine: (old-k8s-version-909137) <domain type='kvm'>
I0318 13:38:44.609076 1154224 main.go:141] libmachine: (old-k8s-version-909137) <name>old-k8s-version-909137</name>
I0318 13:38:44.609083 1154224 main.go:141] libmachine: (old-k8s-version-909137) <memory unit='MiB'>2200</memory>
I0318 13:38:44.609091 1154224 main.go:141] libmachine: (old-k8s-version-909137) <vcpu>2</vcpu>
I0318 13:38:44.609098 1154224 main.go:141] libmachine: (old-k8s-version-909137) <features>
I0318 13:38:44.609118 1154224 main.go:141] libmachine: (old-k8s-version-909137) <acpi/>
I0318 13:38:44.609125 1154224 main.go:141] libmachine: (old-k8s-version-909137) <apic/>
I0318 13:38:44.609130 1154224 main.go:141] libmachine: (old-k8s-version-909137) <pae/>
I0318 13:38:44.609137 1154224 main.go:141] libmachine: (old-k8s-version-909137)
I0318 13:38:44.609159 1154224 main.go:141] libmachine: (old-k8s-version-909137) </features>
I0318 13:38:44.609185 1154224 main.go:141] libmachine: (old-k8s-version-909137) <cpu mode='host-passthrough'>
I0318 13:38:44.609215 1154224 main.go:141] libmachine: (old-k8s-version-909137)
I0318 13:38:44.609240 1154224 main.go:141] libmachine: (old-k8s-version-909137) </cpu>
I0318 13:38:44.609250 1154224 main.go:141] libmachine: (old-k8s-version-909137) <os>
I0318 13:38:44.609262 1154224 main.go:141] libmachine: (old-k8s-version-909137) <type>hvm</type>
I0318 13:38:44.609274 1154224 main.go:141] libmachine: (old-k8s-version-909137) <boot dev='cdrom'/>
I0318 13:38:44.609288 1154224 main.go:141] libmachine: (old-k8s-version-909137) <boot dev='hd'/>
I0318 13:38:44.609302 1154224 main.go:141] libmachine: (old-k8s-version-909137) <bootmenu enable='no'/>
I0318 13:38:44.609330 1154224 main.go:141] libmachine: (old-k8s-version-909137) </os>
I0318 13:38:44.609342 1154224 main.go:141] libmachine: (old-k8s-version-909137) <devices>
I0318 13:38:44.609361 1154224 main.go:141] libmachine: (old-k8s-version-909137) <disk type='file' device='cdrom'>
I0318 13:38:44.609379 1154224 main.go:141] libmachine: (old-k8s-version-909137) <source file='/home/jenkins/minikube-integration/18429-1106816/.minikube/machines/old-k8s-version-909137/boot2docker.iso'/>
I0318 13:38:44.609399 1154224 main.go:141] libmachine: (old-k8s-version-909137) <target dev='hdc' bus='scsi'/>
I0318 13:38:44.609411 1154224 main.go:141] libmachine: (old-k8s-version-909137) <readonly/>
I0318 13:38:44.609421 1154224 main.go:141] libmachine: (old-k8s-version-909137) </disk>
I0318 13:38:44.609433 1154224 main.go:141] libmachine: (old-k8s-version-909137) <disk type='file' device='disk'>
I0318 13:38:44.609446 1154224 main.go:141] libmachine: (old-k8s-version-909137) <driver name='qemu' type='raw' cache='default' io='threads' />
I0318 13:38:44.609462 1154224 main.go:141] libmachine: (old-k8s-version-909137) <source file='/home/jenkins/minikube-integration/18429-1106816/.minikube/machines/old-k8s-version-909137/old-k8s-version-909137.rawdisk'/>
I0318 13:38:44.609474 1154224 main.go:141] libmachine: (old-k8s-version-909137) <target dev='hda' bus='virtio'/>
I0318 13:38:44.609497 1154224 main.go:141] libmachine: (old-k8s-version-909137) </disk>
I0318 13:38:44.609523 1154224 main.go:141] libmachine: (old-k8s-version-909137) <interface type='network'>
I0318 13:38:44.609549 1154224 main.go:141] libmachine: (old-k8s-version-909137) <source network='mk-old-k8s-version-909137'/>
I0318 13:38:44.609560 1154224 main.go:141] libmachine: (old-k8s-version-909137) <model type='virtio'/>
I0318 13:38:44.609570 1154224 main.go:141] libmachine: (old-k8s-version-909137) </interface>
I0318 13:38:44.609580 1154224 main.go:141] libmachine: (old-k8s-version-909137) <interface type='network'>
I0318 13:38:44.609589 1154224 main.go:141] libmachine: (old-k8s-version-909137) <source network='default'/>
I0318 13:38:44.609599 1154224 main.go:141] libmachine: (old-k8s-version-909137) <model type='virtio'/>
I0318 13:38:44.609621 1154224 main.go:141] libmachine: (old-k8s-version-909137) </interface>
I0318 13:38:44.609642 1154224 main.go:141] libmachine: (old-k8s-version-909137) <serial type='pty'>
I0318 13:38:44.609653 1154224 main.go:141] libmachine: (old-k8s-version-909137) <target port='0'/>
I0318 13:38:44.609664 1154224 main.go:141] libmachine: (old-k8s-version-909137) </serial>
I0318 13:38:44.609677 1154224 main.go:141] libmachine: (old-k8s-version-909137) <console type='pty'>
I0318 13:38:44.609689 1154224 main.go:141] libmachine: (old-k8s-version-909137) <target type='serial' port='0'/>
I0318 13:38:44.609714 1154224 main.go:141] libmachine: (old-k8s-version-909137) </console>
I0318 13:38:44.609725 1154224 main.go:141] libmachine: (old-k8s-version-909137) <rng model='virtio'>
I0318 13:38:44.609743 1154224 main.go:141] libmachine: (old-k8s-version-909137) <backend model='random'>/dev/random</backend>
I0318 13:38:44.609760 1154224 main.go:141] libmachine: (old-k8s-version-909137) </rng>
I0318 13:38:44.609768 1154224 main.go:141] libmachine: (old-k8s-version-909137)
I0318 13:38:44.609777 1154224 main.go:141] libmachine: (old-k8s-version-909137)
I0318 13:38:44.609786 1154224 main.go:141] libmachine: (old-k8s-version-909137) </devices>
I0318 13:38:44.609796 1154224 main.go:141] libmachine: (old-k8s-version-909137) </domain>
I0318 13:38:44.609807 1154224 main.go:141] libmachine: (old-k8s-version-909137)
I0318 13:38:44.614102 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has defined MAC address 52:54:00:33:9d:94 in network default
I0318 13:38:44.614969 1154224 main.go:141] libmachine: (old-k8s-version-909137) Ensuring networks are active...
I0318 13:38:44.614999 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has defined MAC address 52:54:00:58:c0:cb in network mk-old-k8s-version-909137
I0318 13:38:44.615813 1154224 main.go:141] libmachine: (old-k8s-version-909137) Ensuring network default is active
I0318 13:38:44.616149 1154224 main.go:141] libmachine: (old-k8s-version-909137) Ensuring network mk-old-k8s-version-909137 is active
I0318 13:38:44.616723 1154224 main.go:141] libmachine: (old-k8s-version-909137) Getting domain xml...
I0318 13:38:44.617402 1154224 main.go:141] libmachine: (old-k8s-version-909137) Creating domain...
I0318 13:38:45.868960 1154224 main.go:141] libmachine: (old-k8s-version-909137) Waiting to get IP...
I0318 13:38:45.869762 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has defined MAC address 52:54:00:58:c0:cb in network mk-old-k8s-version-909137
I0318 13:38:45.870317 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | unable to find current IP address of domain old-k8s-version-909137 in network mk-old-k8s-version-909137
I0318 13:38:45.870374 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | I0318 13:38:45.870299 1154246 retry.go:31] will retry after 290.822684ms: waiting for machine to come up
I0318 13:38:46.162874 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has defined MAC address 52:54:00:58:c0:cb in network mk-old-k8s-version-909137
I0318 13:38:46.163462 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | unable to find current IP address of domain old-k8s-version-909137 in network mk-old-k8s-version-909137
I0318 13:38:46.163494 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | I0318 13:38:46.163425 1154246 retry.go:31] will retry after 375.060474ms: waiting for machine to come up
I0318 13:38:46.539990 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has defined MAC address 52:54:00:58:c0:cb in network mk-old-k8s-version-909137
I0318 13:38:46.540655 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | unable to find current IP address of domain old-k8s-version-909137 in network mk-old-k8s-version-909137
I0318 13:38:46.540705 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | I0318 13:38:46.540602 1154246 retry.go:31] will retry after 429.060227ms: waiting for machine to come up
I0318 13:38:46.971151 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has defined MAC address 52:54:00:58:c0:cb in network mk-old-k8s-version-909137
I0318 13:38:46.971658 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | unable to find current IP address of domain old-k8s-version-909137 in network mk-old-k8s-version-909137
I0318 13:38:46.971691 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | I0318 13:38:46.971604 1154246 retry.go:31] will retry after 453.902765ms: waiting for machine to come up
I0318 13:38:47.427366 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has defined MAC address 52:54:00:58:c0:cb in network mk-old-k8s-version-909137
I0318 13:38:47.427883 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | unable to find current IP address of domain old-k8s-version-909137 in network mk-old-k8s-version-909137
I0318 13:38:47.427916 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | I0318 13:38:47.427816 1154246 retry.go:31] will retry after 654.68348ms: waiting for machine to come up
I0318 13:38:48.084403 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has defined MAC address 52:54:00:58:c0:cb in network mk-old-k8s-version-909137
I0318 13:38:48.085097 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | unable to find current IP address of domain old-k8s-version-909137 in network mk-old-k8s-version-909137
I0318 13:38:48.085141 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | I0318 13:38:48.085033 1154246 retry.go:31] will retry after 684.802787ms: waiting for machine to come up
I0318 13:38:48.772014 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has defined MAC address 52:54:00:58:c0:cb in network mk-old-k8s-version-909137
I0318 13:38:48.772528 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | unable to find current IP address of domain old-k8s-version-909137 in network mk-old-k8s-version-909137
I0318 13:38:48.772560 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | I0318 13:38:48.772461 1154246 retry.go:31] will retry after 818.732899ms: waiting for machine to come up
I0318 13:38:49.593122 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has defined MAC address 52:54:00:58:c0:cb in network mk-old-k8s-version-909137
I0318 13:38:49.593715 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | unable to find current IP address of domain old-k8s-version-909137 in network mk-old-k8s-version-909137
I0318 13:38:49.593745 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | I0318 13:38:49.593662 1154246 retry.go:31] will retry after 1.294798056s: waiting for machine to come up
I0318 13:38:50.890541 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has defined MAC address 52:54:00:58:c0:cb in network mk-old-k8s-version-909137
I0318 13:38:50.890994 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | unable to find current IP address of domain old-k8s-version-909137 in network mk-old-k8s-version-909137
I0318 13:38:50.891070 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | I0318 13:38:50.890965 1154246 retry.go:31] will retry after 1.271577524s: waiting for machine to come up
I0318 13:38:52.164620 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has defined MAC address 52:54:00:58:c0:cb in network mk-old-k8s-version-909137
I0318 13:38:52.165180 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | unable to find current IP address of domain old-k8s-version-909137 in network mk-old-k8s-version-909137
I0318 13:38:52.165212 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | I0318 13:38:52.165114 1154246 retry.go:31] will retry after 1.447227556s: waiting for machine to come up
I0318 13:38:53.614195 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has defined MAC address 52:54:00:58:c0:cb in network mk-old-k8s-version-909137
I0318 13:38:53.614827 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | unable to find current IP address of domain old-k8s-version-909137 in network mk-old-k8s-version-909137
I0318 13:38:53.614861 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | I0318 13:38:53.614771 1154246 retry.go:31] will retry after 2.765609306s: waiting for machine to come up
I0318 13:38:56.381666 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has defined MAC address 52:54:00:58:c0:cb in network mk-old-k8s-version-909137
I0318 13:38:56.382289 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | unable to find current IP address of domain old-k8s-version-909137 in network mk-old-k8s-version-909137
I0318 13:38:56.382318 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | I0318 13:38:56.382225 1154246 retry.go:31] will retry after 2.487143994s: waiting for machine to come up
I0318 13:38:58.870604 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has defined MAC address 52:54:00:58:c0:cb in network mk-old-k8s-version-909137
I0318 13:38:58.871167 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | unable to find current IP address of domain old-k8s-version-909137 in network mk-old-k8s-version-909137
I0318 13:38:58.871193 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | I0318 13:38:58.871111 1154246 retry.go:31] will retry after 3.090822224s: waiting for machine to come up
I0318 13:39:01.964618 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has defined MAC address 52:54:00:58:c0:cb in network mk-old-k8s-version-909137
I0318 13:39:01.965115 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | unable to find current IP address of domain old-k8s-version-909137 in network mk-old-k8s-version-909137
I0318 13:39:01.965145 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | I0318 13:39:01.965068 1154246 retry.go:31] will retry after 4.345365249s: waiting for machine to come up
I0318 13:39:06.312811 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has defined MAC address 52:54:00:58:c0:cb in network mk-old-k8s-version-909137
I0318 13:39:06.313323 1154224 main.go:141] libmachine: (old-k8s-version-909137) Found IP for machine: 192.168.72.135
I0318 13:39:06.313354 1154224 main.go:141] libmachine: (old-k8s-version-909137) Reserving static IP address...
I0318 13:39:06.313387 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has current primary IP address 192.168.72.135 and MAC address 52:54:00:58:c0:cb in network mk-old-k8s-version-909137
I0318 13:39:06.313713 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-909137", mac: "52:54:00:58:c0:cb", ip: "192.168.72.135"} in network mk-old-k8s-version-909137
I0318 13:39:06.389052 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | Getting to WaitForSSH function...
I0318 13:39:06.389082 1154224 main.go:141] libmachine: (old-k8s-version-909137) Reserved static IP address: 192.168.72.135
I0318 13:39:06.389096 1154224 main.go:141] libmachine: (old-k8s-version-909137) Waiting for SSH to be available...
I0318 13:39:06.391978 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has defined MAC address 52:54:00:58:c0:cb in network mk-old-k8s-version-909137
I0318 13:39:06.392460 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:58:c0:cb", ip: ""} in network mk-old-k8s-version-909137: {Iface:virbr4 ExpiryTime:2024-03-18 14:39:00 +0000 UTC Type:0 Mac:52:54:00:58:c0:cb Iaid: IPaddr:192.168.72.135 Prefix:24 Hostname:minikube Clientid:01:52:54:00:58:c0:cb}
I0318 13:39:06.392492 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has defined IP address 192.168.72.135 and MAC address 52:54:00:58:c0:cb in network mk-old-k8s-version-909137
I0318 13:39:06.392717 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | Using SSH client type: external
I0318 13:39:06.392765 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | Using SSH private key: /home/jenkins/minikube-integration/18429-1106816/.minikube/machines/old-k8s-version-909137/id_rsa (-rw-------)
I0318 13:39:06.392803 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.72.135 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/18429-1106816/.minikube/machines/old-k8s-version-909137/id_rsa -p 22] /usr/bin/ssh <nil>}
I0318 13:39:06.392826 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | About to run SSH command:
I0318 13:39:06.392850 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | exit 0
I0318 13:39:06.521490 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | SSH cmd err, output: <nil>:
I0318 13:39:06.521763 1154224 main.go:141] libmachine: (old-k8s-version-909137) KVM machine creation complete!
I0318 13:39:06.522092 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetConfigRaw
I0318 13:39:06.522790 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .DriverName
I0318 13:39:06.523015 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .DriverName
I0318 13:39:06.523232 1154224 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0318 13:39:06.523250 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetState
I0318 13:39:06.524582 1154224 main.go:141] libmachine: Detecting operating system of created instance...
I0318 13:39:06.524599 1154224 main.go:141] libmachine: Waiting for SSH to be available...
I0318 13:39:06.524606 1154224 main.go:141] libmachine: Getting to WaitForSSH function...
I0318 13:39:06.524633 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetSSHHostname
I0318 13:39:06.527124 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has defined MAC address 52:54:00:58:c0:cb in network mk-old-k8s-version-909137
I0318 13:39:06.527592 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:58:c0:cb", ip: ""} in network mk-old-k8s-version-909137: {Iface:virbr4 ExpiryTime:2024-03-18 14:39:00 +0000 UTC Type:0 Mac:52:54:00:58:c0:cb Iaid: IPaddr:192.168.72.135 Prefix:24 Hostname:old-k8s-version-909137 Clientid:01:52:54:00:58:c0:cb}
I0318 13:39:06.527623 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has defined IP address 192.168.72.135 and MAC address 52:54:00:58:c0:cb in network mk-old-k8s-version-909137
I0318 13:39:06.527753 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetSSHPort
I0318 13:39:06.527973 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetSSHKeyPath
I0318 13:39:06.528170 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetSSHKeyPath
I0318 13:39:06.528353 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetSSHUsername
I0318 13:39:06.528538 1154224 main.go:141] libmachine: Using SSH client type: native
I0318 13:39:06.528777 1154224 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4a0] 0x830200 <nil> [] 0s} 192.168.72.135 22 <nil> <nil>}
I0318 13:39:06.528791 1154224 main.go:141] libmachine: About to run SSH command:
exit 0
I0318 13:39:06.643920 1154224 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0318 13:39:06.643945 1154224 main.go:141] libmachine: Detecting the provisioner...
I0318 13:39:06.643956 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetSSHHostname
I0318 13:39:06.647072 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has defined MAC address 52:54:00:58:c0:cb in network mk-old-k8s-version-909137
I0318 13:39:06.647418 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:58:c0:cb", ip: ""} in network mk-old-k8s-version-909137: {Iface:virbr4 ExpiryTime:2024-03-18 14:39:00 +0000 UTC Type:0 Mac:52:54:00:58:c0:cb Iaid: IPaddr:192.168.72.135 Prefix:24 Hostname:old-k8s-version-909137 Clientid:01:52:54:00:58:c0:cb}
I0318 13:39:06.647449 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has defined IP address 192.168.72.135 and MAC address 52:54:00:58:c0:cb in network mk-old-k8s-version-909137
I0318 13:39:06.647578 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetSSHPort
I0318 13:39:06.647773 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetSSHKeyPath
I0318 13:39:06.647941 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetSSHKeyPath
I0318 13:39:06.648083 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetSSHUsername
I0318 13:39:06.648247 1154224 main.go:141] libmachine: Using SSH client type: native
I0318 13:39:06.648532 1154224 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4a0] 0x830200 <nil> [] 0s} 192.168.72.135 22 <nil> <nil>}
I0318 13:39:06.648549 1154224 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0318 13:39:06.757825 1154224 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0318 13:39:06.757897 1154224 main.go:141] libmachine: found compatible host: buildroot
I0318 13:39:06.757907 1154224 main.go:141] libmachine: Provisioning with buildroot...
I0318 13:39:06.757918 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetMachineName
I0318 13:39:06.758178 1154224 buildroot.go:166] provisioning hostname "old-k8s-version-909137"
I0318 13:39:06.758203 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetMachineName
I0318 13:39:06.758392 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetSSHHostname
I0318 13:39:06.760960 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has defined MAC address 52:54:00:58:c0:cb in network mk-old-k8s-version-909137
I0318 13:39:06.761334 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:58:c0:cb", ip: ""} in network mk-old-k8s-version-909137: {Iface:virbr4 ExpiryTime:2024-03-18 14:39:00 +0000 UTC Type:0 Mac:52:54:00:58:c0:cb Iaid: IPaddr:192.168.72.135 Prefix:24 Hostname:old-k8s-version-909137 Clientid:01:52:54:00:58:c0:cb}
I0318 13:39:06.761362 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has defined IP address 192.168.72.135 and MAC address 52:54:00:58:c0:cb in network mk-old-k8s-version-909137
I0318 13:39:06.761522 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetSSHPort
I0318 13:39:06.761725 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetSSHKeyPath
I0318 13:39:06.761901 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetSSHKeyPath
I0318 13:39:06.762082 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetSSHUsername
I0318 13:39:06.762286 1154224 main.go:141] libmachine: Using SSH client type: native
I0318 13:39:06.762515 1154224 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4a0] 0x830200 <nil> [] 0s} 192.168.72.135 22 <nil> <nil>}
I0318 13:39:06.762533 1154224 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-909137 && echo "old-k8s-version-909137" | sudo tee /etc/hostname
I0318 13:39:06.889898 1154224 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-909137
I0318 13:39:06.889931 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetSSHHostname
I0318 13:39:06.892677 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has defined MAC address 52:54:00:58:c0:cb in network mk-old-k8s-version-909137
I0318 13:39:06.893102 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:58:c0:cb", ip: ""} in network mk-old-k8s-version-909137: {Iface:virbr4 ExpiryTime:2024-03-18 14:39:00 +0000 UTC Type:0 Mac:52:54:00:58:c0:cb Iaid: IPaddr:192.168.72.135 Prefix:24 Hostname:old-k8s-version-909137 Clientid:01:52:54:00:58:c0:cb}
I0318 13:39:06.893135 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has defined IP address 192.168.72.135 and MAC address 52:54:00:58:c0:cb in network mk-old-k8s-version-909137
I0318 13:39:06.893281 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetSSHPort
I0318 13:39:06.893496 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetSSHKeyPath
I0318 13:39:06.893694 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetSSHKeyPath
I0318 13:39:06.893863 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetSSHUsername
I0318 13:39:06.894086 1154224 main.go:141] libmachine: Using SSH client type: native
I0318 13:39:06.894279 1154224 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4a0] 0x830200 <nil> [] 0s} 192.168.72.135 22 <nil> <nil>}
I0318 13:39:06.894303 1154224 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-909137' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-909137/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-909137' | sudo tee -a /etc/hosts;
fi
fi
I0318 13:39:07.011332 1154224 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0318 13:39:07.011392 1154224 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/18429-1106816/.minikube CaCertPath:/home/jenkins/minikube-integration/18429-1106816/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18429-1106816/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18429-1106816/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18429-1106816/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18429-1106816/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18429-1106816/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18429-1106816/.minikube}
I0318 13:39:07.011418 1154224 buildroot.go:174] setting up certificates
I0318 13:39:07.011428 1154224 provision.go:84] configureAuth start
I0318 13:39:07.011438 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetMachineName
I0318 13:39:07.011787 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetIP
I0318 13:39:07.014699 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has defined MAC address 52:54:00:58:c0:cb in network mk-old-k8s-version-909137
I0318 13:39:07.015086 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:58:c0:cb", ip: ""} in network mk-old-k8s-version-909137: {Iface:virbr4 ExpiryTime:2024-03-18 14:39:00 +0000 UTC Type:0 Mac:52:54:00:58:c0:cb Iaid: IPaddr:192.168.72.135 Prefix:24 Hostname:old-k8s-version-909137 Clientid:01:52:54:00:58:c0:cb}
I0318 13:39:07.015110 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has defined IP address 192.168.72.135 and MAC address 52:54:00:58:c0:cb in network mk-old-k8s-version-909137
I0318 13:39:07.015329 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetSSHHostname
I0318 13:39:07.017721 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has defined MAC address 52:54:00:58:c0:cb in network mk-old-k8s-version-909137
I0318 13:39:07.018027 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:58:c0:cb", ip: ""} in network mk-old-k8s-version-909137: {Iface:virbr4 ExpiryTime:2024-03-18 14:39:00 +0000 UTC Type:0 Mac:52:54:00:58:c0:cb Iaid: IPaddr:192.168.72.135 Prefix:24 Hostname:old-k8s-version-909137 Clientid:01:52:54:00:58:c0:cb}
I0318 13:39:07.018057 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has defined IP address 192.168.72.135 and MAC address 52:54:00:58:c0:cb in network mk-old-k8s-version-909137
I0318 13:39:07.018219 1154224 provision.go:143] copyHostCerts
I0318 13:39:07.018311 1154224 exec_runner.go:144] found /home/jenkins/minikube-integration/18429-1106816/.minikube/cert.pem, removing ...
I0318 13:39:07.018325 1154224 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18429-1106816/.minikube/cert.pem
I0318 13:39:07.018418 1154224 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18429-1106816/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18429-1106816/.minikube/cert.pem (1123 bytes)
I0318 13:39:07.018526 1154224 exec_runner.go:144] found /home/jenkins/minikube-integration/18429-1106816/.minikube/key.pem, removing ...
I0318 13:39:07.018537 1154224 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18429-1106816/.minikube/key.pem
I0318 13:39:07.018580 1154224 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18429-1106816/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18429-1106816/.minikube/key.pem (1679 bytes)
I0318 13:39:07.018657 1154224 exec_runner.go:144] found /home/jenkins/minikube-integration/18429-1106816/.minikube/ca.pem, removing ...
I0318 13:39:07.018668 1154224 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18429-1106816/.minikube/ca.pem
I0318 13:39:07.018702 1154224 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18429-1106816/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18429-1106816/.minikube/ca.pem (1078 bytes)
I0318 13:39:07.018765 1154224 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18429-1106816/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18429-1106816/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18429-1106816/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-909137 san=[127.0.0.1 192.168.72.135 localhost minikube old-k8s-version-909137]
I0318 13:39:07.295657 1154224 provision.go:177] copyRemoteCerts
I0318 13:39:07.295727 1154224 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0318 13:39:07.295769 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetSSHHostname
I0318 13:39:07.298439 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has defined MAC address 52:54:00:58:c0:cb in network mk-old-k8s-version-909137
I0318 13:39:07.298845 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:58:c0:cb", ip: ""} in network mk-old-k8s-version-909137: {Iface:virbr4 ExpiryTime:2024-03-18 14:39:00 +0000 UTC Type:0 Mac:52:54:00:58:c0:cb Iaid: IPaddr:192.168.72.135 Prefix:24 Hostname:old-k8s-version-909137 Clientid:01:52:54:00:58:c0:cb}
I0318 13:39:07.298882 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has defined IP address 192.168.72.135 and MAC address 52:54:00:58:c0:cb in network mk-old-k8s-version-909137
I0318 13:39:07.299039 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetSSHPort
I0318 13:39:07.299259 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetSSHKeyPath
I0318 13:39:07.299435 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetSSHUsername
I0318 13:39:07.299618 1154224 sshutil.go:53] new ssh client: &{IP:192.168.72.135 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18429-1106816/.minikube/machines/old-k8s-version-909137/id_rsa Username:docker}
I0318 13:39:07.386399 1154224 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18429-1106816/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0318 13:39:07.416513 1154224 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18429-1106816/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0318 13:39:07.447140 1154224 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18429-1106816/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0318 13:39:07.477556 1154224 provision.go:87] duration metric: took 466.114347ms to configureAuth
I0318 13:39:07.477592 1154224 buildroot.go:189] setting minikube options for container-runtime
I0318 13:39:07.477830 1154224 config.go:182] Loaded profile config "old-k8s-version-909137": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0318 13:39:07.477909 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetSSHHostname
I0318 13:39:07.480535 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has defined MAC address 52:54:00:58:c0:cb in network mk-old-k8s-version-909137
I0318 13:39:07.480929 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:58:c0:cb", ip: ""} in network mk-old-k8s-version-909137: {Iface:virbr4 ExpiryTime:2024-03-18 14:39:00 +0000 UTC Type:0 Mac:52:54:00:58:c0:cb Iaid: IPaddr:192.168.72.135 Prefix:24 Hostname:old-k8s-version-909137 Clientid:01:52:54:00:58:c0:cb}
I0318 13:39:07.480984 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has defined IP address 192.168.72.135 and MAC address 52:54:00:58:c0:cb in network mk-old-k8s-version-909137
I0318 13:39:07.481178 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetSSHPort
I0318 13:39:07.481395 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetSSHKeyPath
I0318 13:39:07.481563 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetSSHKeyPath
I0318 13:39:07.481744 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetSSHUsername
I0318 13:39:07.481923 1154224 main.go:141] libmachine: Using SSH client type: native
I0318 13:39:07.482096 1154224 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4a0] 0x830200 <nil> [] 0s} 192.168.72.135 22 <nil> <nil>}
I0318 13:39:07.482111 1154224 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0318 13:39:07.779233 1154224 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0318 13:39:07.779294 1154224 main.go:141] libmachine: Checking connection to Docker...
I0318 13:39:07.779309 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetURL
I0318 13:39:07.780753 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | Using libvirt version 6000000
I0318 13:39:07.783498 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has defined MAC address 52:54:00:58:c0:cb in network mk-old-k8s-version-909137
I0318 13:39:07.783919 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:58:c0:cb", ip: ""} in network mk-old-k8s-version-909137: {Iface:virbr4 ExpiryTime:2024-03-18 14:39:00 +0000 UTC Type:0 Mac:52:54:00:58:c0:cb Iaid: IPaddr:192.168.72.135 Prefix:24 Hostname:old-k8s-version-909137 Clientid:01:52:54:00:58:c0:cb}
I0318 13:39:07.783969 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has defined IP address 192.168.72.135 and MAC address 52:54:00:58:c0:cb in network mk-old-k8s-version-909137
I0318 13:39:07.784127 1154224 main.go:141] libmachine: Docker is up and running!
I0318 13:39:07.784146 1154224 main.go:141] libmachine: Reticulating splines...
I0318 13:39:07.784155 1154224 client.go:171] duration metric: took 23.624862242s to LocalClient.Create
I0318 13:39:07.784186 1154224 start.go:167] duration metric: took 23.624938007s to libmachine.API.Create "old-k8s-version-909137"
I0318 13:39:07.784199 1154224 start.go:293] postStartSetup for "old-k8s-version-909137" (driver="kvm2")
I0318 13:39:07.784215 1154224 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0318 13:39:07.784241 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .DriverName
I0318 13:39:07.784511 1154224 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0318 13:39:07.784539 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetSSHHostname
I0318 13:39:07.786621 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has defined MAC address 52:54:00:58:c0:cb in network mk-old-k8s-version-909137
I0318 13:39:07.786989 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:58:c0:cb", ip: ""} in network mk-old-k8s-version-909137: {Iface:virbr4 ExpiryTime:2024-03-18 14:39:00 +0000 UTC Type:0 Mac:52:54:00:58:c0:cb Iaid: IPaddr:192.168.72.135 Prefix:24 Hostname:old-k8s-version-909137 Clientid:01:52:54:00:58:c0:cb}
I0318 13:39:07.787019 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has defined IP address 192.168.72.135 and MAC address 52:54:00:58:c0:cb in network mk-old-k8s-version-909137
I0318 13:39:07.787194 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetSSHPort
I0318 13:39:07.787387 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetSSHKeyPath
I0318 13:39:07.787553 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetSSHUsername
I0318 13:39:07.787698 1154224 sshutil.go:53] new ssh client: &{IP:192.168.72.135 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18429-1106816/.minikube/machines/old-k8s-version-909137/id_rsa Username:docker}
I0318 13:39:07.872424 1154224 ssh_runner.go:195] Run: cat /etc/os-release
I0318 13:39:07.877848 1154224 info.go:137] Remote host: Buildroot 2023.02.9
I0318 13:39:07.877880 1154224 filesync.go:126] Scanning /home/jenkins/minikube-integration/18429-1106816/.minikube/addons for local assets ...
I0318 13:39:07.877939 1154224 filesync.go:126] Scanning /home/jenkins/minikube-integration/18429-1106816/.minikube/files for local assets ...
I0318 13:39:07.878023 1154224 filesync.go:149] local asset: /home/jenkins/minikube-integration/18429-1106816/.minikube/files/etc/ssl/certs/11141362.pem -> 11141362.pem in /etc/ssl/certs
I0318 13:39:07.878134 1154224 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0318 13:39:07.889346 1154224 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18429-1106816/.minikube/files/etc/ssl/certs/11141362.pem --> /etc/ssl/certs/11141362.pem (1708 bytes)
I0318 13:39:07.917197 1154224 start.go:296] duration metric: took 132.978085ms for postStartSetup
I0318 13:39:07.917252 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetConfigRaw
I0318 13:39:07.917883 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetIP
I0318 13:39:07.920681 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has defined MAC address 52:54:00:58:c0:cb in network mk-old-k8s-version-909137
I0318 13:39:07.921137 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:58:c0:cb", ip: ""} in network mk-old-k8s-version-909137: {Iface:virbr4 ExpiryTime:2024-03-18 14:39:00 +0000 UTC Type:0 Mac:52:54:00:58:c0:cb Iaid: IPaddr:192.168.72.135 Prefix:24 Hostname:old-k8s-version-909137 Clientid:01:52:54:00:58:c0:cb}
I0318 13:39:07.921169 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has defined IP address 192.168.72.135 and MAC address 52:54:00:58:c0:cb in network mk-old-k8s-version-909137
I0318 13:39:07.921550 1154224 profile.go:142] Saving config to /home/jenkins/minikube-integration/18429-1106816/.minikube/profiles/old-k8s-version-909137/config.json ...
I0318 13:39:07.921731 1154224 start.go:128] duration metric: took 23.78117398s to createHost
I0318 13:39:07.921765 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetSSHHostname
I0318 13:39:07.923982 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has defined MAC address 52:54:00:58:c0:cb in network mk-old-k8s-version-909137
I0318 13:39:07.924374 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:58:c0:cb", ip: ""} in network mk-old-k8s-version-909137: {Iface:virbr4 ExpiryTime:2024-03-18 14:39:00 +0000 UTC Type:0 Mac:52:54:00:58:c0:cb Iaid: IPaddr:192.168.72.135 Prefix:24 Hostname:old-k8s-version-909137 Clientid:01:52:54:00:58:c0:cb}
I0318 13:39:07.924415 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has defined IP address 192.168.72.135 and MAC address 52:54:00:58:c0:cb in network mk-old-k8s-version-909137
I0318 13:39:07.924582 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetSSHPort
I0318 13:39:07.924794 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetSSHKeyPath
I0318 13:39:07.924993 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetSSHKeyPath
I0318 13:39:07.925184 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetSSHUsername
I0318 13:39:07.925358 1154224 main.go:141] libmachine: Using SSH client type: native
I0318 13:39:07.925537 1154224 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4a0] 0x830200 <nil> [] 0s} 192.168.72.135 22 <nil> <nil>}
I0318 13:39:07.925547 1154224 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0318 13:39:08.038095 1154224 main.go:141] libmachine: SSH cmd err, output: <nil>: 1710769148.017154927
I0318 13:39:08.038126 1154224 fix.go:216] guest clock: 1710769148.017154927
I0318 13:39:08.038136 1154224 fix.go:229] Guest: 2024-03-18 13:39:08.017154927 +0000 UTC Remote: 2024-03-18 13:39:07.921750471 +0000 UTC m=+23.912467331 (delta=95.404456ms)
I0318 13:39:08.038165 1154224 fix.go:200] guest clock delta is within tolerance: 95.404456ms
I0318 13:39:08.038174 1154224 start.go:83] releasing machines lock for "old-k8s-version-909137", held for 23.897719822s
I0318 13:39:08.038203 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .DriverName
I0318 13:39:08.038501 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetIP
I0318 13:39:08.041474 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has defined MAC address 52:54:00:58:c0:cb in network mk-old-k8s-version-909137
I0318 13:39:08.041880 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:58:c0:cb", ip: ""} in network mk-old-k8s-version-909137: {Iface:virbr4 ExpiryTime:2024-03-18 14:39:00 +0000 UTC Type:0 Mac:52:54:00:58:c0:cb Iaid: IPaddr:192.168.72.135 Prefix:24 Hostname:old-k8s-version-909137 Clientid:01:52:54:00:58:c0:cb}
I0318 13:39:08.041910 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has defined IP address 192.168.72.135 and MAC address 52:54:00:58:c0:cb in network mk-old-k8s-version-909137
I0318 13:39:08.042111 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .DriverName
I0318 13:39:08.042711 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .DriverName
I0318 13:39:08.042922 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .DriverName
I0318 13:39:08.043048 1154224 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0318 13:39:08.043102 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetSSHHostname
I0318 13:39:08.043184 1154224 ssh_runner.go:195] Run: cat /version.json
I0318 13:39:08.043212 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetSSHHostname
I0318 13:39:08.045941 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has defined MAC address 52:54:00:58:c0:cb in network mk-old-k8s-version-909137
I0318 13:39:08.046164 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has defined MAC address 52:54:00:58:c0:cb in network mk-old-k8s-version-909137
I0318 13:39:08.046327 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:58:c0:cb", ip: ""} in network mk-old-k8s-version-909137: {Iface:virbr4 ExpiryTime:2024-03-18 14:39:00 +0000 UTC Type:0 Mac:52:54:00:58:c0:cb Iaid: IPaddr:192.168.72.135 Prefix:24 Hostname:old-k8s-version-909137 Clientid:01:52:54:00:58:c0:cb}
I0318 13:39:08.046362 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has defined IP address 192.168.72.135 and MAC address 52:54:00:58:c0:cb in network mk-old-k8s-version-909137
I0318 13:39:08.046589 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetSSHPort
I0318 13:39:08.046682 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:58:c0:cb", ip: ""} in network mk-old-k8s-version-909137: {Iface:virbr4 ExpiryTime:2024-03-18 14:39:00 +0000 UTC Type:0 Mac:52:54:00:58:c0:cb Iaid: IPaddr:192.168.72.135 Prefix:24 Hostname:old-k8s-version-909137 Clientid:01:52:54:00:58:c0:cb}
I0318 13:39:08.046728 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has defined IP address 192.168.72.135 and MAC address 52:54:00:58:c0:cb in network mk-old-k8s-version-909137
I0318 13:39:08.046769 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetSSHKeyPath
I0318 13:39:08.046929 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetSSHUsername
I0318 13:39:08.047012 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetSSHPort
I0318 13:39:08.047120 1154224 sshutil.go:53] new ssh client: &{IP:192.168.72.135 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18429-1106816/.minikube/machines/old-k8s-version-909137/id_rsa Username:docker}
I0318 13:39:08.047189 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetSSHKeyPath
I0318 13:39:08.047329 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetSSHUsername
I0318 13:39:08.047495 1154224 sshutil.go:53] new ssh client: &{IP:192.168.72.135 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18429-1106816/.minikube/machines/old-k8s-version-909137/id_rsa Username:docker}
I0318 13:39:08.150721 1154224 ssh_runner.go:195] Run: systemctl --version
I0318 13:39:08.159325 1154224 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0318 13:39:08.341670 1154224 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0318 13:39:08.349246 1154224 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0318 13:39:08.349322 1154224 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0318 13:39:08.372010 1154224 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0318 13:39:08.372034 1154224 start.go:494] detecting cgroup driver to use...
I0318 13:39:08.372102 1154224 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0318 13:39:08.392380 1154224 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0318 13:39:08.408165 1154224 docker.go:217] disabling cri-docker service (if available) ...
I0318 13:39:08.408225 1154224 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0318 13:39:08.423844 1154224 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0318 13:39:08.441499 1154224 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0318 13:39:08.570829 1154224 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0318 13:39:08.759583 1154224 docker.go:233] disabling docker service ...
I0318 13:39:08.759663 1154224 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0318 13:39:08.782110 1154224 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0318 13:39:08.802841 1154224 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0318 13:39:08.937365 1154224 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0318 13:39:09.087724 1154224 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0318 13:39:09.116270 1154224 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0318 13:39:09.147098 1154224 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0318 13:39:09.147168 1154224 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0318 13:39:09.161002 1154224 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0318 13:39:09.161082 1154224 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0318 13:39:09.173863 1154224 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0318 13:39:09.186323 1154224 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0318 13:39:09.199334 1154224 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0318 13:39:09.212092 1154224 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0318 13:39:09.223452 1154224 crio.go:148] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0318 13:39:09.223514 1154224 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0318 13:39:09.239226 1154224 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0318 13:39:09.251237 1154224 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0318 13:39:09.390008 1154224 ssh_runner.go:195] Run: sudo systemctl restart crio
I0318 13:39:09.547922 1154224 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0318 13:39:09.548017 1154224 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0318 13:39:09.553613 1154224 start.go:562] Will wait 60s for crictl version
I0318 13:39:09.553676 1154224 ssh_runner.go:195] Run: which crictl
I0318 13:39:09.557964 1154224 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0318 13:39:09.598687 1154224 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0318 13:39:09.598796 1154224 ssh_runner.go:195] Run: crio --version
I0318 13:39:09.635042 1154224 ssh_runner.go:195] Run: crio --version
I0318 13:39:09.674048 1154224 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0318 13:39:09.675316 1154224 main.go:141] libmachine: (old-k8s-version-909137) Calling .GetIP
I0318 13:39:09.678485 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has defined MAC address 52:54:00:58:c0:cb in network mk-old-k8s-version-909137
I0318 13:39:09.678972 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:58:c0:cb", ip: ""} in network mk-old-k8s-version-909137: {Iface:virbr4 ExpiryTime:2024-03-18 14:39:00 +0000 UTC Type:0 Mac:52:54:00:58:c0:cb Iaid: IPaddr:192.168.72.135 Prefix:24 Hostname:old-k8s-version-909137 Clientid:01:52:54:00:58:c0:cb}
I0318 13:39:09.679001 1154224 main.go:141] libmachine: (old-k8s-version-909137) DBG | domain old-k8s-version-909137 has defined IP address 192.168.72.135 and MAC address 52:54:00:58:c0:cb in network mk-old-k8s-version-909137
I0318 13:39:09.679260 1154224 ssh_runner.go:195] Run: grep 192.168.72.1 host.minikube.internal$ /etc/hosts
I0318 13:39:09.686483 1154224 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.72.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0318 13:39:09.704230 1154224 kubeadm.go:877] updating cluster {Name:old-k8s-version-909137 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17991/minikube-v1.32.1-1710520390-17991-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-909137 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.135 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] M
ountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0318 13:39:09.704406 1154224 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0318 13:39:09.704473 1154224 ssh_runner.go:195] Run: sudo crictl images --output json
I0318 13:39:09.747990 1154224 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0318 13:39:09.748064 1154224 ssh_runner.go:195] Run: which lz4
I0318 13:39:09.752676 1154224 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0318 13:39:09.757560 1154224 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0318 13:39:09.757595 1154224 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18429-1106816/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0318 13:39:11.803315 1154224 crio.go:444] duration metric: took 2.050671481s to copy over tarball
I0318 13:39:11.803405 1154224 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0318 13:39:14.934208 1154224 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.130766341s)
I0318 13:39:14.934268 1154224 crio.go:451] duration metric: took 3.13091664s to extract the tarball
I0318 13:39:14.934279 1154224 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0318 13:39:14.980000 1154224 ssh_runner.go:195] Run: sudo crictl images --output json
I0318 13:39:15.037162 1154224 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0318 13:39:15.037194 1154224 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0318 13:39:15.037298 1154224 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0318 13:39:15.037308 1154224 image.go:134] retrieving image: registry.k8s.io/coredns:1.7.0
I0318 13:39:15.037326 1154224 image.go:134] retrieving image: registry.k8s.io/pause:3.2
I0318 13:39:15.037369 1154224 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0318 13:39:15.037404 1154224 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0318 13:39:15.037303 1154224 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0318 13:39:15.037291 1154224 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0318 13:39:15.037375 1154224 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0318 13:39:15.038974 1154224 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0318 13:39:15.039013 1154224 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0318 13:39:15.039055 1154224 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0318 13:39:15.039091 1154224 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0318 13:39:15.039129 1154224 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0318 13:39:15.039183 1154224 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0318 13:39:15.039234 1154224 image.go:177] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0318 13:39:15.039350 1154224 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0318 13:39:15.200725 1154224 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0318 13:39:15.202799 1154224 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0318 13:39:15.207100 1154224 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0318 13:39:15.217555 1154224 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0318 13:39:15.219743 1154224 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0318 13:39:15.319767 1154224 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0318 13:39:15.319827 1154224 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0318 13:39:15.319875 1154224 ssh_runner.go:195] Run: which crictl
I0318 13:39:15.319875 1154224 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0318 13:39:15.319914 1154224 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0318 13:39:15.319960 1154224 ssh_runner.go:195] Run: which crictl
I0318 13:39:15.330074 1154224 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0318 13:39:15.332390 1154224 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0318 13:39:15.357687 1154224 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0318 13:39:15.357737 1154224 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0318 13:39:15.357789 1154224 ssh_runner.go:195] Run: which crictl
I0318 13:39:15.357799 1154224 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0318 13:39:15.357858 1154224 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0318 13:39:15.357908 1154224 ssh_runner.go:195] Run: which crictl
I0318 13:39:15.383802 1154224 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0318 13:39:15.383850 1154224 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0318 13:39:15.383894 1154224 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0318 13:39:15.383932 1154224 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0318 13:39:15.383970 1154224 ssh_runner.go:195] Run: which crictl
I0318 13:39:15.437274 1154224 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0318 13:39:15.437321 1154224 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0318 13:39:15.437374 1154224 ssh_runner.go:195] Run: which crictl
I0318 13:39:15.454700 1154224 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0318 13:39:15.454757 1154224 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0318 13:39:15.454804 1154224 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0318 13:39:15.454819 1154224 ssh_runner.go:195] Run: which crictl
I0318 13:39:15.454824 1154224 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0318 13:39:15.498132 1154224 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18429-1106816/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0318 13:39:15.498188 1154224 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0318 13:39:15.498221 1154224 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18429-1106816/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0318 13:39:15.498271 1154224 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0318 13:39:15.555502 1154224 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0318 13:39:15.555625 1154224 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18429-1106816/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0318 13:39:15.580846 1154224 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18429-1106816/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0318 13:39:15.593087 1154224 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18429-1106816/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0318 13:39:15.608883 1154224 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18429-1106816/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0318 13:39:15.627544 1154224 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18429-1106816/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0318 13:39:15.959790 1154224 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0318 13:39:16.103844 1154224 cache_images.go:92] duration metric: took 1.066629694s to LoadCachedImages
W0318 13:39:16.103956 1154224 out.go:239] X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/18429-1106816/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0: no such file or directory
X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/18429-1106816/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0: no such file or directory
I0318 13:39:16.103975 1154224 kubeadm.go:928] updating node { 192.168.72.135 8443 v1.20.0 crio true true} ...
I0318 13:39:16.104114 1154224 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-909137 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.72.135
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-909137 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0318 13:39:16.104210 1154224 ssh_runner.go:195] Run: crio config
I0318 13:39:16.159469 1154224 cni.go:84] Creating CNI manager for ""
I0318 13:39:16.159489 1154224 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0318 13:39:16.159499 1154224 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0318 13:39:16.159523 1154224 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.72.135 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-909137 NodeName:old-k8s-version-909137 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.72.135"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.72.135 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0318 13:39:16.159701 1154224 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.72.135
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-909137"
kubeletExtraArgs:
node-ip: 192.168.72.135
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.72.135"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0318 13:39:16.159786 1154224 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0318 13:39:16.171376 1154224 binaries.go:44] Found k8s binaries, skipping transfer
I0318 13:39:16.171470 1154224 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0318 13:39:16.182883 1154224 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0318 13:39:16.203177 1154224 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0318 13:39:16.223251 1154224 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0318 13:39:16.243146 1154224 ssh_runner.go:195] Run: grep 192.168.72.135 control-plane.minikube.internal$ /etc/hosts
I0318 13:39:16.247581 1154224 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.72.135 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0318 13:39:16.263010 1154224 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0318 13:39:16.387688 1154224 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0318 13:39:16.406597 1154224 certs.go:68] Setting up /home/jenkins/minikube-integration/18429-1106816/.minikube/profiles/old-k8s-version-909137 for IP: 192.168.72.135
I0318 13:39:16.406624 1154224 certs.go:194] generating shared ca certs ...
I0318 13:39:16.406641 1154224 certs.go:226] acquiring lock for ca certs: {Name:mka24dbce78b8549c3bcfe7842863cce2dcda207 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0318 13:39:16.406836 1154224 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18429-1106816/.minikube/ca.key
I0318 13:39:16.406958 1154224 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18429-1106816/.minikube/proxy-client-ca.key
I0318 13:39:16.406997 1154224 certs.go:256] generating profile certs ...
I0318 13:39:16.407074 1154224 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/18429-1106816/.minikube/profiles/old-k8s-version-909137/client.key
I0318 13:39:16.407092 1154224 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18429-1106816/.minikube/profiles/old-k8s-version-909137/client.crt with IP's: []
I0318 13:39:16.553221 1154224 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18429-1106816/.minikube/profiles/old-k8s-version-909137/client.crt ...
I0318 13:39:16.553254 1154224 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18429-1106816/.minikube/profiles/old-k8s-version-909137/client.crt: {Name:mk4feb3fc7b51c387e2dbc404e902f0bd4659c9c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0318 13:39:16.553454 1154224 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18429-1106816/.minikube/profiles/old-k8s-version-909137/client.key ...
I0318 13:39:16.553477 1154224 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18429-1106816/.minikube/profiles/old-k8s-version-909137/client.key: {Name:mk9153c08e5c972f2782c39d4c5196a3ff57b199 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0318 13:39:16.553630 1154224 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/18429-1106816/.minikube/profiles/old-k8s-version-909137/apiserver.key.e9806bd6
I0318 13:39:16.553654 1154224 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18429-1106816/.minikube/profiles/old-k8s-version-909137/apiserver.crt.e9806bd6 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.72.135]
I0318 13:39:16.907950 1154224 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18429-1106816/.minikube/profiles/old-k8s-version-909137/apiserver.crt.e9806bd6 ...
I0318 13:39:16.907982 1154224 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18429-1106816/.minikube/profiles/old-k8s-version-909137/apiserver.crt.e9806bd6: {Name:mkd5705a12cd6883852f7e10c0c7a4114e6f706d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0318 13:39:16.908136 1154224 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18429-1106816/.minikube/profiles/old-k8s-version-909137/apiserver.key.e9806bd6 ...
I0318 13:39:16.908151 1154224 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18429-1106816/.minikube/profiles/old-k8s-version-909137/apiserver.key.e9806bd6: {Name:mkff0ace5797ea0596435b8fa2df49afad0c225a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0318 13:39:16.908223 1154224 certs.go:381] copying /home/jenkins/minikube-integration/18429-1106816/.minikube/profiles/old-k8s-version-909137/apiserver.crt.e9806bd6 -> /home/jenkins/minikube-integration/18429-1106816/.minikube/profiles/old-k8s-version-909137/apiserver.crt
I0318 13:39:16.908314 1154224 certs.go:385] copying /home/jenkins/minikube-integration/18429-1106816/.minikube/profiles/old-k8s-version-909137/apiserver.key.e9806bd6 -> /home/jenkins/minikube-integration/18429-1106816/.minikube/profiles/old-k8s-version-909137/apiserver.key
I0318 13:39:16.908421 1154224 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/18429-1106816/.minikube/profiles/old-k8s-version-909137/proxy-client.key
I0318 13:39:16.908441 1154224 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18429-1106816/.minikube/profiles/old-k8s-version-909137/proxy-client.crt with IP's: []
I0318 13:39:17.060442 1154224 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18429-1106816/.minikube/profiles/old-k8s-version-909137/proxy-client.crt ...
I0318 13:39:17.060474 1154224 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18429-1106816/.minikube/profiles/old-k8s-version-909137/proxy-client.crt: {Name:mkfe23ff7bbe7838bd0e39a173701079a2ac38a3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0318 13:39:17.060645 1154224 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18429-1106816/.minikube/profiles/old-k8s-version-909137/proxy-client.key ...
I0318 13:39:17.060658 1154224 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18429-1106816/.minikube/profiles/old-k8s-version-909137/proxy-client.key: {Name:mk667f986b9ba2592d7b9ff9633d6f400685eb35 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0318 13:39:17.060969 1154224 certs.go:484] found cert: /home/jenkins/minikube-integration/18429-1106816/.minikube/certs/1114136.pem (1338 bytes)
W0318 13:39:17.061016 1154224 certs.go:480] ignoring /home/jenkins/minikube-integration/18429-1106816/.minikube/certs/1114136_empty.pem, impossibly tiny 0 bytes
I0318 13:39:17.061027 1154224 certs.go:484] found cert: /home/jenkins/minikube-integration/18429-1106816/.minikube/certs/ca-key.pem (1675 bytes)
I0318 13:39:17.061046 1154224 certs.go:484] found cert: /home/jenkins/minikube-integration/18429-1106816/.minikube/certs/ca.pem (1078 bytes)
I0318 13:39:17.061073 1154224 certs.go:484] found cert: /home/jenkins/minikube-integration/18429-1106816/.minikube/certs/cert.pem (1123 bytes)
I0318 13:39:17.061100 1154224 certs.go:484] found cert: /home/jenkins/minikube-integration/18429-1106816/.minikube/certs/key.pem (1679 bytes)
I0318 13:39:17.061139 1154224 certs.go:484] found cert: /home/jenkins/minikube-integration/18429-1106816/.minikube/files/etc/ssl/certs/11141362.pem (1708 bytes)
I0318 13:39:17.061787 1154224 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18429-1106816/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0318 13:39:17.097324 1154224 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18429-1106816/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0318 13:39:17.132554 1154224 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18429-1106816/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0318 13:39:17.174683 1154224 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18429-1106816/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0318 13:39:17.219590 1154224 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18429-1106816/.minikube/profiles/old-k8s-version-909137/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0318 13:39:17.259255 1154224 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18429-1106816/.minikube/profiles/old-k8s-version-909137/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0318 13:39:17.316641 1154224 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18429-1106816/.minikube/profiles/old-k8s-version-909137/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0318 13:39:17.356080 1154224 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18429-1106816/.minikube/profiles/old-k8s-version-909137/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0318 13:39:17.384141 1154224 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18429-1106816/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0318 13:39:17.412146 1154224 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18429-1106816/.minikube/certs/1114136.pem --> /usr/share/ca-certificates/1114136.pem (1338 bytes)
I0318 13:39:17.445413 1154224 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18429-1106816/.minikube/files/etc/ssl/certs/11141362.pem --> /usr/share/ca-certificates/11141362.pem (1708 bytes)
I0318 13:39:17.472839 1154224 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0318 13:39:17.491686 1154224 ssh_runner.go:195] Run: openssl version
I0318 13:39:17.498338 1154224 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0318 13:39:17.510746 1154224 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0318 13:39:17.516060 1154224 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Mar 18 12:17 /usr/share/ca-certificates/minikubeCA.pem
I0318 13:39:17.516122 1154224 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0318 13:39:17.522206 1154224 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0318 13:39:17.533874 1154224 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1114136.pem && ln -fs /usr/share/ca-certificates/1114136.pem /etc/ssl/certs/1114136.pem"
I0318 13:39:17.545550 1154224 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1114136.pem
I0318 13:39:17.550986 1154224 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Mar 18 12:26 /usr/share/ca-certificates/1114136.pem
I0318 13:39:17.551044 1154224 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1114136.pem
I0318 13:39:17.557726 1154224 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1114136.pem /etc/ssl/certs/51391683.0"
I0318 13:39:17.569851 1154224 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11141362.pem && ln -fs /usr/share/ca-certificates/11141362.pem /etc/ssl/certs/11141362.pem"
I0318 13:39:17.582102 1154224 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11141362.pem
I0318 13:39:17.587695 1154224 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Mar 18 12:26 /usr/share/ca-certificates/11141362.pem
I0318 13:39:17.587763 1154224 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11141362.pem
I0318 13:39:17.594296 1154224 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/11141362.pem /etc/ssl/certs/3ec20f2e.0"
I0318 13:39:17.606307 1154224 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0318 13:39:17.611284 1154224 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0318 13:39:17.611352 1154224 kubeadm.go:391] StartCluster: {Name:old-k8s-version-909137 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17991/minikube-v1.32.1-1710520390-17991-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1710284843-18375@sha256:d67c38c9fc2ad14c48d95e17cbac49314325db5758d8f7b3de60b927e62ce94f Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-909137 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.135 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0318 13:39:17.611462 1154224 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0318 13:39:17.611512 1154224 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0318 13:39:17.658087 1154224 cri.go:89] found id: ""
I0318 13:39:17.658183 1154224 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0318 13:39:17.669818 1154224 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0318 13:39:17.680543 1154224 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0318 13:39:17.691190 1154224 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0318 13:39:17.691223 1154224 kubeadm.go:156] found existing configuration files:
I0318 13:39:17.691274 1154224 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0318 13:39:17.701080 1154224 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0318 13:39:17.701171 1154224 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0318 13:39:17.711855 1154224 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0318 13:39:17.725326 1154224 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0318 13:39:17.725408 1154224 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0318 13:39:17.738401 1154224 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0318 13:39:17.749035 1154224 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0318 13:39:17.749098 1154224 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0318 13:39:17.759659 1154224 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0318 13:39:17.770870 1154224 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0318 13:39:17.770937 1154224 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0318 13:39:17.784772 1154224 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0318 13:39:18.079193 1154224 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0318 13:41:16.446724 1154224 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0318 13:41:16.446919 1154224 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
I0318 13:41:16.451885 1154224 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0318 13:41:16.451962 1154224 kubeadm.go:309] [preflight] Running pre-flight checks
I0318 13:41:16.452074 1154224 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0318 13:41:16.452210 1154224 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0318 13:41:16.452403 1154224 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0318 13:41:16.452514 1154224 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0318 13:41:16.454397 1154224 out.go:204] - Generating certificates and keys ...
I0318 13:41:16.454498 1154224 kubeadm.go:309] [certs] Using existing ca certificate authority
I0318 13:41:16.454597 1154224 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0318 13:41:16.454711 1154224 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key
I0318 13:41:16.454806 1154224 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key
I0318 13:41:16.454894 1154224 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key
I0318 13:41:16.454969 1154224 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key
I0318 13:41:16.455063 1154224 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key
I0318 13:41:16.455246 1154224 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-909137] and IPs [192.168.72.135 127.0.0.1 ::1]
I0318 13:41:16.455343 1154224 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key
I0318 13:41:16.455486 1154224 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-909137] and IPs [192.168.72.135 127.0.0.1 ::1]
I0318 13:41:16.455567 1154224 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key
I0318 13:41:16.455651 1154224 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key
I0318 13:41:16.455714 1154224 kubeadm.go:309] [certs] Generating "sa" key and public key
I0318 13:41:16.455798 1154224 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0318 13:41:16.455880 1154224 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0318 13:41:16.455958 1154224 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0318 13:41:16.456050 1154224 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0318 13:41:16.456125 1154224 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0318 13:41:16.456272 1154224 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0318 13:41:16.456403 1154224 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0318 13:41:16.456464 1154224 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0318 13:41:16.456553 1154224 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0318 13:41:16.458285 1154224 out.go:204] - Booting up control plane ...
I0318 13:41:16.458390 1154224 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0318 13:41:16.458522 1154224 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0318 13:41:16.458627 1154224 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0318 13:41:16.458747 1154224 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0318 13:41:16.458968 1154224 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0318 13:41:16.459036 1154224 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0318 13:41:16.459135 1154224 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0318 13:41:16.459322 1154224 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0318 13:41:16.459413 1154224 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0318 13:41:16.459596 1154224 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0318 13:41:16.459685 1154224 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0318 13:41:16.459948 1154224 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0318 13:41:16.460049 1154224 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0318 13:41:16.460333 1154224 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0318 13:41:16.460433 1154224 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0318 13:41:16.460599 1154224 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0318 13:41:16.460610 1154224 kubeadm.go:309]
I0318 13:41:16.460642 1154224 kubeadm.go:309] Unfortunately, an error has occurred:
I0318 13:41:16.460680 1154224 kubeadm.go:309] timed out waiting for the condition
I0318 13:41:16.460689 1154224 kubeadm.go:309]
I0318 13:41:16.460718 1154224 kubeadm.go:309] This error is likely caused by:
I0318 13:41:16.460746 1154224 kubeadm.go:309] - The kubelet is not running
I0318 13:41:16.460831 1154224 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0318 13:41:16.460838 1154224 kubeadm.go:309]
I0318 13:41:16.460950 1154224 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0318 13:41:16.460983 1154224 kubeadm.go:309] - 'systemctl status kubelet'
I0318 13:41:16.461026 1154224 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0318 13:41:16.461034 1154224 kubeadm.go:309]
I0318 13:41:16.461177 1154224 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0318 13:41:16.461305 1154224 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0318 13:41:16.461317 1154224 kubeadm.go:309]
I0318 13:41:16.461461 1154224 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0318 13:41:16.461579 1154224 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0318 13:41:16.461705 1154224 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0318 13:41:16.461764 1154224 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0318 13:41:16.461820 1154224 kubeadm.go:309]
W0318 13:41:16.461902 1154224 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-909137] and IPs [192.168.72.135 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-909137] and IPs [192.168.72.135 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-909137] and IPs [192.168.72.135 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-909137] and IPs [192.168.72.135 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0318 13:41:16.461960 1154224 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0318 13:41:18.286233 1154224 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (1.824240904s)
I0318 13:41:18.286341 1154224 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0318 13:41:18.302141 1154224 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0318 13:41:18.313519 1154224 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0318 13:41:18.313543 1154224 kubeadm.go:156] found existing configuration files:
I0318 13:41:18.313599 1154224 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0318 13:41:18.328742 1154224 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0318 13:41:18.328818 1154224 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0318 13:41:18.340440 1154224 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0318 13:41:18.350414 1154224 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0318 13:41:18.350495 1154224 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0318 13:41:18.360532 1154224 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0318 13:41:18.370863 1154224 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0318 13:41:18.370926 1154224 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0318 13:41:18.382009 1154224 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0318 13:41:18.393030 1154224 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0318 13:41:18.393121 1154224 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0318 13:41:18.404057 1154224 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0318 13:41:18.487258 1154224 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0318 13:41:18.487426 1154224 kubeadm.go:309] [preflight] Running pre-flight checks
I0318 13:41:18.671987 1154224 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0318 13:41:18.672151 1154224 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0318 13:41:18.672337 1154224 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0318 13:41:18.881853 1154224 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0318 13:41:18.883461 1154224 out.go:204] - Generating certificates and keys ...
I0318 13:41:18.883614 1154224 kubeadm.go:309] [certs] Using existing ca certificate authority
I0318 13:41:18.883742 1154224 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0318 13:41:18.883849 1154224 kubeadm.go:309] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0318 13:41:18.883946 1154224 kubeadm.go:309] [certs] Using existing front-proxy-ca certificate authority
I0318 13:41:18.884467 1154224 kubeadm.go:309] [certs] Using existing front-proxy-client certificate and key on disk
I0318 13:41:18.884653 1154224 kubeadm.go:309] [certs] Using existing etcd/ca certificate authority
I0318 13:41:18.885306 1154224 kubeadm.go:309] [certs] Using existing etcd/server certificate and key on disk
I0318 13:41:18.885677 1154224 kubeadm.go:309] [certs] Using existing etcd/peer certificate and key on disk
I0318 13:41:18.886068 1154224 kubeadm.go:309] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0318 13:41:18.886684 1154224 kubeadm.go:309] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0318 13:41:18.886748 1154224 kubeadm.go:309] [certs] Using the existing "sa" key
I0318 13:41:18.886834 1154224 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0318 13:41:19.154585 1154224 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0318 13:41:19.239083 1154224 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0318 13:41:19.641015 1154224 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0318 13:41:20.174969 1154224 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0318 13:41:20.194281 1154224 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0318 13:41:20.195752 1154224 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0318 13:41:20.195826 1154224 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0318 13:41:20.369502 1154224 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0318 13:41:20.371112 1154224 out.go:204] - Booting up control plane ...
I0318 13:41:20.371263 1154224 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0318 13:41:20.375121 1154224 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0318 13:41:20.376773 1154224 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0318 13:41:20.377917 1154224 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0318 13:41:20.389658 1154224 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0318 13:42:00.395224 1154224 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0318 13:42:00.395624 1154224 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0318 13:42:00.395861 1154224 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0318 13:42:05.396638 1154224 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0318 13:42:05.396871 1154224 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0318 13:42:15.397584 1154224 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0318 13:42:15.397863 1154224 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0318 13:42:35.398902 1154224 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0318 13:42:35.399143 1154224 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0318 13:43:15.398457 1154224 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0318 13:43:15.398674 1154224 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0318 13:43:15.398685 1154224 kubeadm.go:309]
I0318 13:43:15.398732 1154224 kubeadm.go:309] Unfortunately, an error has occurred:
I0318 13:43:15.398785 1154224 kubeadm.go:309] timed out waiting for the condition
I0318 13:43:15.398798 1154224 kubeadm.go:309]
I0318 13:43:15.398847 1154224 kubeadm.go:309] This error is likely caused by:
I0318 13:43:15.398884 1154224 kubeadm.go:309] - The kubelet is not running
I0318 13:43:15.398972 1154224 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0318 13:43:15.398980 1154224 kubeadm.go:309]
I0318 13:43:15.399073 1154224 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0318 13:43:15.399104 1154224 kubeadm.go:309] - 'systemctl status kubelet'
I0318 13:43:15.399131 1154224 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0318 13:43:15.399135 1154224 kubeadm.go:309]
I0318 13:43:15.399229 1154224 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0318 13:43:15.399298 1154224 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0318 13:43:15.399305 1154224 kubeadm.go:309]
I0318 13:43:15.399419 1154224 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0318 13:43:15.399494 1154224 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0318 13:43:15.399656 1154224 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0318 13:43:15.399807 1154224 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0318 13:43:15.399837 1154224 kubeadm.go:309]
I0318 13:43:15.401278 1154224 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0318 13:43:15.401387 1154224 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0318 13:43:15.401490 1154224 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
I0318 13:43:15.401605 1154224 kubeadm.go:393] duration metric: took 3m57.790259721s to StartCluster
I0318 13:43:15.401663 1154224 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0318 13:43:15.401737 1154224 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0318 13:43:15.450584 1154224 cri.go:89] found id: ""
I0318 13:43:15.450620 1154224 logs.go:276] 0 containers: []
W0318 13:43:15.450631 1154224 logs.go:278] No container was found matching "kube-apiserver"
I0318 13:43:15.450640 1154224 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0318 13:43:15.450706 1154224 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0318 13:43:15.490732 1154224 cri.go:89] found id: ""
I0318 13:43:15.490763 1154224 logs.go:276] 0 containers: []
W0318 13:43:15.490772 1154224 logs.go:278] No container was found matching "etcd"
I0318 13:43:15.490780 1154224 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0318 13:43:15.490853 1154224 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0318 13:43:15.531187 1154224 cri.go:89] found id: ""
I0318 13:43:15.531211 1154224 logs.go:276] 0 containers: []
W0318 13:43:15.531220 1154224 logs.go:278] No container was found matching "coredns"
I0318 13:43:15.531227 1154224 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0318 13:43:15.531285 1154224 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0318 13:43:15.570784 1154224 cri.go:89] found id: ""
I0318 13:43:15.570823 1154224 logs.go:276] 0 containers: []
W0318 13:43:15.570833 1154224 logs.go:278] No container was found matching "kube-scheduler"
I0318 13:43:15.570840 1154224 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0318 13:43:15.570903 1154224 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0318 13:43:15.606681 1154224 cri.go:89] found id: ""
I0318 13:43:15.606710 1154224 logs.go:276] 0 containers: []
W0318 13:43:15.606721 1154224 logs.go:278] No container was found matching "kube-proxy"
I0318 13:43:15.606730 1154224 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0318 13:43:15.606792 1154224 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0318 13:43:15.649027 1154224 cri.go:89] found id: ""
I0318 13:43:15.649052 1154224 logs.go:276] 0 containers: []
W0318 13:43:15.649063 1154224 logs.go:278] No container was found matching "kube-controller-manager"
I0318 13:43:15.649072 1154224 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0318 13:43:15.649138 1154224 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0318 13:43:15.687065 1154224 cri.go:89] found id: ""
I0318 13:43:15.687101 1154224 logs.go:276] 0 containers: []
W0318 13:43:15.687114 1154224 logs.go:278] No container was found matching "kindnet"
I0318 13:43:15.687128 1154224 logs.go:123] Gathering logs for kubelet ...
I0318 13:43:15.687144 1154224 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0318 13:43:15.743684 1154224 logs.go:123] Gathering logs for dmesg ...
I0318 13:43:15.743726 1154224 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0318 13:43:15.758893 1154224 logs.go:123] Gathering logs for describe nodes ...
I0318 13:43:15.758928 1154224 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0318 13:43:15.875382 1154224 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0318 13:43:15.875411 1154224 logs.go:123] Gathering logs for CRI-O ...
I0318 13:43:15.875425 1154224 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0318 13:43:15.970033 1154224 logs.go:123] Gathering logs for container status ...
I0318 13:43:15.970073 1154224 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0318 13:43:16.014636 1154224 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0318 13:43:16.014704 1154224 out.go:239] *
*
W0318 13:43:16.014825 1154224 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0318 13:43:16.014852 1154224 out.go:239] *
*
W0318 13:43:16.015703 1154224 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0318 13:43:16.018783 1154224 out.go:177]
W0318 13:43:16.019977 1154224 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0318 13:43:16.020029 1154224 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0318 13:43:16.020049 1154224 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0318 13:43:16.021556 1154224 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-909137 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-909137 -n old-k8s-version-909137
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-909137 -n old-k8s-version-909137: exit status 6 (247.403757ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0318 13:43:16.314995 1156796 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-909137" does not appear in /home/jenkins/minikube-integration/18429-1106816/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-909137" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (272.33s)