=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-098619 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-098619 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (5m0.013800983s)
-- stdout --
* [old-k8s-version-098619] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=19452
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19452-12919/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19452-12919/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-098619" primary control-plane node in "old-k8s-version-098619" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0816 00:22:56.199213 71480 out.go:345] Setting OutFile to fd 1 ...
I0816 00:22:56.199503 71480 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0816 00:22:56.199514 71480 out.go:358] Setting ErrFile to fd 2...
I0816 00:22:56.199519 71480 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0816 00:22:56.199758 71480 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19452-12919/.minikube/bin
I0816 00:22:56.200374 71480 out.go:352] Setting JSON to false
I0816 00:22:56.201456 71480 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-13","uptime":7476,"bootTime":1723760300,"procs":306,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1066-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0816 00:22:56.201519 71480 start.go:139] virtualization: kvm guest
I0816 00:22:56.203753 71480 out.go:177] * [old-k8s-version-098619] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
I0816 00:22:56.205229 71480 out.go:177] - MINIKUBE_LOCATION=19452
I0816 00:22:56.205288 71480 notify.go:220] Checking for updates...
I0816 00:22:56.207881 71480 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0816 00:22:56.209205 71480 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19452-12919/kubeconfig
I0816 00:22:56.210440 71480 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19452-12919/.minikube
I0816 00:22:56.211702 71480 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0816 00:22:56.212966 71480 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0816 00:22:56.214689 71480 config.go:182] Loaded profile config "bridge-697641": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.0
I0816 00:22:56.214808 71480 config.go:182] Loaded profile config "enable-default-cni-697641": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.0
I0816 00:22:56.214910 71480 config.go:182] Loaded profile config "flannel-697641": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.0
I0816 00:22:56.215033 71480 driver.go:392] Setting default libvirt URI to qemu:///system
I0816 00:22:56.252808 71480 out.go:177] * Using the kvm2 driver based on user configuration
I0816 00:22:56.254022 71480 start.go:297] selected driver: kvm2
I0816 00:22:56.254042 71480 start.go:901] validating driver "kvm2" against <nil>
I0816 00:22:56.254054 71480 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0816 00:22:56.254718 71480 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0816 00:22:56.254822 71480 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19452-12919/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0816 00:22:56.271090 71480 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.1
I0816 00:22:56.271143 71480 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0816 00:22:56.271333 71480 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0816 00:22:56.271363 71480 cni.go:84] Creating CNI manager for ""
I0816 00:22:56.271371 71480 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0816 00:22:56.271378 71480 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0816 00:22:56.271422 71480 start.go:340] cluster config:
{Name:old-k8s-version-098619 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-098619 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0816 00:22:56.271523 71480 iso.go:125] acquiring lock: {Name:mk18de6493e4b29cb1a03fa462b2de44693c337e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0816 00:22:56.273240 71480 out.go:177] * Starting "old-k8s-version-098619" primary control-plane node in "old-k8s-version-098619" cluster
I0816 00:22:56.274611 71480 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0816 00:22:56.274643 71480 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19452-12919/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0816 00:22:56.274652 71480 cache.go:56] Caching tarball of preloaded images
I0816 00:22:56.274738 71480 preload.go:172] Found /home/jenkins/minikube-integration/19452-12919/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0816 00:22:56.274752 71480 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0816 00:22:56.274872 71480 profile.go:143] Saving config to /home/jenkins/minikube-integration/19452-12919/.minikube/profiles/old-k8s-version-098619/config.json ...
I0816 00:22:56.274897 71480 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19452-12919/.minikube/profiles/old-k8s-version-098619/config.json: {Name:mk15722e10aaee04cf64bdedd88f93a3f1d79b55 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0816 00:22:56.275098 71480 start.go:360] acquireMachinesLock for old-k8s-version-098619: {Name:mk2bb1901c2e94ad7d7514ec24a0540b1ab722dd Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0816 00:23:23.515403 71480 start.go:364] duration metric: took 27.24027423s to acquireMachinesLock for "old-k8s-version-098619"
I0816 00:23:23.515510 71480 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-098619 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19452/minikube-v1.33.1-1723740674-19452-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-098619 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0816 00:23:23.515626 71480 start.go:125] createHost starting for "" (driver="kvm2")
I0816 00:23:23.517222 71480 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0816 00:23:23.517393 71480 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0816 00:23:23.517441 71480 main.go:141] libmachine: Launching plugin server for driver kvm2
I0816 00:23:23.535437 71480 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36845
I0816 00:23:23.535945 71480 main.go:141] libmachine: () Calling .GetVersion
I0816 00:23:23.536539 71480 main.go:141] libmachine: Using API Version 1
I0816 00:23:23.536565 71480 main.go:141] libmachine: () Calling .SetConfigRaw
I0816 00:23:23.536948 71480 main.go:141] libmachine: () Calling .GetMachineName
I0816 00:23:23.537175 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetMachineName
I0816 00:23:23.537367 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .DriverName
I0816 00:23:23.537522 71480 start.go:159] libmachine.API.Create for "old-k8s-version-098619" (driver="kvm2")
I0816 00:23:23.537553 71480 client.go:168] LocalClient.Create starting
I0816 00:23:23.537591 71480 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19452-12919/.minikube/certs/ca.pem
I0816 00:23:23.537633 71480 main.go:141] libmachine: Decoding PEM data...
I0816 00:23:23.537655 71480 main.go:141] libmachine: Parsing certificate...
I0816 00:23:23.537736 71480 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19452-12919/.minikube/certs/cert.pem
I0816 00:23:23.537762 71480 main.go:141] libmachine: Decoding PEM data...
I0816 00:23:23.537781 71480 main.go:141] libmachine: Parsing certificate...
I0816 00:23:23.537804 71480 main.go:141] libmachine: Running pre-create checks...
I0816 00:23:23.537818 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .PreCreateCheck
I0816 00:23:23.538187 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetConfigRaw
I0816 00:23:23.538571 71480 main.go:141] libmachine: Creating machine...
I0816 00:23:23.538584 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .Create
I0816 00:23:23.538732 71480 main.go:141] libmachine: (old-k8s-version-098619) Creating KVM machine...
I0816 00:23:23.540174 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | found existing default KVM network
I0816 00:23:23.541831 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | I0816 00:23:23.541643 71796 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:d5:29:43} reservation:<nil>}
I0816 00:23:23.543063 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | I0816 00:23:23.542973 71796 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:df:56:29} reservation:<nil>}
I0816 00:23:23.544024 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | I0816 00:23:23.543889 71796 network.go:211] skipping subnet 192.168.61.0/24 that is taken: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName:virbr4 IfaceIPv4:192.168.61.1 IfaceMTU:1500 IfaceMAC:52:54:00:d9:ac:8a} reservation:<nil>}
I0816 00:23:23.545321 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | I0816 00:23:23.545211 71796 network.go:206] using free private subnet 192.168.72.0/24: &{IP:192.168.72.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.72.0/24 Gateway:192.168.72.1 ClientMin:192.168.72.2 ClientMax:192.168.72.254 Broadcast:192.168.72.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0002a5960}
I0816 00:23:23.545350 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | created network xml:
I0816 00:23:23.545370 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | <network>
I0816 00:23:23.545379 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | <name>mk-old-k8s-version-098619</name>
I0816 00:23:23.545388 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | <dns enable='no'/>
I0816 00:23:23.545394 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG |
I0816 00:23:23.545404 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | <ip address='192.168.72.1' netmask='255.255.255.0'>
I0816 00:23:23.545416 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | <dhcp>
I0816 00:23:23.545426 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | <range start='192.168.72.2' end='192.168.72.253'/>
I0816 00:23:23.545439 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | </dhcp>
I0816 00:23:23.545448 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | </ip>
I0816 00:23:23.545455 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG |
I0816 00:23:23.545464 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | </network>
I0816 00:23:23.545471 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG |
I0816 00:23:23.551310 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | trying to create private KVM network mk-old-k8s-version-098619 192.168.72.0/24...
I0816 00:23:23.636886 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | private KVM network mk-old-k8s-version-098619 192.168.72.0/24 created
I0816 00:23:23.636919 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | I0816 00:23:23.636871 71796 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19452-12919/.minikube
I0816 00:23:23.636931 71480 main.go:141] libmachine: (old-k8s-version-098619) Setting up store path in /home/jenkins/minikube-integration/19452-12919/.minikube/machines/old-k8s-version-098619 ...
I0816 00:23:23.636949 71480 main.go:141] libmachine: (old-k8s-version-098619) Building disk image from file:///home/jenkins/minikube-integration/19452-12919/.minikube/cache/iso/amd64/minikube-v1.33.1-1723740674-19452-amd64.iso
I0816 00:23:23.637015 71480 main.go:141] libmachine: (old-k8s-version-098619) Downloading /home/jenkins/minikube-integration/19452-12919/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19452-12919/.minikube/cache/iso/amd64/minikube-v1.33.1-1723740674-19452-amd64.iso...
I0816 00:23:23.918859 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | I0816 00:23:23.918722 71796 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19452-12919/.minikube/machines/old-k8s-version-098619/id_rsa...
I0816 00:23:24.041986 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | I0816 00:23:24.041837 71796 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19452-12919/.minikube/machines/old-k8s-version-098619/old-k8s-version-098619.rawdisk...
I0816 00:23:24.042024 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | Writing magic tar header
I0816 00:23:24.042045 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | Writing SSH key tar header
I0816 00:23:24.042064 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | I0816 00:23:24.042018 71796 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19452-12919/.minikube/machines/old-k8s-version-098619 ...
I0816 00:23:24.042195 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19452-12919/.minikube/machines/old-k8s-version-098619
I0816 00:23:24.042214 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19452-12919/.minikube/machines
I0816 00:23:24.042237 71480 main.go:141] libmachine: (old-k8s-version-098619) Setting executable bit set on /home/jenkins/minikube-integration/19452-12919/.minikube/machines/old-k8s-version-098619 (perms=drwx------)
I0816 00:23:24.042250 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19452-12919/.minikube
I0816 00:23:24.042288 71480 main.go:141] libmachine: (old-k8s-version-098619) Setting executable bit set on /home/jenkins/minikube-integration/19452-12919/.minikube/machines (perms=drwxr-xr-x)
I0816 00:23:24.042314 71480 main.go:141] libmachine: (old-k8s-version-098619) Setting executable bit set on /home/jenkins/minikube-integration/19452-12919/.minikube (perms=drwxr-xr-x)
I0816 00:23:24.042339 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19452-12919
I0816 00:23:24.042355 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0816 00:23:24.042367 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | Checking permissions on dir: /home/jenkins
I0816 00:23:24.042380 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | Checking permissions on dir: /home
I0816 00:23:24.042391 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | Skipping /home - not owner
I0816 00:23:24.042403 71480 main.go:141] libmachine: (old-k8s-version-098619) Setting executable bit set on /home/jenkins/minikube-integration/19452-12919 (perms=drwxrwxr-x)
I0816 00:23:24.042418 71480 main.go:141] libmachine: (old-k8s-version-098619) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0816 00:23:24.042430 71480 main.go:141] libmachine: (old-k8s-version-098619) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0816 00:23:24.042442 71480 main.go:141] libmachine: (old-k8s-version-098619) Creating domain...
I0816 00:23:24.043652 71480 main.go:141] libmachine: (old-k8s-version-098619) define libvirt domain using xml:
I0816 00:23:24.043681 71480 main.go:141] libmachine: (old-k8s-version-098619) <domain type='kvm'>
I0816 00:23:24.043692 71480 main.go:141] libmachine: (old-k8s-version-098619) <name>old-k8s-version-098619</name>
I0816 00:23:24.043701 71480 main.go:141] libmachine: (old-k8s-version-098619) <memory unit='MiB'>2200</memory>
I0816 00:23:24.043711 71480 main.go:141] libmachine: (old-k8s-version-098619) <vcpu>2</vcpu>
I0816 00:23:24.043721 71480 main.go:141] libmachine: (old-k8s-version-098619) <features>
I0816 00:23:24.043731 71480 main.go:141] libmachine: (old-k8s-version-098619) <acpi/>
I0816 00:23:24.043742 71480 main.go:141] libmachine: (old-k8s-version-098619) <apic/>
I0816 00:23:24.043751 71480 main.go:141] libmachine: (old-k8s-version-098619) <pae/>
I0816 00:23:24.043767 71480 main.go:141] libmachine: (old-k8s-version-098619)
I0816 00:23:24.043779 71480 main.go:141] libmachine: (old-k8s-version-098619) </features>
I0816 00:23:24.043788 71480 main.go:141] libmachine: (old-k8s-version-098619) <cpu mode='host-passthrough'>
I0816 00:23:24.043800 71480 main.go:141] libmachine: (old-k8s-version-098619)
I0816 00:23:24.043809 71480 main.go:141] libmachine: (old-k8s-version-098619) </cpu>
I0816 00:23:24.043821 71480 main.go:141] libmachine: (old-k8s-version-098619) <os>
I0816 00:23:24.043830 71480 main.go:141] libmachine: (old-k8s-version-098619) <type>hvm</type>
I0816 00:23:24.043843 71480 main.go:141] libmachine: (old-k8s-version-098619) <boot dev='cdrom'/>
I0816 00:23:24.043858 71480 main.go:141] libmachine: (old-k8s-version-098619) <boot dev='hd'/>
I0816 00:23:24.043869 71480 main.go:141] libmachine: (old-k8s-version-098619) <bootmenu enable='no'/>
I0816 00:23:24.043878 71480 main.go:141] libmachine: (old-k8s-version-098619) </os>
I0816 00:23:24.043887 71480 main.go:141] libmachine: (old-k8s-version-098619) <devices>
I0816 00:23:24.043898 71480 main.go:141] libmachine: (old-k8s-version-098619) <disk type='file' device='cdrom'>
I0816 00:23:24.043916 71480 main.go:141] libmachine: (old-k8s-version-098619) <source file='/home/jenkins/minikube-integration/19452-12919/.minikube/machines/old-k8s-version-098619/boot2docker.iso'/>
I0816 00:23:24.043940 71480 main.go:141] libmachine: (old-k8s-version-098619) <target dev='hdc' bus='scsi'/>
I0816 00:23:24.043949 71480 main.go:141] libmachine: (old-k8s-version-098619) <readonly/>
I0816 00:23:24.043956 71480 main.go:141] libmachine: (old-k8s-version-098619) </disk>
I0816 00:23:24.043967 71480 main.go:141] libmachine: (old-k8s-version-098619) <disk type='file' device='disk'>
I0816 00:23:24.043978 71480 main.go:141] libmachine: (old-k8s-version-098619) <driver name='qemu' type='raw' cache='default' io='threads' />
I0816 00:23:24.044000 71480 main.go:141] libmachine: (old-k8s-version-098619) <source file='/home/jenkins/minikube-integration/19452-12919/.minikube/machines/old-k8s-version-098619/old-k8s-version-098619.rawdisk'/>
I0816 00:23:24.044008 71480 main.go:141] libmachine: (old-k8s-version-098619) <target dev='hda' bus='virtio'/>
I0816 00:23:24.044017 71480 main.go:141] libmachine: (old-k8s-version-098619) </disk>
I0816 00:23:24.044029 71480 main.go:141] libmachine: (old-k8s-version-098619) <interface type='network'>
I0816 00:23:24.044040 71480 main.go:141] libmachine: (old-k8s-version-098619) <source network='mk-old-k8s-version-098619'/>
I0816 00:23:24.044048 71480 main.go:141] libmachine: (old-k8s-version-098619) <model type='virtio'/>
I0816 00:23:24.044066 71480 main.go:141] libmachine: (old-k8s-version-098619) </interface>
I0816 00:23:24.044075 71480 main.go:141] libmachine: (old-k8s-version-098619) <interface type='network'>
I0816 00:23:24.044085 71480 main.go:141] libmachine: (old-k8s-version-098619) <source network='default'/>
I0816 00:23:24.044093 71480 main.go:141] libmachine: (old-k8s-version-098619) <model type='virtio'/>
I0816 00:23:24.044101 71480 main.go:141] libmachine: (old-k8s-version-098619) </interface>
I0816 00:23:24.044112 71480 main.go:141] libmachine: (old-k8s-version-098619) <serial type='pty'>
I0816 00:23:24.044121 71480 main.go:141] libmachine: (old-k8s-version-098619) <target port='0'/>
I0816 00:23:24.044128 71480 main.go:141] libmachine: (old-k8s-version-098619) </serial>
I0816 00:23:24.044137 71480 main.go:141] libmachine: (old-k8s-version-098619) <console type='pty'>
I0816 00:23:24.044145 71480 main.go:141] libmachine: (old-k8s-version-098619) <target type='serial' port='0'/>
I0816 00:23:24.044154 71480 main.go:141] libmachine: (old-k8s-version-098619) </console>
I0816 00:23:24.044161 71480 main.go:141] libmachine: (old-k8s-version-098619) <rng model='virtio'>
I0816 00:23:24.044175 71480 main.go:141] libmachine: (old-k8s-version-098619) <backend model='random'>/dev/random</backend>
I0816 00:23:24.044187 71480 main.go:141] libmachine: (old-k8s-version-098619) </rng>
I0816 00:23:24.044197 71480 main.go:141] libmachine: (old-k8s-version-098619)
I0816 00:23:24.044203 71480 main.go:141] libmachine: (old-k8s-version-098619)
I0816 00:23:24.044211 71480 main.go:141] libmachine: (old-k8s-version-098619) </devices>
I0816 00:23:24.044219 71480 main.go:141] libmachine: (old-k8s-version-098619) </domain>
I0816 00:23:24.044230 71480 main.go:141] libmachine: (old-k8s-version-098619)
I0816 00:23:24.053017 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has defined MAC address 52:54:00:0a:38:42 in network default
I0816 00:23:24.053967 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has defined MAC address 52:54:00:22:73:72 in network mk-old-k8s-version-098619
I0816 00:23:24.053994 71480 main.go:141] libmachine: (old-k8s-version-098619) Ensuring networks are active...
I0816 00:23:24.054986 71480 main.go:141] libmachine: (old-k8s-version-098619) Ensuring network default is active
I0816 00:23:24.055429 71480 main.go:141] libmachine: (old-k8s-version-098619) Ensuring network mk-old-k8s-version-098619 is active
I0816 00:23:24.056131 71480 main.go:141] libmachine: (old-k8s-version-098619) Getting domain xml...
I0816 00:23:24.056912 71480 main.go:141] libmachine: (old-k8s-version-098619) Creating domain...
I0816 00:23:25.676600 71480 main.go:141] libmachine: (old-k8s-version-098619) Waiting to get IP...
I0816 00:23:25.677984 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has defined MAC address 52:54:00:22:73:72 in network mk-old-k8s-version-098619
I0816 00:23:25.679252 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | unable to find current IP address of domain old-k8s-version-098619 in network mk-old-k8s-version-098619
I0816 00:23:25.679306 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | I0816 00:23:25.679246 71796 retry.go:31] will retry after 296.794667ms: waiting for machine to come up
I0816 00:23:25.978091 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has defined MAC address 52:54:00:22:73:72 in network mk-old-k8s-version-098619
I0816 00:23:25.978918 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | unable to find current IP address of domain old-k8s-version-098619 in network mk-old-k8s-version-098619
I0816 00:23:25.978939 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | I0816 00:23:25.978835 71796 retry.go:31] will retry after 351.519133ms: waiting for machine to come up
I0816 00:23:26.332572 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has defined MAC address 52:54:00:22:73:72 in network mk-old-k8s-version-098619
I0816 00:23:26.333237 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | unable to find current IP address of domain old-k8s-version-098619 in network mk-old-k8s-version-098619
I0816 00:23:26.333265 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | I0816 00:23:26.333185 71796 retry.go:31] will retry after 441.815388ms: waiting for machine to come up
I0816 00:23:26.776666 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has defined MAC address 52:54:00:22:73:72 in network mk-old-k8s-version-098619
I0816 00:23:26.777292 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | unable to find current IP address of domain old-k8s-version-098619 in network mk-old-k8s-version-098619
I0816 00:23:26.777319 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | I0816 00:23:26.777269 71796 retry.go:31] will retry after 418.337983ms: waiting for machine to come up
I0816 00:23:27.197081 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has defined MAC address 52:54:00:22:73:72 in network mk-old-k8s-version-098619
I0816 00:23:27.197629 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | unable to find current IP address of domain old-k8s-version-098619 in network mk-old-k8s-version-098619
I0816 00:23:27.197658 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | I0816 00:23:27.197588 71796 retry.go:31] will retry after 656.191501ms: waiting for machine to come up
I0816 00:23:27.855235 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has defined MAC address 52:54:00:22:73:72 in network mk-old-k8s-version-098619
I0816 00:23:27.856006 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | unable to find current IP address of domain old-k8s-version-098619 in network mk-old-k8s-version-098619
I0816 00:23:27.856031 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | I0816 00:23:27.855954 71796 retry.go:31] will retry after 786.275423ms: waiting for machine to come up
I0816 00:23:28.644465 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has defined MAC address 52:54:00:22:73:72 in network mk-old-k8s-version-098619
I0816 00:23:28.644997 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | unable to find current IP address of domain old-k8s-version-098619 in network mk-old-k8s-version-098619
I0816 00:23:28.645028 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | I0816 00:23:28.644958 71796 retry.go:31] will retry after 762.849122ms: waiting for machine to come up
I0816 00:23:29.410027 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has defined MAC address 52:54:00:22:73:72 in network mk-old-k8s-version-098619
I0816 00:23:29.410451 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | unable to find current IP address of domain old-k8s-version-098619 in network mk-old-k8s-version-098619
I0816 00:23:29.410480 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | I0816 00:23:29.410441 71796 retry.go:31] will retry after 1.225682467s: waiting for machine to come up
I0816 00:23:30.637615 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has defined MAC address 52:54:00:22:73:72 in network mk-old-k8s-version-098619
I0816 00:23:30.638245 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | unable to find current IP address of domain old-k8s-version-098619 in network mk-old-k8s-version-098619
I0816 00:23:30.638273 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | I0816 00:23:30.638191 71796 retry.go:31] will retry after 1.549917623s: waiting for machine to come up
I0816 00:23:32.189669 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has defined MAC address 52:54:00:22:73:72 in network mk-old-k8s-version-098619
I0816 00:23:32.190373 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | unable to find current IP address of domain old-k8s-version-098619 in network mk-old-k8s-version-098619
I0816 00:23:32.190403 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | I0816 00:23:32.190323 71796 retry.go:31] will retry after 1.431030801s: waiting for machine to come up
I0816 00:23:33.622629 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has defined MAC address 52:54:00:22:73:72 in network mk-old-k8s-version-098619
I0816 00:23:33.623202 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | unable to find current IP address of domain old-k8s-version-098619 in network mk-old-k8s-version-098619
I0816 00:23:33.623247 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | I0816 00:23:33.623152 71796 retry.go:31] will retry after 2.805434197s: waiting for machine to come up
I0816 00:23:36.431523 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has defined MAC address 52:54:00:22:73:72 in network mk-old-k8s-version-098619
I0816 00:23:36.432093 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | unable to find current IP address of domain old-k8s-version-098619 in network mk-old-k8s-version-098619
I0816 00:23:36.432112 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | I0816 00:23:36.432045 71796 retry.go:31] will retry after 3.545659106s: waiting for machine to come up
I0816 00:23:39.979383 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has defined MAC address 52:54:00:22:73:72 in network mk-old-k8s-version-098619
I0816 00:23:39.980008 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | unable to find current IP address of domain old-k8s-version-098619 in network mk-old-k8s-version-098619
I0816 00:23:39.980036 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | I0816 00:23:39.979946 71796 retry.go:31] will retry after 3.787927209s: waiting for machine to come up
I0816 00:23:43.769441 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has defined MAC address 52:54:00:22:73:72 in network mk-old-k8s-version-098619
I0816 00:23:43.769883 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | unable to find current IP address of domain old-k8s-version-098619 in network mk-old-k8s-version-098619
I0816 00:23:43.769912 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | I0816 00:23:43.769824 71796 retry.go:31] will retry after 4.820709049s: waiting for machine to come up
I0816 00:23:48.591999 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has defined MAC address 52:54:00:22:73:72 in network mk-old-k8s-version-098619
I0816 00:23:48.592591 71480 main.go:141] libmachine: (old-k8s-version-098619) Found IP for machine: 192.168.72.137
I0816 00:23:48.592614 71480 main.go:141] libmachine: (old-k8s-version-098619) Reserving static IP address...
I0816 00:23:48.592636 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has current primary IP address 192.168.72.137 and MAC address 52:54:00:22:73:72 in network mk-old-k8s-version-098619
I0816 00:23:48.592979 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-098619", mac: "52:54:00:22:73:72", ip: "192.168.72.137"} in network mk-old-k8s-version-098619
I0816 00:23:48.677365 71480 main.go:141] libmachine: (old-k8s-version-098619) Reserved static IP address: 192.168.72.137
I0816 00:23:48.677397 71480 main.go:141] libmachine: (old-k8s-version-098619) Waiting for SSH to be available...
I0816 00:23:48.677414 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | Getting to WaitForSSH function...
I0816 00:23:48.680512 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has defined MAC address 52:54:00:22:73:72 in network mk-old-k8s-version-098619
I0816 00:23:48.680884 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:22:73:72", ip: ""} in network mk-old-k8s-version-098619: {Iface:virbr3 ExpiryTime:2024-08-16 01:23:39 +0000 UTC Type:0 Mac:52:54:00:22:73:72 Iaid: IPaddr:192.168.72.137 Prefix:24 Hostname:minikube Clientid:01:52:54:00:22:73:72}
I0816 00:23:48.680910 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has defined IP address 192.168.72.137 and MAC address 52:54:00:22:73:72 in network mk-old-k8s-version-098619
I0816 00:23:48.681100 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | Using SSH client type: external
I0816 00:23:48.681127 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | Using SSH private key: /home/jenkins/minikube-integration/19452-12919/.minikube/machines/old-k8s-version-098619/id_rsa (-rw-------)
I0816 00:23:48.681176 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.72.137 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19452-12919/.minikube/machines/old-k8s-version-098619/id_rsa -p 22] /usr/bin/ssh <nil>}
I0816 00:23:48.681188 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | About to run SSH command:
I0816 00:23:48.681228 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | exit 0
I0816 00:23:48.814310 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | SSH cmd err, output: <nil>:
I0816 00:23:48.814633 71480 main.go:141] libmachine: (old-k8s-version-098619) KVM machine creation complete!
I0816 00:23:48.814934 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetConfigRaw
I0816 00:23:48.815536 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .DriverName
I0816 00:23:48.815720 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .DriverName
I0816 00:23:48.815893 71480 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0816 00:23:48.815906 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetState
I0816 00:23:48.817653 71480 main.go:141] libmachine: Detecting operating system of created instance...
I0816 00:23:48.817667 71480 main.go:141] libmachine: Waiting for SSH to be available...
I0816 00:23:48.817676 71480 main.go:141] libmachine: Getting to WaitForSSH function...
I0816 00:23:48.817685 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetSSHHostname
I0816 00:23:48.820659 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has defined MAC address 52:54:00:22:73:72 in network mk-old-k8s-version-098619
I0816 00:23:48.821114 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:22:73:72", ip: ""} in network mk-old-k8s-version-098619: {Iface:virbr3 ExpiryTime:2024-08-16 01:23:39 +0000 UTC Type:0 Mac:52:54:00:22:73:72 Iaid: IPaddr:192.168.72.137 Prefix:24 Hostname:old-k8s-version-098619 Clientid:01:52:54:00:22:73:72}
I0816 00:23:48.821143 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has defined IP address 192.168.72.137 and MAC address 52:54:00:22:73:72 in network mk-old-k8s-version-098619
I0816 00:23:48.821328 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetSSHPort
I0816 00:23:48.821561 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetSSHKeyPath
I0816 00:23:48.821719 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetSSHKeyPath
I0816 00:23:48.821861 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetSSHUsername
I0816 00:23:48.822053 71480 main.go:141] libmachine: Using SSH client type: native
I0816 00:23:48.822245 71480 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.72.137 22 <nil> <nil>}
I0816 00:23:48.822257 71480 main.go:141] libmachine: About to run SSH command:
exit 0
I0816 00:23:48.933360 71480 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0816 00:23:48.933396 71480 main.go:141] libmachine: Detecting the provisioner...
I0816 00:23:48.933406 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetSSHHostname
I0816 00:23:48.936497 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has defined MAC address 52:54:00:22:73:72 in network mk-old-k8s-version-098619
I0816 00:23:48.936891 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:22:73:72", ip: ""} in network mk-old-k8s-version-098619: {Iface:virbr3 ExpiryTime:2024-08-16 01:23:39 +0000 UTC Type:0 Mac:52:54:00:22:73:72 Iaid: IPaddr:192.168.72.137 Prefix:24 Hostname:old-k8s-version-098619 Clientid:01:52:54:00:22:73:72}
I0816 00:23:48.936927 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has defined IP address 192.168.72.137 and MAC address 52:54:00:22:73:72 in network mk-old-k8s-version-098619
I0816 00:23:48.937110 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetSSHPort
I0816 00:23:48.937337 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetSSHKeyPath
I0816 00:23:48.937494 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetSSHKeyPath
I0816 00:23:48.937673 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetSSHUsername
I0816 00:23:48.937817 71480 main.go:141] libmachine: Using SSH client type: native
I0816 00:23:48.938015 71480 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.72.137 22 <nil> <nil>}
I0816 00:23:48.938027 71480 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0816 00:23:49.052126 71480 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0816 00:23:49.052208 71480 main.go:141] libmachine: found compatible host: buildroot
I0816 00:23:49.052218 71480 main.go:141] libmachine: Provisioning with buildroot...
I0816 00:23:49.052226 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetMachineName
I0816 00:23:49.052503 71480 buildroot.go:166] provisioning hostname "old-k8s-version-098619"
I0816 00:23:49.052522 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetMachineName
I0816 00:23:49.052725 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetSSHHostname
I0816 00:23:49.055958 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has defined MAC address 52:54:00:22:73:72 in network mk-old-k8s-version-098619
I0816 00:23:49.056403 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:22:73:72", ip: ""} in network mk-old-k8s-version-098619: {Iface:virbr3 ExpiryTime:2024-08-16 01:23:39 +0000 UTC Type:0 Mac:52:54:00:22:73:72 Iaid: IPaddr:192.168.72.137 Prefix:24 Hostname:old-k8s-version-098619 Clientid:01:52:54:00:22:73:72}
I0816 00:23:49.056426 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has defined IP address 192.168.72.137 and MAC address 52:54:00:22:73:72 in network mk-old-k8s-version-098619
I0816 00:23:49.056636 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetSSHPort
I0816 00:23:49.056792 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetSSHKeyPath
I0816 00:23:49.056922 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetSSHKeyPath
I0816 00:23:49.057023 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetSSHUsername
I0816 00:23:49.057163 71480 main.go:141] libmachine: Using SSH client type: native
I0816 00:23:49.057387 71480 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.72.137 22 <nil> <nil>}
I0816 00:23:49.057401 71480 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-098619 && echo "old-k8s-version-098619" | sudo tee /etc/hostname
I0816 00:23:49.194418 71480 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-098619
I0816 00:23:49.194453 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetSSHHostname
I0816 00:23:49.197560 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has defined MAC address 52:54:00:22:73:72 in network mk-old-k8s-version-098619
I0816 00:23:49.197992 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:22:73:72", ip: ""} in network mk-old-k8s-version-098619: {Iface:virbr3 ExpiryTime:2024-08-16 01:23:39 +0000 UTC Type:0 Mac:52:54:00:22:73:72 Iaid: IPaddr:192.168.72.137 Prefix:24 Hostname:old-k8s-version-098619 Clientid:01:52:54:00:22:73:72}
I0816 00:23:49.198024 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has defined IP address 192.168.72.137 and MAC address 52:54:00:22:73:72 in network mk-old-k8s-version-098619
I0816 00:23:49.198218 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetSSHPort
I0816 00:23:49.198421 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetSSHKeyPath
I0816 00:23:49.198603 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetSSHKeyPath
I0816 00:23:49.198753 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetSSHUsername
I0816 00:23:49.198926 71480 main.go:141] libmachine: Using SSH client type: native
I0816 00:23:49.199096 71480 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.72.137 22 <nil> <nil>}
I0816 00:23:49.199112 71480 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-098619' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-098619/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-098619' | sudo tee -a /etc/hosts;
fi
fi
I0816 00:23:49.322121 71480 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0816 00:23:49.322152 71480 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19452-12919/.minikube CaCertPath:/home/jenkins/minikube-integration/19452-12919/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19452-12919/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19452-12919/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19452-12919/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19452-12919/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19452-12919/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19452-12919/.minikube}
I0816 00:23:49.322187 71480 buildroot.go:174] setting up certificates
I0816 00:23:49.322200 71480 provision.go:84] configureAuth start
I0816 00:23:49.322212 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetMachineName
I0816 00:23:49.323431 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetIP
I0816 00:23:49.326189 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has defined MAC address 52:54:00:22:73:72 in network mk-old-k8s-version-098619
I0816 00:23:49.326603 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:22:73:72", ip: ""} in network mk-old-k8s-version-098619: {Iface:virbr3 ExpiryTime:2024-08-16 01:23:39 +0000 UTC Type:0 Mac:52:54:00:22:73:72 Iaid: IPaddr:192.168.72.137 Prefix:24 Hostname:old-k8s-version-098619 Clientid:01:52:54:00:22:73:72}
I0816 00:23:49.326636 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has defined IP address 192.168.72.137 and MAC address 52:54:00:22:73:72 in network mk-old-k8s-version-098619
I0816 00:23:49.326809 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetSSHHostname
I0816 00:23:49.329213 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has defined MAC address 52:54:00:22:73:72 in network mk-old-k8s-version-098619
I0816 00:23:49.329585 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:22:73:72", ip: ""} in network mk-old-k8s-version-098619: {Iface:virbr3 ExpiryTime:2024-08-16 01:23:39 +0000 UTC Type:0 Mac:52:54:00:22:73:72 Iaid: IPaddr:192.168.72.137 Prefix:24 Hostname:old-k8s-version-098619 Clientid:01:52:54:00:22:73:72}
I0816 00:23:49.329622 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has defined IP address 192.168.72.137 and MAC address 52:54:00:22:73:72 in network mk-old-k8s-version-098619
I0816 00:23:49.329857 71480 provision.go:143] copyHostCerts
I0816 00:23:49.329922 71480 exec_runner.go:144] found /home/jenkins/minikube-integration/19452-12919/.minikube/ca.pem, removing ...
I0816 00:23:49.329943 71480 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19452-12919/.minikube/ca.pem
I0816 00:23:49.330023 71480 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19452-12919/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19452-12919/.minikube/ca.pem (1082 bytes)
I0816 00:23:49.330128 71480 exec_runner.go:144] found /home/jenkins/minikube-integration/19452-12919/.minikube/cert.pem, removing ...
I0816 00:23:49.330138 71480 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19452-12919/.minikube/cert.pem
I0816 00:23:49.330169 71480 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19452-12919/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19452-12919/.minikube/cert.pem (1123 bytes)
I0816 00:23:49.330242 71480 exec_runner.go:144] found /home/jenkins/minikube-integration/19452-12919/.minikube/key.pem, removing ...
I0816 00:23:49.330250 71480 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19452-12919/.minikube/key.pem
I0816 00:23:49.330300 71480 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19452-12919/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19452-12919/.minikube/key.pem (1675 bytes)
I0816 00:23:49.330364 71480 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19452-12919/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19452-12919/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19452-12919/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-098619 san=[127.0.0.1 192.168.72.137 localhost minikube old-k8s-version-098619]
I0816 00:23:49.485239 71480 provision.go:177] copyRemoteCerts
I0816 00:23:49.485304 71480 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0816 00:23:49.485331 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetSSHHostname
I0816 00:23:49.488063 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has defined MAC address 52:54:00:22:73:72 in network mk-old-k8s-version-098619
I0816 00:23:49.488416 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:22:73:72", ip: ""} in network mk-old-k8s-version-098619: {Iface:virbr3 ExpiryTime:2024-08-16 01:23:39 +0000 UTC Type:0 Mac:52:54:00:22:73:72 Iaid: IPaddr:192.168.72.137 Prefix:24 Hostname:old-k8s-version-098619 Clientid:01:52:54:00:22:73:72}
I0816 00:23:49.488448 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has defined IP address 192.168.72.137 and MAC address 52:54:00:22:73:72 in network mk-old-k8s-version-098619
I0816 00:23:49.488622 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetSSHPort
I0816 00:23:49.488783 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetSSHKeyPath
I0816 00:23:49.488924 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetSSHUsername
I0816 00:23:49.489030 71480 sshutil.go:53] new ssh client: &{IP:192.168.72.137 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19452-12919/.minikube/machines/old-k8s-version-098619/id_rsa Username:docker}
I0816 00:23:49.576618 71480 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19452-12919/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0816 00:23:49.603055 71480 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19452-12919/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0816 00:23:49.629047 71480 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19452-12919/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0816 00:23:49.653432 71480 provision.go:87] duration metric: took 331.21913ms to configureAuth
I0816 00:23:49.653462 71480 buildroot.go:189] setting minikube options for container-runtime
I0816 00:23:49.653651 71480 config.go:182] Loaded profile config "old-k8s-version-098619": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0816 00:23:49.653719 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetSSHHostname
I0816 00:23:49.656178 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has defined MAC address 52:54:00:22:73:72 in network mk-old-k8s-version-098619
I0816 00:23:49.656508 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:22:73:72", ip: ""} in network mk-old-k8s-version-098619: {Iface:virbr3 ExpiryTime:2024-08-16 01:23:39 +0000 UTC Type:0 Mac:52:54:00:22:73:72 Iaid: IPaddr:192.168.72.137 Prefix:24 Hostname:old-k8s-version-098619 Clientid:01:52:54:00:22:73:72}
I0816 00:23:49.656534 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has defined IP address 192.168.72.137 and MAC address 52:54:00:22:73:72 in network mk-old-k8s-version-098619
I0816 00:23:49.656759 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetSSHPort
I0816 00:23:49.656943 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetSSHKeyPath
I0816 00:23:49.657103 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetSSHKeyPath
I0816 00:23:49.657259 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetSSHUsername
I0816 00:23:49.657442 71480 main.go:141] libmachine: Using SSH client type: native
I0816 00:23:49.657618 71480 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.72.137 22 <nil> <nil>}
I0816 00:23:49.657641 71480 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0816 00:23:49.947145 71480 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0816 00:23:49.947179 71480 main.go:141] libmachine: Checking connection to Docker...
I0816 00:23:49.947189 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetURL
I0816 00:23:49.948667 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | Using libvirt version 6000000
I0816 00:23:49.951004 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has defined MAC address 52:54:00:22:73:72 in network mk-old-k8s-version-098619
I0816 00:23:49.951372 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:22:73:72", ip: ""} in network mk-old-k8s-version-098619: {Iface:virbr3 ExpiryTime:2024-08-16 01:23:39 +0000 UTC Type:0 Mac:52:54:00:22:73:72 Iaid: IPaddr:192.168.72.137 Prefix:24 Hostname:old-k8s-version-098619 Clientid:01:52:54:00:22:73:72}
I0816 00:23:49.951399 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has defined IP address 192.168.72.137 and MAC address 52:54:00:22:73:72 in network mk-old-k8s-version-098619
I0816 00:23:49.951609 71480 main.go:141] libmachine: Docker is up and running!
I0816 00:23:49.951622 71480 main.go:141] libmachine: Reticulating splines...
I0816 00:23:49.951628 71480 client.go:171] duration metric: took 26.414068353s to LocalClient.Create
I0816 00:23:49.951648 71480 start.go:167] duration metric: took 26.414127226s to libmachine.API.Create "old-k8s-version-098619"
I0816 00:23:49.951678 71480 start.go:293] postStartSetup for "old-k8s-version-098619" (driver="kvm2")
I0816 00:23:49.951687 71480 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0816 00:23:49.951704 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .DriverName
I0816 00:23:49.951942 71480 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0816 00:23:49.951987 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetSSHHostname
I0816 00:23:49.954147 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has defined MAC address 52:54:00:22:73:72 in network mk-old-k8s-version-098619
I0816 00:23:49.954508 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:22:73:72", ip: ""} in network mk-old-k8s-version-098619: {Iface:virbr3 ExpiryTime:2024-08-16 01:23:39 +0000 UTC Type:0 Mac:52:54:00:22:73:72 Iaid: IPaddr:192.168.72.137 Prefix:24 Hostname:old-k8s-version-098619 Clientid:01:52:54:00:22:73:72}
I0816 00:23:49.954544 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has defined IP address 192.168.72.137 and MAC address 52:54:00:22:73:72 in network mk-old-k8s-version-098619
I0816 00:23:49.954660 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetSSHPort
I0816 00:23:49.954863 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetSSHKeyPath
I0816 00:23:49.955056 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetSSHUsername
I0816 00:23:49.955187 71480 sshutil.go:53] new ssh client: &{IP:192.168.72.137 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19452-12919/.minikube/machines/old-k8s-version-098619/id_rsa Username:docker}
I0816 00:23:50.045050 71480 ssh_runner.go:195] Run: cat /etc/os-release
I0816 00:23:50.049576 71480 info.go:137] Remote host: Buildroot 2023.02.9
I0816 00:23:50.049609 71480 filesync.go:126] Scanning /home/jenkins/minikube-integration/19452-12919/.minikube/addons for local assets ...
I0816 00:23:50.049675 71480 filesync.go:126] Scanning /home/jenkins/minikube-integration/19452-12919/.minikube/files for local assets ...
I0816 00:23:50.049761 71480 filesync.go:149] local asset: /home/jenkins/minikube-integration/19452-12919/.minikube/files/etc/ssl/certs/200782.pem -> 200782.pem in /etc/ssl/certs
I0816 00:23:50.049872 71480 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0816 00:23:50.060176 71480 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19452-12919/.minikube/files/etc/ssl/certs/200782.pem --> /etc/ssl/certs/200782.pem (1708 bytes)
I0816 00:23:50.086058 71480 start.go:296] duration metric: took 134.36836ms for postStartSetup
I0816 00:23:50.086120 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetConfigRaw
I0816 00:23:50.086767 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetIP
I0816 00:23:50.089448 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has defined MAC address 52:54:00:22:73:72 in network mk-old-k8s-version-098619
I0816 00:23:50.089889 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:22:73:72", ip: ""} in network mk-old-k8s-version-098619: {Iface:virbr3 ExpiryTime:2024-08-16 01:23:39 +0000 UTC Type:0 Mac:52:54:00:22:73:72 Iaid: IPaddr:192.168.72.137 Prefix:24 Hostname:old-k8s-version-098619 Clientid:01:52:54:00:22:73:72}
I0816 00:23:50.089921 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has defined IP address 192.168.72.137 and MAC address 52:54:00:22:73:72 in network mk-old-k8s-version-098619
I0816 00:23:50.090180 71480 profile.go:143] Saving config to /home/jenkins/minikube-integration/19452-12919/.minikube/profiles/old-k8s-version-098619/config.json ...
I0816 00:23:50.090432 71480 start.go:128] duration metric: took 26.574790902s to createHost
I0816 00:23:50.090466 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetSSHHostname
I0816 00:23:50.092886 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has defined MAC address 52:54:00:22:73:72 in network mk-old-k8s-version-098619
I0816 00:23:50.093221 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:22:73:72", ip: ""} in network mk-old-k8s-version-098619: {Iface:virbr3 ExpiryTime:2024-08-16 01:23:39 +0000 UTC Type:0 Mac:52:54:00:22:73:72 Iaid: IPaddr:192.168.72.137 Prefix:24 Hostname:old-k8s-version-098619 Clientid:01:52:54:00:22:73:72}
I0816 00:23:50.093242 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has defined IP address 192.168.72.137 and MAC address 52:54:00:22:73:72 in network mk-old-k8s-version-098619
I0816 00:23:50.093443 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetSSHPort
I0816 00:23:50.093657 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetSSHKeyPath
I0816 00:23:50.093835 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetSSHKeyPath
I0816 00:23:50.094019 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetSSHUsername
I0816 00:23:50.094189 71480 main.go:141] libmachine: Using SSH client type: native
I0816 00:23:50.094398 71480 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.72.137 22 <nil> <nil>}
I0816 00:23:50.094410 71480 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0816 00:23:50.207257 71480 main.go:141] libmachine: SSH cmd err, output: <nil>: 1723767830.159267902
I0816 00:23:50.207285 71480 fix.go:216] guest clock: 1723767830.159267902
I0816 00:23:50.207296 71480 fix.go:229] Guest: 2024-08-16 00:23:50.159267902 +0000 UTC Remote: 2024-08-16 00:23:50.090448873 +0000 UTC m=+53.934736366 (delta=68.819029ms)
I0816 00:23:50.207325 71480 fix.go:200] guest clock delta is within tolerance: 68.819029ms
I0816 00:23:50.207332 71480 start.go:83] releasing machines lock for "old-k8s-version-098619", held for 26.691888144s
I0816 00:23:50.207357 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .DriverName
I0816 00:23:50.207642 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetIP
I0816 00:23:50.210905 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has defined MAC address 52:54:00:22:73:72 in network mk-old-k8s-version-098619
I0816 00:23:50.211281 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:22:73:72", ip: ""} in network mk-old-k8s-version-098619: {Iface:virbr3 ExpiryTime:2024-08-16 01:23:39 +0000 UTC Type:0 Mac:52:54:00:22:73:72 Iaid: IPaddr:192.168.72.137 Prefix:24 Hostname:old-k8s-version-098619 Clientid:01:52:54:00:22:73:72}
I0816 00:23:50.211305 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has defined IP address 192.168.72.137 and MAC address 52:54:00:22:73:72 in network mk-old-k8s-version-098619
I0816 00:23:50.211499 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .DriverName
I0816 00:23:50.212094 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .DriverName
I0816 00:23:50.212280 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .DriverName
I0816 00:23:50.212429 71480 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0816 00:23:50.212483 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetSSHHostname
I0816 00:23:50.212556 71480 ssh_runner.go:195] Run: cat /version.json
I0816 00:23:50.212578 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetSSHHostname
I0816 00:23:50.215410 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has defined MAC address 52:54:00:22:73:72 in network mk-old-k8s-version-098619
I0816 00:23:50.215727 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has defined MAC address 52:54:00:22:73:72 in network mk-old-k8s-version-098619
I0816 00:23:50.215815 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:22:73:72", ip: ""} in network mk-old-k8s-version-098619: {Iface:virbr3 ExpiryTime:2024-08-16 01:23:39 +0000 UTC Type:0 Mac:52:54:00:22:73:72 Iaid: IPaddr:192.168.72.137 Prefix:24 Hostname:old-k8s-version-098619 Clientid:01:52:54:00:22:73:72}
I0816 00:23:50.215842 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has defined IP address 192.168.72.137 and MAC address 52:54:00:22:73:72 in network mk-old-k8s-version-098619
I0816 00:23:50.215980 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetSSHPort
I0816 00:23:50.216152 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetSSHKeyPath
I0816 00:23:50.216235 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:22:73:72", ip: ""} in network mk-old-k8s-version-098619: {Iface:virbr3 ExpiryTime:2024-08-16 01:23:39 +0000 UTC Type:0 Mac:52:54:00:22:73:72 Iaid: IPaddr:192.168.72.137 Prefix:24 Hostname:old-k8s-version-098619 Clientid:01:52:54:00:22:73:72}
I0816 00:23:50.216256 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has defined IP address 192.168.72.137 and MAC address 52:54:00:22:73:72 in network mk-old-k8s-version-098619
I0816 00:23:50.216288 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetSSHUsername
I0816 00:23:50.216412 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetSSHPort
I0816 00:23:50.216465 71480 sshutil.go:53] new ssh client: &{IP:192.168.72.137 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19452-12919/.minikube/machines/old-k8s-version-098619/id_rsa Username:docker}
I0816 00:23:50.216592 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetSSHKeyPath
I0816 00:23:50.216737 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetSSHUsername
I0816 00:23:50.216882 71480 sshutil.go:53] new ssh client: &{IP:192.168.72.137 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19452-12919/.minikube/machines/old-k8s-version-098619/id_rsa Username:docker}
I0816 00:23:50.322461 71480 ssh_runner.go:195] Run: systemctl --version
I0816 00:23:50.329504 71480 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0816 00:23:50.511586 71480 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0816 00:23:50.518945 71480 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0816 00:23:50.519025 71480 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0816 00:23:50.537171 71480 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0816 00:23:50.537199 71480 start.go:495] detecting cgroup driver to use...
I0816 00:23:50.537295 71480 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0816 00:23:50.556492 71480 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0816 00:23:50.572929 71480 docker.go:217] disabling cri-docker service (if available) ...
I0816 00:23:50.572988 71480 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0816 00:23:50.589965 71480 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0816 00:23:50.607107 71480 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0816 00:23:50.732247 71480 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0816 00:23:50.905725 71480 docker.go:233] disabling docker service ...
I0816 00:23:50.905808 71480 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0816 00:23:50.922184 71480 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0816 00:23:50.937109 71480 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0816 00:23:51.078931 71480 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0816 00:23:51.225117 71480 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0816 00:23:51.244023 71480 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0816 00:23:51.267168 71480 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0816 00:23:51.267238 71480 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0816 00:23:51.279241 71480 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0816 00:23:51.279315 71480 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0816 00:23:51.293683 71480 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0816 00:23:51.308347 71480 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0816 00:23:51.320422 71480 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0816 00:23:51.333589 71480 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0816 00:23:51.345349 71480 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0816 00:23:51.345411 71480 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0816 00:23:51.361313 71480 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0816 00:23:51.372684 71480 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0816 00:23:51.531753 71480 ssh_runner.go:195] Run: sudo systemctl restart crio
I0816 00:23:51.701909 71480 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0816 00:23:51.701971 71480 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0816 00:23:51.708460 71480 start.go:563] Will wait 60s for crictl version
I0816 00:23:51.708543 71480 ssh_runner.go:195] Run: which crictl
I0816 00:23:51.713592 71480 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0816 00:23:51.755798 71480 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0816 00:23:51.755888 71480 ssh_runner.go:195] Run: crio --version
I0816 00:23:51.787377 71480 ssh_runner.go:195] Run: crio --version
I0816 00:23:51.822578 71480 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0816 00:23:51.823926 71480 main.go:141] libmachine: (old-k8s-version-098619) Calling .GetIP
I0816 00:23:51.826603 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has defined MAC address 52:54:00:22:73:72 in network mk-old-k8s-version-098619
I0816 00:23:51.826947 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:22:73:72", ip: ""} in network mk-old-k8s-version-098619: {Iface:virbr3 ExpiryTime:2024-08-16 01:23:39 +0000 UTC Type:0 Mac:52:54:00:22:73:72 Iaid: IPaddr:192.168.72.137 Prefix:24 Hostname:old-k8s-version-098619 Clientid:01:52:54:00:22:73:72}
I0816 00:23:51.826976 71480 main.go:141] libmachine: (old-k8s-version-098619) DBG | domain old-k8s-version-098619 has defined IP address 192.168.72.137 and MAC address 52:54:00:22:73:72 in network mk-old-k8s-version-098619
I0816 00:23:51.827243 71480 ssh_runner.go:195] Run: grep 192.168.72.1 host.minikube.internal$ /etc/hosts
I0816 00:23:51.831958 71480 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.72.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0816 00:23:51.846779 71480 kubeadm.go:883] updating cluster {Name:old-k8s-version-098619 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19452/minikube-v1.33.1-1723740674-19452-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-098619 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.137 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] M
ountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0816 00:23:51.846931 71480 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0816 00:23:51.846988 71480 ssh_runner.go:195] Run: sudo crictl images --output json
I0816 00:23:51.886654 71480 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0816 00:23:51.886732 71480 ssh_runner.go:195] Run: which lz4
I0816 00:23:51.891884 71480 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0816 00:23:51.897398 71480 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0816 00:23:51.897433 71480 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19452-12919/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0816 00:23:53.665082 71480 crio.go:462] duration metric: took 1.773245131s to copy over tarball
I0816 00:23:53.665153 71480 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0816 00:23:56.544373 71480 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.879195194s)
I0816 00:23:56.544395 71480 crio.go:469] duration metric: took 2.879284718s to extract the tarball
I0816 00:23:56.544402 71480 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0816 00:23:56.602304 71480 ssh_runner.go:195] Run: sudo crictl images --output json
I0816 00:23:56.666424 71480 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0816 00:23:56.666457 71480 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0816 00:23:56.666531 71480 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0816 00:23:56.666543 71480 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0816 00:23:56.666548 71480 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0816 00:23:56.666593 71480 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0816 00:23:56.666603 71480 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0816 00:23:56.666608 71480 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0816 00:23:56.666764 71480 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0816 00:23:56.666574 71480 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0816 00:23:56.668944 71480 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0816 00:23:56.669266 71480 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0816 00:23:56.669275 71480 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0816 00:23:56.669281 71480 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0816 00:23:56.669384 71480 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0816 00:23:56.669459 71480 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0816 00:23:56.669391 71480 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0816 00:23:56.670683 71480 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0816 00:23:56.833560 71480 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0816 00:23:56.835053 71480 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0816 00:23:56.838977 71480 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0816 00:23:56.840273 71480 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0816 00:23:56.843050 71480 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0816 00:23:56.847426 71480 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0816 00:23:56.885497 71480 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0816 00:23:56.967695 71480 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0816 00:23:57.023682 71480 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0816 00:23:57.023741 71480 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0816 00:23:57.023790 71480 ssh_runner.go:195] Run: which crictl
I0816 00:23:57.023873 71480 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0816 00:23:57.023906 71480 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0816 00:23:57.023933 71480 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0816 00:23:57.023949 71480 ssh_runner.go:195] Run: which crictl
I0816 00:23:57.023966 71480 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0816 00:23:57.023996 71480 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0816 00:23:57.024007 71480 ssh_runner.go:195] Run: which crictl
I0816 00:23:57.024022 71480 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0816 00:23:57.024054 71480 ssh_runner.go:195] Run: which crictl
I0816 00:23:57.069580 71480 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0816 00:23:57.069621 71480 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0816 00:23:57.069629 71480 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0816 00:23:57.069652 71480 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0816 00:23:57.069682 71480 ssh_runner.go:195] Run: which crictl
I0816 00:23:57.069693 71480 ssh_runner.go:195] Run: which crictl
I0816 00:23:57.089741 71480 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0816 00:23:57.089788 71480 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0816 00:23:57.089863 71480 ssh_runner.go:195] Run: which crictl
I0816 00:23:57.201861 71480 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0816 00:23:57.201891 71480 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0816 00:23:57.201912 71480 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0816 00:23:57.201917 71480 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0816 00:23:57.201837 71480 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0816 00:23:57.201962 71480 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0816 00:23:57.201983 71480 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0816 00:23:57.397784 71480 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0816 00:23:57.397921 71480 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0816 00:23:57.397974 71480 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0816 00:23:57.397995 71480 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0816 00:23:57.398068 71480 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0816 00:23:57.398111 71480 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0816 00:23:57.398186 71480 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0816 00:23:57.530373 71480 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0816 00:23:57.566217 71480 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0816 00:23:57.566343 71480 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0816 00:23:57.566393 71480 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0816 00:23:57.566421 71480 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0816 00:23:57.566475 71480 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0816 00:23:57.566492 71480 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0816 00:23:57.653894 71480 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19452-12919/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0816 00:23:57.731772 71480 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19452-12919/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0816 00:23:57.731840 71480 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19452-12919/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0816 00:23:57.732071 71480 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19452-12919/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0816 00:23:57.740586 71480 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19452-12919/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0816 00:23:57.740650 71480 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19452-12919/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0816 00:23:57.740686 71480 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19452-12919/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0816 00:23:57.740731 71480 cache_images.go:92] duration metric: took 1.074259279s to LoadCachedImages
W0816 00:23:57.740799 71480 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19452-12919/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19452-12919/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2: no such file or directory
I0816 00:23:57.740814 71480 kubeadm.go:934] updating node { 192.168.72.137 8443 v1.20.0 crio true true} ...
I0816 00:23:57.740994 71480 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-098619 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.72.137
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-098619 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0816 00:23:57.741209 71480 ssh_runner.go:195] Run: crio config
I0816 00:23:57.813807 71480 cni.go:84] Creating CNI manager for ""
I0816 00:23:57.813830 71480 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0816 00:23:57.813862 71480 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0816 00:23:57.813887 71480 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.72.137 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-098619 NodeName:old-k8s-version-098619 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.72.137"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.72.137 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0816 00:23:57.814044 71480 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.72.137
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-098619"
kubeletExtraArgs:
node-ip: 192.168.72.137
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.72.137"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0816 00:23:57.814114 71480 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0816 00:23:57.827341 71480 binaries.go:44] Found k8s binaries, skipping transfer
I0816 00:23:57.827405 71480 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0816 00:23:57.840760 71480 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0816 00:23:57.864626 71480 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0816 00:23:57.890374 71480 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0816 00:23:57.910421 71480 ssh_runner.go:195] Run: grep 192.168.72.137 control-plane.minikube.internal$ /etc/hosts
I0816 00:23:57.914691 71480 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.72.137 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0816 00:23:57.928645 71480 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0816 00:23:58.075463 71480 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0816 00:23:58.095142 71480 certs.go:68] Setting up /home/jenkins/minikube-integration/19452-12919/.minikube/profiles/old-k8s-version-098619 for IP: 192.168.72.137
I0816 00:23:58.095165 71480 certs.go:194] generating shared ca certs ...
I0816 00:23:58.095188 71480 certs.go:226] acquiring lock for ca certs: {Name:mkc7c702c85330ff91217d90d2270778ddb79f73 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0816 00:23:58.095350 71480 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19452-12919/.minikube/ca.key
I0816 00:23:58.095416 71480 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19452-12919/.minikube/proxy-client-ca.key
I0816 00:23:58.095428 71480 certs.go:256] generating profile certs ...
I0816 00:23:58.095494 71480 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19452-12919/.minikube/profiles/old-k8s-version-098619/client.key
I0816 00:23:58.095512 71480 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19452-12919/.minikube/profiles/old-k8s-version-098619/client.crt with IP's: []
I0816 00:23:58.304674 71480 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19452-12919/.minikube/profiles/old-k8s-version-098619/client.crt ...
I0816 00:23:58.304703 71480 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19452-12919/.minikube/profiles/old-k8s-version-098619/client.crt: {Name:mke7fc0eca18c780fc6ab06471f19438d004102d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0816 00:23:58.304892 71480 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19452-12919/.minikube/profiles/old-k8s-version-098619/client.key ...
I0816 00:23:58.304939 71480 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19452-12919/.minikube/profiles/old-k8s-version-098619/client.key: {Name:mk8cdfa3a05543970a9cc87426dce9e2654be571 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0816 00:23:58.305060 71480 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19452-12919/.minikube/profiles/old-k8s-version-098619/apiserver.key.97f18ce4
I0816 00:23:58.305078 71480 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19452-12919/.minikube/profiles/old-k8s-version-098619/apiserver.crt.97f18ce4 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.72.137]
I0816 00:23:58.828487 71480 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19452-12919/.minikube/profiles/old-k8s-version-098619/apiserver.crt.97f18ce4 ...
I0816 00:23:58.828517 71480 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19452-12919/.minikube/profiles/old-k8s-version-098619/apiserver.crt.97f18ce4: {Name:mk139e8bdb440a4dddcba84b4db4fccc827277ce Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0816 00:23:58.828673 71480 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19452-12919/.minikube/profiles/old-k8s-version-098619/apiserver.key.97f18ce4 ...
I0816 00:23:58.828689 71480 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19452-12919/.minikube/profiles/old-k8s-version-098619/apiserver.key.97f18ce4: {Name:mkb48a9eda56a1843e084dacb0b0ee7f1836ade4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0816 00:23:58.828783 71480 certs.go:381] copying /home/jenkins/minikube-integration/19452-12919/.minikube/profiles/old-k8s-version-098619/apiserver.crt.97f18ce4 -> /home/jenkins/minikube-integration/19452-12919/.minikube/profiles/old-k8s-version-098619/apiserver.crt
I0816 00:23:58.828869 71480 certs.go:385] copying /home/jenkins/minikube-integration/19452-12919/.minikube/profiles/old-k8s-version-098619/apiserver.key.97f18ce4 -> /home/jenkins/minikube-integration/19452-12919/.minikube/profiles/old-k8s-version-098619/apiserver.key
I0816 00:23:58.828951 71480 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19452-12919/.minikube/profiles/old-k8s-version-098619/proxy-client.key
I0816 00:23:58.828968 71480 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19452-12919/.minikube/profiles/old-k8s-version-098619/proxy-client.crt with IP's: []
I0816 00:23:58.902191 71480 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19452-12919/.minikube/profiles/old-k8s-version-098619/proxy-client.crt ...
I0816 00:23:58.902229 71480 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19452-12919/.minikube/profiles/old-k8s-version-098619/proxy-client.crt: {Name:mkb8e4c92209756e79f53bffdd8a3937df3ac6b4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0816 00:23:58.902436 71480 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19452-12919/.minikube/profiles/old-k8s-version-098619/proxy-client.key ...
I0816 00:23:58.902452 71480 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19452-12919/.minikube/profiles/old-k8s-version-098619/proxy-client.key: {Name:mke65d7e7f8c15c4e8193dbcfd0d4e0912925d40 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0816 00:23:58.902673 71480 certs.go:484] found cert: /home/jenkins/minikube-integration/19452-12919/.minikube/certs/20078.pem (1338 bytes)
W0816 00:23:58.902720 71480 certs.go:480] ignoring /home/jenkins/minikube-integration/19452-12919/.minikube/certs/20078_empty.pem, impossibly tiny 0 bytes
I0816 00:23:58.902734 71480 certs.go:484] found cert: /home/jenkins/minikube-integration/19452-12919/.minikube/certs/ca-key.pem (1675 bytes)
I0816 00:23:58.902767 71480 certs.go:484] found cert: /home/jenkins/minikube-integration/19452-12919/.minikube/certs/ca.pem (1082 bytes)
I0816 00:23:58.902798 71480 certs.go:484] found cert: /home/jenkins/minikube-integration/19452-12919/.minikube/certs/cert.pem (1123 bytes)
I0816 00:23:58.902832 71480 certs.go:484] found cert: /home/jenkins/minikube-integration/19452-12919/.minikube/certs/key.pem (1675 bytes)
I0816 00:23:58.902883 71480 certs.go:484] found cert: /home/jenkins/minikube-integration/19452-12919/.minikube/files/etc/ssl/certs/200782.pem (1708 bytes)
I0816 00:23:58.903517 71480 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19452-12919/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0816 00:23:58.930564 71480 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19452-12919/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0816 00:23:58.960364 71480 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19452-12919/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0816 00:23:58.988646 71480 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19452-12919/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0816 00:23:59.023103 71480 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19452-12919/.minikube/profiles/old-k8s-version-098619/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0816 00:23:59.055680 71480 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19452-12919/.minikube/profiles/old-k8s-version-098619/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0816 00:23:59.101872 71480 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19452-12919/.minikube/profiles/old-k8s-version-098619/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0816 00:23:59.136360 71480 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19452-12919/.minikube/profiles/old-k8s-version-098619/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0816 00:23:59.161547 71480 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19452-12919/.minikube/files/etc/ssl/certs/200782.pem --> /usr/share/ca-certificates/200782.pem (1708 bytes)
I0816 00:23:59.188440 71480 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19452-12919/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0816 00:23:59.217549 71480 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19452-12919/.minikube/certs/20078.pem --> /usr/share/ca-certificates/20078.pem (1338 bytes)
I0816 00:23:59.250604 71480 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0816 00:23:59.269267 71480 ssh_runner.go:195] Run: openssl version
I0816 00:23:59.275614 71480 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/200782.pem && ln -fs /usr/share/ca-certificates/200782.pem /etc/ssl/certs/200782.pem"
I0816 00:23:59.289188 71480 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/200782.pem
I0816 00:23:59.293889 71480 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug 15 23:16 /usr/share/ca-certificates/200782.pem
I0816 00:23:59.293966 71480 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/200782.pem
I0816 00:23:59.301078 71480 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/200782.pem /etc/ssl/certs/3ec20f2e.0"
I0816 00:23:59.315841 71480 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0816 00:23:59.328973 71480 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0816 00:23:59.333675 71480 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug 15 23:06 /usr/share/ca-certificates/minikubeCA.pem
I0816 00:23:59.333726 71480 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0816 00:23:59.339737 71480 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0816 00:23:59.352945 71480 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/20078.pem && ln -fs /usr/share/ca-certificates/20078.pem /etc/ssl/certs/20078.pem"
I0816 00:23:59.365693 71480 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/20078.pem
I0816 00:23:59.370716 71480 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug 15 23:16 /usr/share/ca-certificates/20078.pem
I0816 00:23:59.370766 71480 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/20078.pem
I0816 00:23:59.376935 71480 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/20078.pem /etc/ssl/certs/51391683.0"
I0816 00:23:59.390055 71480 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0816 00:23:59.394344 71480 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0816 00:23:59.394407 71480 kubeadm.go:392] StartCluster: {Name:old-k8s-version-098619 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19452/minikube-v1.33.1-1723740674-19452-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-098619 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.137 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0816 00:23:59.394498 71480 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0816 00:23:59.394577 71480 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0816 00:23:59.447937 71480 cri.go:89] found id: ""
I0816 00:23:59.448015 71480 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0816 00:23:59.459318 71480 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0816 00:23:59.471868 71480 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0816 00:23:59.484358 71480 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0816 00:23:59.484378 71480 kubeadm.go:157] found existing configuration files:
I0816 00:23:59.484427 71480 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0816 00:23:59.497111 71480 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0816 00:23:59.497182 71480 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0816 00:23:59.508856 71480 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0816 00:23:59.520445 71480 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0816 00:23:59.520516 71480 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0816 00:23:59.532177 71480 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0816 00:23:59.554162 71480 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0816 00:23:59.554222 71480 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0816 00:23:59.567270 71480 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0816 00:23:59.585509 71480 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0816 00:23:59.585556 71480 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0816 00:23:59.600379 71480 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0816 00:23:59.956069 71480 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0816 00:25:57.721070 71480 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0816 00:25:57.721151 71480 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0816 00:25:57.722862 71480 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0816 00:25:57.722932 71480 kubeadm.go:310] [preflight] Running pre-flight checks
I0816 00:25:57.723032 71480 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0816 00:25:57.723118 71480 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0816 00:25:57.723211 71480 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0816 00:25:57.723272 71480 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0816 00:25:57.724890 71480 out.go:235] - Generating certificates and keys ...
I0816 00:25:57.724986 71480 kubeadm.go:310] [certs] Using existing ca certificate authority
I0816 00:25:57.725063 71480 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0816 00:25:57.725165 71480 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0816 00:25:57.725238 71480 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0816 00:25:57.725307 71480 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0816 00:25:57.725363 71480 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0816 00:25:57.725430 71480 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0816 00:25:57.725619 71480 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-098619] and IPs [192.168.72.137 127.0.0.1 ::1]
I0816 00:25:57.725718 71480 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0816 00:25:57.725894 71480 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-098619] and IPs [192.168.72.137 127.0.0.1 ::1]
I0816 00:25:57.725965 71480 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0816 00:25:57.726035 71480 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0816 00:25:57.726207 71480 kubeadm.go:310] [certs] Generating "sa" key and public key
I0816 00:25:57.726302 71480 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0816 00:25:57.726393 71480 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0816 00:25:57.726472 71480 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0816 00:25:57.726589 71480 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0816 00:25:57.726661 71480 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0816 00:25:57.726747 71480 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0816 00:25:57.726823 71480 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0816 00:25:57.726857 71480 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0816 00:25:57.726922 71480 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0816 00:25:57.728291 71480 out.go:235] - Booting up control plane ...
I0816 00:25:57.728367 71480 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0816 00:25:57.728440 71480 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0816 00:25:57.728527 71480 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0816 00:25:57.728633 71480 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0816 00:25:57.728849 71480 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0816 00:25:57.728923 71480 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0816 00:25:57.729019 71480 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0816 00:25:57.729235 71480 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0816 00:25:57.729329 71480 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0816 00:25:57.729586 71480 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0816 00:25:57.729685 71480 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0816 00:25:57.729893 71480 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0816 00:25:57.729974 71480 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0816 00:25:57.730177 71480 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0816 00:25:57.730256 71480 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0816 00:25:57.730472 71480 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0816 00:25:57.730483 71480 kubeadm.go:310]
I0816 00:25:57.730517 71480 kubeadm.go:310] Unfortunately, an error has occurred:
I0816 00:25:57.730554 71480 kubeadm.go:310] timed out waiting for the condition
I0816 00:25:57.730561 71480 kubeadm.go:310]
I0816 00:25:57.730590 71480 kubeadm.go:310] This error is likely caused by:
I0816 00:25:57.730622 71480 kubeadm.go:310] - The kubelet is not running
I0816 00:25:57.730712 71480 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0816 00:25:57.730720 71480 kubeadm.go:310]
I0816 00:25:57.730813 71480 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0816 00:25:57.730842 71480 kubeadm.go:310] - 'systemctl status kubelet'
I0816 00:25:57.730955 71480 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0816 00:25:57.730972 71480 kubeadm.go:310]
I0816 00:25:57.731121 71480 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0816 00:25:57.731240 71480 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0816 00:25:57.731250 71480 kubeadm.go:310]
I0816 00:25:57.731388 71480 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0816 00:25:57.731518 71480 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0816 00:25:57.731608 71480 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0816 00:25:57.731683 71480 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0816 00:25:57.731713 71480 kubeadm.go:310]
W0816 00:25:57.731819 71480 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-098619] and IPs [192.168.72.137 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-098619] and IPs [192.168.72.137 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-098619] and IPs [192.168.72.137 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-098619] and IPs [192.168.72.137 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0816 00:25:57.731855 71480 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0816 00:25:59.061148 71480 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (1.329263599s)
I0816 00:25:59.061244 71480 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0816 00:25:59.076053 71480 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0816 00:25:59.086099 71480 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0816 00:25:59.086119 71480 kubeadm.go:157] found existing configuration files:
I0816 00:25:59.086170 71480 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0816 00:25:59.098650 71480 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0816 00:25:59.098719 71480 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0816 00:25:59.110255 71480 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0816 00:25:59.121289 71480 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0816 00:25:59.121355 71480 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0816 00:25:59.132527 71480 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0816 00:25:59.143859 71480 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0816 00:25:59.143935 71480 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0816 00:25:59.154586 71480 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0816 00:25:59.164414 71480 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0816 00:25:59.164472 71480 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0816 00:25:59.174224 71480 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0816 00:25:59.400193 71480 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0816 00:27:55.515429 71480 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0816 00:27:55.515509 71480 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0816 00:27:55.516956 71480 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0816 00:27:55.517041 71480 kubeadm.go:310] [preflight] Running pre-flight checks
I0816 00:27:55.517134 71480 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0816 00:27:55.517249 71480 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0816 00:27:55.517361 71480 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0816 00:27:55.517418 71480 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0816 00:27:55.519039 71480 out.go:235] - Generating certificates and keys ...
I0816 00:27:55.519108 71480 kubeadm.go:310] [certs] Using existing ca certificate authority
I0816 00:27:55.519160 71480 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0816 00:27:55.519258 71480 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0816 00:27:55.519351 71480 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0816 00:27:55.519450 71480 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0816 00:27:55.519525 71480 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0816 00:27:55.519618 71480 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0816 00:27:55.519676 71480 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0816 00:27:55.519757 71480 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0816 00:27:55.519833 71480 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0816 00:27:55.519871 71480 kubeadm.go:310] [certs] Using the existing "sa" key
I0816 00:27:55.519920 71480 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0816 00:27:55.519965 71480 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0816 00:27:55.520011 71480 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0816 00:27:55.520069 71480 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0816 00:27:55.520116 71480 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0816 00:27:55.520223 71480 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0816 00:27:55.520342 71480 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0816 00:27:55.520405 71480 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0816 00:27:55.520496 71480 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0816 00:27:55.522140 71480 out.go:235] - Booting up control plane ...
I0816 00:27:55.522235 71480 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0816 00:27:55.522314 71480 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0816 00:27:55.522374 71480 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0816 00:27:55.522456 71480 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0816 00:27:55.522607 71480 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0816 00:27:55.522651 71480 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0816 00:27:55.522718 71480 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0816 00:27:55.522868 71480 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0816 00:27:55.522931 71480 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0816 00:27:55.523097 71480 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0816 00:27:55.523168 71480 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0816 00:27:55.523350 71480 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0816 00:27:55.523422 71480 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0816 00:27:55.523577 71480 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0816 00:27:55.523637 71480 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0816 00:27:55.523796 71480 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0816 00:27:55.523805 71480 kubeadm.go:310]
I0816 00:27:55.523838 71480 kubeadm.go:310] Unfortunately, an error has occurred:
I0816 00:27:55.523876 71480 kubeadm.go:310] timed out waiting for the condition
I0816 00:27:55.523882 71480 kubeadm.go:310]
I0816 00:27:55.523934 71480 kubeadm.go:310] This error is likely caused by:
I0816 00:27:55.523964 71480 kubeadm.go:310] - The kubelet is not running
I0816 00:27:55.524054 71480 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0816 00:27:55.524063 71480 kubeadm.go:310]
I0816 00:27:55.524151 71480 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0816 00:27:55.524194 71480 kubeadm.go:310] - 'systemctl status kubelet'
I0816 00:27:55.524239 71480 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0816 00:27:55.524253 71480 kubeadm.go:310]
I0816 00:27:55.524352 71480 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0816 00:27:55.524428 71480 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0816 00:27:55.524434 71480 kubeadm.go:310]
I0816 00:27:55.524529 71480 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0816 00:27:55.524608 71480 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0816 00:27:55.524676 71480 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0816 00:27:55.524741 71480 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0816 00:27:55.524761 71480 kubeadm.go:310]
I0816 00:27:55.524792 71480 kubeadm.go:394] duration metric: took 3m56.130389863s to StartCluster
I0816 00:27:55.524832 71480 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0816 00:27:55.524887 71480 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0816 00:27:55.567584 71480 cri.go:89] found id: ""
I0816 00:27:55.567633 71480 logs.go:276] 0 containers: []
W0816 00:27:55.567646 71480 logs.go:278] No container was found matching "kube-apiserver"
I0816 00:27:55.567660 71480 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0816 00:27:55.567723 71480 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0816 00:27:55.603407 71480 cri.go:89] found id: ""
I0816 00:27:55.603434 71480 logs.go:276] 0 containers: []
W0816 00:27:55.603445 71480 logs.go:278] No container was found matching "etcd"
I0816 00:27:55.603452 71480 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0816 00:27:55.603512 71480 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0816 00:27:55.638774 71480 cri.go:89] found id: ""
I0816 00:27:55.638800 71480 logs.go:276] 0 containers: []
W0816 00:27:55.638809 71480 logs.go:278] No container was found matching "coredns"
I0816 00:27:55.638814 71480 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0816 00:27:55.638876 71480 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0816 00:27:55.673827 71480 cri.go:89] found id: ""
I0816 00:27:55.673859 71480 logs.go:276] 0 containers: []
W0816 00:27:55.673867 71480 logs.go:278] No container was found matching "kube-scheduler"
I0816 00:27:55.673873 71480 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0816 00:27:55.673927 71480 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0816 00:27:55.711414 71480 cri.go:89] found id: ""
I0816 00:27:55.711436 71480 logs.go:276] 0 containers: []
W0816 00:27:55.711443 71480 logs.go:278] No container was found matching "kube-proxy"
I0816 00:27:55.711449 71480 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0816 00:27:55.711499 71480 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0816 00:27:55.747525 71480 cri.go:89] found id: ""
I0816 00:27:55.747546 71480 logs.go:276] 0 containers: []
W0816 00:27:55.747554 71480 logs.go:278] No container was found matching "kube-controller-manager"
I0816 00:27:55.747560 71480 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0816 00:27:55.747612 71480 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0816 00:27:55.781629 71480 cri.go:89] found id: ""
I0816 00:27:55.781659 71480 logs.go:276] 0 containers: []
W0816 00:27:55.781670 71480 logs.go:278] No container was found matching "kindnet"
I0816 00:27:55.781681 71480 logs.go:123] Gathering logs for kubelet ...
I0816 00:27:55.781697 71480 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0816 00:27:55.832807 71480 logs.go:123] Gathering logs for dmesg ...
I0816 00:27:55.832839 71480 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0816 00:27:55.847159 71480 logs.go:123] Gathering logs for describe nodes ...
I0816 00:27:55.847184 71480 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0816 00:27:56.003956 71480 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0816 00:27:56.003985 71480 logs.go:123] Gathering logs for CRI-O ...
I0816 00:27:56.004000 71480 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0816 00:27:56.115481 71480 logs.go:123] Gathering logs for container status ...
I0816 00:27:56.115516 71480 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0816 00:27:56.153683 71480 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0816 00:27:56.153739 71480 out.go:270] *
*
W0816 00:27:56.153798 71480 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0816 00:27:56.153817 71480 out.go:270] *
*
W0816 00:27:56.154834 71480 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0816 00:27:56.158632 71480 out.go:201]
W0816 00:27:56.159911 71480 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0816 00:27:56.159953 71480 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0816 00:27:56.159971 71480 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0816 00:27:56.161372 71480 out.go:201]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-098619 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-098619 -n old-k8s-version-098619
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-098619 -n old-k8s-version-098619: exit status 6 (219.956532ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0816 00:27:56.429542 78090 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-098619" does not appear in /home/jenkins/minikube-integration/19452-12919/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-098619" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (300.29s)