=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-862528 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-862528 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m31.00069561s)
-- stdout --
* [old-k8s-version-862528] minikube v1.33.0-beta.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=18610
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/18610-5679/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/18610-5679/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-862528" primary control-plane node in "old-k8s-version-862528" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0410 22:37:55.119212 54076 out.go:291] Setting OutFile to fd 1 ...
I0410 22:37:55.119636 54076 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0410 22:37:55.119650 54076 out.go:304] Setting ErrFile to fd 2...
I0410 22:37:55.119658 54076 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0410 22:37:55.120085 54076 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18610-5679/.minikube/bin
I0410 22:37:55.121392 54076 out.go:298] Setting JSON to false
I0410 22:37:55.122856 54076 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":4817,"bootTime":1712783858,"procs":220,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1055-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0410 22:37:55.122943 54076 start.go:139] virtualization: kvm guest
I0410 22:37:55.125271 54076 out.go:177] * [old-k8s-version-862528] minikube v1.33.0-beta.0 on Ubuntu 20.04 (kvm/amd64)
I0410 22:37:55.126635 54076 out.go:177] - MINIKUBE_LOCATION=18610
I0410 22:37:55.126634 54076 notify.go:220] Checking for updates...
I0410 22:37:55.127984 54076 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0410 22:37:55.129481 54076 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18610-5679/kubeconfig
I0410 22:37:55.131025 54076 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18610-5679/.minikube
I0410 22:37:55.132865 54076 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0410 22:37:55.134431 54076 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0410 22:37:55.136384 54076 config.go:182] Loaded profile config "cert-expiration-464519": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.29.3
I0410 22:37:55.136549 54076 config.go:182] Loaded profile config "cert-options-849843": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.29.3
I0410 22:37:55.136651 54076 config.go:182] Loaded profile config "kubernetes-upgrade-407031": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0410 22:37:55.136779 54076 driver.go:392] Setting default libvirt URI to qemu:///system
I0410 22:37:55.174500 54076 out.go:177] * Using the kvm2 driver based on user configuration
I0410 22:37:55.175929 54076 start.go:297] selected driver: kvm2
I0410 22:37:55.175946 54076 start.go:901] validating driver "kvm2" against <nil>
I0410 22:37:55.175962 54076 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0410 22:37:55.177013 54076 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0410 22:37:55.177116 54076 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/18610-5679/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0410 22:37:55.193440 54076 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.0-beta.0
I0410 22:37:55.193495 54076 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0410 22:37:55.193688 54076 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0410 22:37:55.193755 54076 cni.go:84] Creating CNI manager for ""
I0410 22:37:55.193767 54076 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0410 22:37:55.193773 54076 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0410 22:37:55.193818 54076 start.go:340] cluster config:
{Name:old-k8s-version-862528 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1712743643-18610@sha256:57f6b6f207b748ce717275fbcd6ae3dba156d24f7d9b85b4b7e51b63bacaf9dc Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-862528 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0410 22:37:55.193912 54076 iso.go:125] acquiring lock: {Name:mk5a268a8a4dbf02629446a098c1de60574dce10 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0410 22:37:55.195762 54076 out.go:177] * Starting "old-k8s-version-862528" primary control-plane node in "old-k8s-version-862528" cluster
I0410 22:37:55.196781 54076 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0410 22:37:55.196820 54076 preload.go:147] Found local preload: /home/jenkins/minikube-integration/18610-5679/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0410 22:37:55.196833 54076 cache.go:56] Caching tarball of preloaded images
I0410 22:37:55.196927 54076 preload.go:173] Found /home/jenkins/minikube-integration/18610-5679/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0410 22:37:55.196949 54076 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0410 22:37:55.197054 54076 profile.go:143] Saving config to /home/jenkins/minikube-integration/18610-5679/.minikube/profiles/old-k8s-version-862528/config.json ...
I0410 22:37:55.197081 54076 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18610-5679/.minikube/profiles/old-k8s-version-862528/config.json: {Name:mk2b0c2999fe7f286b4293fdc459d3d508eef116 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0410 22:37:55.197234 54076 start.go:360] acquireMachinesLock for old-k8s-version-862528: {Name:mkcfcfa8b01b63726303cd37d33f01d452118635 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0410 22:37:55.197296 54076 start.go:364] duration metric: took 42.873µs to acquireMachinesLock for "old-k8s-version-862528"
I0410 22:37:55.197332 54076 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-862528 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18610/minikube-v1.33.0-1712743565-18610-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1712743643-18610@sha256:57f6b6f207b748ce717275fbcd6ae3dba156d24f7d9b85b4b7e51b63bacaf9dc Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-862528 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0410 22:37:55.197425 54076 start.go:125] createHost starting for "" (driver="kvm2")
I0410 22:37:55.198904 54076 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0410 22:37:55.199044 54076 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0410 22:37:55.199086 54076 main.go:141] libmachine: Launching plugin server for driver kvm2
I0410 22:37:55.213487 54076 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44971
I0410 22:37:55.213966 54076 main.go:141] libmachine: () Calling .GetVersion
I0410 22:37:55.214502 54076 main.go:141] libmachine: Using API Version 1
I0410 22:37:55.214523 54076 main.go:141] libmachine: () Calling .SetConfigRaw
I0410 22:37:55.214876 54076 main.go:141] libmachine: () Calling .GetMachineName
I0410 22:37:55.215125 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetMachineName
I0410 22:37:55.215312 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .DriverName
I0410 22:37:55.215478 54076 start.go:159] libmachine.API.Create for "old-k8s-version-862528" (driver="kvm2")
I0410 22:37:55.215512 54076 client.go:168] LocalClient.Create starting
I0410 22:37:55.215546 54076 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18610-5679/.minikube/certs/ca.pem
I0410 22:37:55.215593 54076 main.go:141] libmachine: Decoding PEM data...
I0410 22:37:55.215616 54076 main.go:141] libmachine: Parsing certificate...
I0410 22:37:55.215678 54076 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18610-5679/.minikube/certs/cert.pem
I0410 22:37:55.215697 54076 main.go:141] libmachine: Decoding PEM data...
I0410 22:37:55.215711 54076 main.go:141] libmachine: Parsing certificate...
I0410 22:37:55.215727 54076 main.go:141] libmachine: Running pre-create checks...
I0410 22:37:55.215742 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .PreCreateCheck
I0410 22:37:55.216067 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetConfigRaw
I0410 22:37:55.216532 54076 main.go:141] libmachine: Creating machine...
I0410 22:37:55.216548 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .Create
I0410 22:37:55.216708 54076 main.go:141] libmachine: (old-k8s-version-862528) Creating KVM machine...
I0410 22:37:55.218052 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | found existing default KVM network
I0410 22:37:55.219655 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | I0410 22:37:55.219476 54099 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr3 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:95:74:01} reservation:<nil>}
I0410 22:37:55.220637 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | I0410 22:37:55.220555 54099 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:29:e4:b6} reservation:<nil>}
I0410 22:37:55.221709 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | I0410 22:37:55.221601 54099 network.go:206] using free private subnet 192.168.61.0/24: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000289340}
I0410 22:37:55.221735 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | created network xml:
I0410 22:37:55.221749 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | <network>
I0410 22:37:55.221772 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | <name>mk-old-k8s-version-862528</name>
I0410 22:37:55.221788 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | <dns enable='no'/>
I0410 22:37:55.221794 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG |
I0410 22:37:55.221807 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | <ip address='192.168.61.1' netmask='255.255.255.0'>
I0410 22:37:55.221817 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | <dhcp>
I0410 22:37:55.221831 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | <range start='192.168.61.2' end='192.168.61.253'/>
I0410 22:37:55.221844 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | </dhcp>
I0410 22:37:55.221857 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | </ip>
I0410 22:37:55.221864 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG |
I0410 22:37:55.221876 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | </network>
I0410 22:37:55.221883 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG |
I0410 22:37:55.226932 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | trying to create private KVM network mk-old-k8s-version-862528 192.168.61.0/24...
I0410 22:37:55.304525 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | private KVM network mk-old-k8s-version-862528 192.168.61.0/24 created
I0410 22:37:55.304562 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | I0410 22:37:55.304447 54099 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/18610-5679/.minikube
I0410 22:37:55.304575 54076 main.go:141] libmachine: (old-k8s-version-862528) Setting up store path in /home/jenkins/minikube-integration/18610-5679/.minikube/machines/old-k8s-version-862528 ...
I0410 22:37:55.304595 54076 main.go:141] libmachine: (old-k8s-version-862528) Building disk image from file:///home/jenkins/minikube-integration/18610-5679/.minikube/cache/iso/amd64/minikube-v1.33.0-1712743565-18610-amd64.iso
I0410 22:37:55.304608 54076 main.go:141] libmachine: (old-k8s-version-862528) Downloading /home/jenkins/minikube-integration/18610-5679/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/18610-5679/.minikube/cache/iso/amd64/minikube-v1.33.0-1712743565-18610-amd64.iso...
I0410 22:37:55.546152 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | I0410 22:37:55.546051 54099 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/18610-5679/.minikube/machines/old-k8s-version-862528/id_rsa...
I0410 22:37:55.846477 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | I0410 22:37:55.846332 54099 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/18610-5679/.minikube/machines/old-k8s-version-862528/old-k8s-version-862528.rawdisk...
I0410 22:37:55.846511 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | Writing magic tar header
I0410 22:37:55.846530 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | Writing SSH key tar header
I0410 22:37:55.846542 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | I0410 22:37:55.846512 54099 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/18610-5679/.minikube/machines/old-k8s-version-862528 ...
I0410 22:37:55.846649 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18610-5679/.minikube/machines/old-k8s-version-862528
I0410 22:37:55.846683 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18610-5679/.minikube/machines
I0410 22:37:55.846721 54076 main.go:141] libmachine: (old-k8s-version-862528) Setting executable bit set on /home/jenkins/minikube-integration/18610-5679/.minikube/machines/old-k8s-version-862528 (perms=drwx------)
I0410 22:37:55.846736 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18610-5679/.minikube
I0410 22:37:55.846755 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18610-5679
I0410 22:37:55.846770 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0410 22:37:55.846785 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | Checking permissions on dir: /home/jenkins
I0410 22:37:55.846803 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | Checking permissions on dir: /home
I0410 22:37:55.846814 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | Skipping /home - not owner
I0410 22:37:55.846829 54076 main.go:141] libmachine: (old-k8s-version-862528) Setting executable bit set on /home/jenkins/minikube-integration/18610-5679/.minikube/machines (perms=drwxr-xr-x)
I0410 22:37:55.846844 54076 main.go:141] libmachine: (old-k8s-version-862528) Setting executable bit set on /home/jenkins/minikube-integration/18610-5679/.minikube (perms=drwxr-xr-x)
I0410 22:37:55.846861 54076 main.go:141] libmachine: (old-k8s-version-862528) Setting executable bit set on /home/jenkins/minikube-integration/18610-5679 (perms=drwxrwxr-x)
I0410 22:37:55.846872 54076 main.go:141] libmachine: (old-k8s-version-862528) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0410 22:37:55.846892 54076 main.go:141] libmachine: (old-k8s-version-862528) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0410 22:37:55.846923 54076 main.go:141] libmachine: (old-k8s-version-862528) Creating domain...
I0410 22:37:55.848056 54076 main.go:141] libmachine: (old-k8s-version-862528) define libvirt domain using xml:
I0410 22:37:55.848077 54076 main.go:141] libmachine: (old-k8s-version-862528) <domain type='kvm'>
I0410 22:37:55.848106 54076 main.go:141] libmachine: (old-k8s-version-862528) <name>old-k8s-version-862528</name>
I0410 22:37:55.848121 54076 main.go:141] libmachine: (old-k8s-version-862528) <memory unit='MiB'>2200</memory>
I0410 22:37:55.848130 54076 main.go:141] libmachine: (old-k8s-version-862528) <vcpu>2</vcpu>
I0410 22:37:55.848137 54076 main.go:141] libmachine: (old-k8s-version-862528) <features>
I0410 22:37:55.848145 54076 main.go:141] libmachine: (old-k8s-version-862528) <acpi/>
I0410 22:37:55.848164 54076 main.go:141] libmachine: (old-k8s-version-862528) <apic/>
I0410 22:37:55.848176 54076 main.go:141] libmachine: (old-k8s-version-862528) <pae/>
I0410 22:37:55.848183 54076 main.go:141] libmachine: (old-k8s-version-862528)
I0410 22:37:55.848193 54076 main.go:141] libmachine: (old-k8s-version-862528) </features>
I0410 22:37:55.848202 54076 main.go:141] libmachine: (old-k8s-version-862528) <cpu mode='host-passthrough'>
I0410 22:37:55.848213 54076 main.go:141] libmachine: (old-k8s-version-862528)
I0410 22:37:55.848220 54076 main.go:141] libmachine: (old-k8s-version-862528) </cpu>
I0410 22:37:55.848229 54076 main.go:141] libmachine: (old-k8s-version-862528) <os>
I0410 22:37:55.848236 54076 main.go:141] libmachine: (old-k8s-version-862528) <type>hvm</type>
I0410 22:37:55.848273 54076 main.go:141] libmachine: (old-k8s-version-862528) <boot dev='cdrom'/>
I0410 22:37:55.848281 54076 main.go:141] libmachine: (old-k8s-version-862528) <boot dev='hd'/>
I0410 22:37:55.848297 54076 main.go:141] libmachine: (old-k8s-version-862528) <bootmenu enable='no'/>
I0410 22:37:55.848304 54076 main.go:141] libmachine: (old-k8s-version-862528) </os>
I0410 22:37:55.848312 54076 main.go:141] libmachine: (old-k8s-version-862528) <devices>
I0410 22:37:55.848319 54076 main.go:141] libmachine: (old-k8s-version-862528) <disk type='file' device='cdrom'>
I0410 22:37:55.848333 54076 main.go:141] libmachine: (old-k8s-version-862528) <source file='/home/jenkins/minikube-integration/18610-5679/.minikube/machines/old-k8s-version-862528/boot2docker.iso'/>
I0410 22:37:55.848341 54076 main.go:141] libmachine: (old-k8s-version-862528) <target dev='hdc' bus='scsi'/>
I0410 22:37:55.848351 54076 main.go:141] libmachine: (old-k8s-version-862528) <readonly/>
I0410 22:37:55.848358 54076 main.go:141] libmachine: (old-k8s-version-862528) </disk>
I0410 22:37:55.848367 54076 main.go:141] libmachine: (old-k8s-version-862528) <disk type='file' device='disk'>
I0410 22:37:55.848375 54076 main.go:141] libmachine: (old-k8s-version-862528) <driver name='qemu' type='raw' cache='default' io='threads' />
I0410 22:37:55.848388 54076 main.go:141] libmachine: (old-k8s-version-862528) <source file='/home/jenkins/minikube-integration/18610-5679/.minikube/machines/old-k8s-version-862528/old-k8s-version-862528.rawdisk'/>
I0410 22:37:55.848407 54076 main.go:141] libmachine: (old-k8s-version-862528) <target dev='hda' bus='virtio'/>
I0410 22:37:55.848415 54076 main.go:141] libmachine: (old-k8s-version-862528) </disk>
I0410 22:37:55.848423 54076 main.go:141] libmachine: (old-k8s-version-862528) <interface type='network'>
I0410 22:37:55.848432 54076 main.go:141] libmachine: (old-k8s-version-862528) <source network='mk-old-k8s-version-862528'/>
I0410 22:37:55.848439 54076 main.go:141] libmachine: (old-k8s-version-862528) <model type='virtio'/>
I0410 22:37:55.848447 54076 main.go:141] libmachine: (old-k8s-version-862528) </interface>
I0410 22:37:55.848459 54076 main.go:141] libmachine: (old-k8s-version-862528) <interface type='network'>
I0410 22:37:55.848468 54076 main.go:141] libmachine: (old-k8s-version-862528) <source network='default'/>
I0410 22:37:55.848480 54076 main.go:141] libmachine: (old-k8s-version-862528) <model type='virtio'/>
I0410 22:37:55.848491 54076 main.go:141] libmachine: (old-k8s-version-862528) </interface>
I0410 22:37:55.848498 54076 main.go:141] libmachine: (old-k8s-version-862528) <serial type='pty'>
I0410 22:37:55.848528 54076 main.go:141] libmachine: (old-k8s-version-862528) <target port='0'/>
I0410 22:37:55.848555 54076 main.go:141] libmachine: (old-k8s-version-862528) </serial>
I0410 22:37:55.848569 54076 main.go:141] libmachine: (old-k8s-version-862528) <console type='pty'>
I0410 22:37:55.848578 54076 main.go:141] libmachine: (old-k8s-version-862528) <target type='serial' port='0'/>
I0410 22:37:55.848600 54076 main.go:141] libmachine: (old-k8s-version-862528) </console>
I0410 22:37:55.848624 54076 main.go:141] libmachine: (old-k8s-version-862528) <rng model='virtio'>
I0410 22:37:55.848640 54076 main.go:141] libmachine: (old-k8s-version-862528) <backend model='random'>/dev/random</backend>
I0410 22:37:55.848660 54076 main.go:141] libmachine: (old-k8s-version-862528) </rng>
I0410 22:37:55.848671 54076 main.go:141] libmachine: (old-k8s-version-862528)
I0410 22:37:55.848681 54076 main.go:141] libmachine: (old-k8s-version-862528)
I0410 22:37:55.848690 54076 main.go:141] libmachine: (old-k8s-version-862528) </devices>
I0410 22:37:55.848701 54076 main.go:141] libmachine: (old-k8s-version-862528) </domain>
I0410 22:37:55.848714 54076 main.go:141] libmachine: (old-k8s-version-862528)
I0410 22:37:55.853584 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has defined MAC address 52:54:00:c8:19:b1 in network default
I0410 22:37:55.854426 54076 main.go:141] libmachine: (old-k8s-version-862528) Ensuring networks are active...
I0410 22:37:55.854454 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has defined MAC address 52:54:00:d0:b7:c9 in network mk-old-k8s-version-862528
I0410 22:37:55.855362 54076 main.go:141] libmachine: (old-k8s-version-862528) Ensuring network default is active
I0410 22:37:55.855833 54076 main.go:141] libmachine: (old-k8s-version-862528) Ensuring network mk-old-k8s-version-862528 is active
I0410 22:37:55.856721 54076 main.go:141] libmachine: (old-k8s-version-862528) Getting domain xml...
I0410 22:37:55.857765 54076 main.go:141] libmachine: (old-k8s-version-862528) Creating domain...
I0410 22:37:57.438847 54076 main.go:141] libmachine: (old-k8s-version-862528) Waiting to get IP...
I0410 22:37:57.439790 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has defined MAC address 52:54:00:d0:b7:c9 in network mk-old-k8s-version-862528
I0410 22:37:57.440310 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | unable to find current IP address of domain old-k8s-version-862528 in network mk-old-k8s-version-862528
I0410 22:37:57.440350 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | I0410 22:37:57.440271 54099 retry.go:31] will retry after 189.892953ms: waiting for machine to come up
I0410 22:37:57.632281 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has defined MAC address 52:54:00:d0:b7:c9 in network mk-old-k8s-version-862528
I0410 22:37:57.632930 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | unable to find current IP address of domain old-k8s-version-862528 in network mk-old-k8s-version-862528
I0410 22:37:57.632962 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | I0410 22:37:57.632868 54099 retry.go:31] will retry after 358.243173ms: waiting for machine to come up
I0410 22:37:57.993166 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has defined MAC address 52:54:00:d0:b7:c9 in network mk-old-k8s-version-862528
I0410 22:37:57.993775 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | unable to find current IP address of domain old-k8s-version-862528 in network mk-old-k8s-version-862528
I0410 22:37:57.993808 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | I0410 22:37:57.993728 54099 retry.go:31] will retry after 430.103842ms: waiting for machine to come up
I0410 22:37:58.425217 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has defined MAC address 52:54:00:d0:b7:c9 in network mk-old-k8s-version-862528
I0410 22:37:58.425747 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | unable to find current IP address of domain old-k8s-version-862528 in network mk-old-k8s-version-862528
I0410 22:37:58.425776 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | I0410 22:37:58.425704 54099 retry.go:31] will retry after 381.701747ms: waiting for machine to come up
I0410 22:37:58.809687 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has defined MAC address 52:54:00:d0:b7:c9 in network mk-old-k8s-version-862528
I0410 22:37:58.810235 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | unable to find current IP address of domain old-k8s-version-862528 in network mk-old-k8s-version-862528
I0410 22:37:58.810284 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | I0410 22:37:58.810187 54099 retry.go:31] will retry after 729.63661ms: waiting for machine to come up
I0410 22:37:59.541214 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has defined MAC address 52:54:00:d0:b7:c9 in network mk-old-k8s-version-862528
I0410 22:37:59.541886 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | unable to find current IP address of domain old-k8s-version-862528 in network mk-old-k8s-version-862528
I0410 22:37:59.541910 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | I0410 22:37:59.541826 54099 retry.go:31] will retry after 595.400924ms: waiting for machine to come up
I0410 22:38:00.138854 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has defined MAC address 52:54:00:d0:b7:c9 in network mk-old-k8s-version-862528
I0410 22:38:00.139455 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | unable to find current IP address of domain old-k8s-version-862528 in network mk-old-k8s-version-862528
I0410 22:38:00.139485 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | I0410 22:38:00.139408 54099 retry.go:31] will retry after 862.803885ms: waiting for machine to come up
I0410 22:38:01.003955 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has defined MAC address 52:54:00:d0:b7:c9 in network mk-old-k8s-version-862528
I0410 22:38:01.004455 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | unable to find current IP address of domain old-k8s-version-862528 in network mk-old-k8s-version-862528
I0410 22:38:01.004486 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | I0410 22:38:01.004387 54099 retry.go:31] will retry after 1.200369945s: waiting for machine to come up
I0410 22:38:02.206475 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has defined MAC address 52:54:00:d0:b7:c9 in network mk-old-k8s-version-862528
I0410 22:38:02.207101 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | unable to find current IP address of domain old-k8s-version-862528 in network mk-old-k8s-version-862528
I0410 22:38:02.207130 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | I0410 22:38:02.207048 54099 retry.go:31] will retry after 1.798287822s: waiting for machine to come up
I0410 22:38:04.008078 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has defined MAC address 52:54:00:d0:b7:c9 in network mk-old-k8s-version-862528
I0410 22:38:04.008619 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | unable to find current IP address of domain old-k8s-version-862528 in network mk-old-k8s-version-862528
I0410 22:38:04.008655 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | I0410 22:38:04.008577 54099 retry.go:31] will retry after 1.873858055s: waiting for machine to come up
I0410 22:38:05.883699 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has defined MAC address 52:54:00:d0:b7:c9 in network mk-old-k8s-version-862528
I0410 22:38:05.884297 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | unable to find current IP address of domain old-k8s-version-862528 in network mk-old-k8s-version-862528
I0410 22:38:05.884330 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | I0410 22:38:05.884244 54099 retry.go:31] will retry after 1.910046569s: waiting for machine to come up
I0410 22:38:07.795629 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has defined MAC address 52:54:00:d0:b7:c9 in network mk-old-k8s-version-862528
I0410 22:38:07.796144 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | unable to find current IP address of domain old-k8s-version-862528 in network mk-old-k8s-version-862528
I0410 22:38:07.796173 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | I0410 22:38:07.796097 54099 retry.go:31] will retry after 3.419239967s: waiting for machine to come up
I0410 22:38:11.216721 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has defined MAC address 52:54:00:d0:b7:c9 in network mk-old-k8s-version-862528
I0410 22:38:11.217205 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | unable to find current IP address of domain old-k8s-version-862528 in network mk-old-k8s-version-862528
I0410 22:38:11.217223 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | I0410 22:38:11.217182 54099 retry.go:31] will retry after 3.680922946s: waiting for machine to come up
I0410 22:38:14.901577 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has defined MAC address 52:54:00:d0:b7:c9 in network mk-old-k8s-version-862528
I0410 22:38:14.902131 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | unable to find current IP address of domain old-k8s-version-862528 in network mk-old-k8s-version-862528
I0410 22:38:14.902170 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | I0410 22:38:14.902093 54099 retry.go:31] will retry after 3.690544208s: waiting for machine to come up
I0410 22:38:18.594497 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has defined MAC address 52:54:00:d0:b7:c9 in network mk-old-k8s-version-862528
I0410 22:38:18.595018 54076 main.go:141] libmachine: (old-k8s-version-862528) Found IP for machine: 192.168.61.178
I0410 22:38:18.595051 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has current primary IP address 192.168.61.178 and MAC address 52:54:00:d0:b7:c9 in network mk-old-k8s-version-862528
I0410 22:38:18.595061 54076 main.go:141] libmachine: (old-k8s-version-862528) Reserving static IP address...
I0410 22:38:18.595409 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-862528", mac: "52:54:00:d0:b7:c9", ip: "192.168.61.178"} in network mk-old-k8s-version-862528
I0410 22:38:18.674426 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | Getting to WaitForSSH function...
I0410 22:38:18.674461 54076 main.go:141] libmachine: (old-k8s-version-862528) Reserved static IP address: 192.168.61.178
I0410 22:38:18.674510 54076 main.go:141] libmachine: (old-k8s-version-862528) Waiting for SSH to be available...
I0410 22:38:18.677208 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has defined MAC address 52:54:00:d0:b7:c9 in network mk-old-k8s-version-862528
I0410 22:38:18.677619 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d0:b7:c9", ip: ""} in network mk-old-k8s-version-862528: {Iface:virbr1 ExpiryTime:2024-04-10 23:38:11 +0000 UTC Type:0 Mac:52:54:00:d0:b7:c9 Iaid: IPaddr:192.168.61.178 Prefix:24 Hostname:minikube Clientid:01:52:54:00:d0:b7:c9}
I0410 22:38:18.677652 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has defined IP address 192.168.61.178 and MAC address 52:54:00:d0:b7:c9 in network mk-old-k8s-version-862528
I0410 22:38:18.677832 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | Using SSH client type: external
I0410 22:38:18.677855 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | Using SSH private key: /home/jenkins/minikube-integration/18610-5679/.minikube/machines/old-k8s-version-862528/id_rsa (-rw-------)
I0410 22:38:18.677883 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.61.178 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/18610-5679/.minikube/machines/old-k8s-version-862528/id_rsa -p 22] /usr/bin/ssh <nil>}
I0410 22:38:18.677904 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | About to run SSH command:
I0410 22:38:18.677917 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | exit 0
I0410 22:38:18.801226 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | SSH cmd err, output: <nil>:
I0410 22:38:18.801539 54076 main.go:141] libmachine: (old-k8s-version-862528) KVM machine creation complete!
I0410 22:38:18.801826 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetConfigRaw
I0410 22:38:18.802414 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .DriverName
I0410 22:38:18.802648 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .DriverName
I0410 22:38:18.802812 54076 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0410 22:38:18.802825 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetState
I0410 22:38:18.804274 54076 main.go:141] libmachine: Detecting operating system of created instance...
I0410 22:38:18.804288 54076 main.go:141] libmachine: Waiting for SSH to be available...
I0410 22:38:18.804294 54076 main.go:141] libmachine: Getting to WaitForSSH function...
I0410 22:38:18.804300 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetSSHHostname
I0410 22:38:18.807025 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has defined MAC address 52:54:00:d0:b7:c9 in network mk-old-k8s-version-862528
I0410 22:38:18.807426 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d0:b7:c9", ip: ""} in network mk-old-k8s-version-862528: {Iface:virbr1 ExpiryTime:2024-04-10 23:38:11 +0000 UTC Type:0 Mac:52:54:00:d0:b7:c9 Iaid: IPaddr:192.168.61.178 Prefix:24 Hostname:old-k8s-version-862528 Clientid:01:52:54:00:d0:b7:c9}
I0410 22:38:18.807460 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has defined IP address 192.168.61.178 and MAC address 52:54:00:d0:b7:c9 in network mk-old-k8s-version-862528
I0410 22:38:18.807600 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetSSHPort
I0410 22:38:18.807800 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetSSHKeyPath
I0410 22:38:18.807994 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetSSHKeyPath
I0410 22:38:18.808150 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetSSHUsername
I0410 22:38:18.808331 54076 main.go:141] libmachine: Using SSH client type: native
I0410 22:38:18.808604 54076 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.61.178 22 <nil> <nil>}
I0410 22:38:18.808621 54076 main.go:141] libmachine: About to run SSH command:
exit 0
I0410 22:38:18.912253 54076 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0410 22:38:18.912284 54076 main.go:141] libmachine: Detecting the provisioner...
I0410 22:38:18.912292 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetSSHHostname
I0410 22:38:18.915541 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has defined MAC address 52:54:00:d0:b7:c9 in network mk-old-k8s-version-862528
I0410 22:38:18.916012 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d0:b7:c9", ip: ""} in network mk-old-k8s-version-862528: {Iface:virbr1 ExpiryTime:2024-04-10 23:38:11 +0000 UTC Type:0 Mac:52:54:00:d0:b7:c9 Iaid: IPaddr:192.168.61.178 Prefix:24 Hostname:old-k8s-version-862528 Clientid:01:52:54:00:d0:b7:c9}
I0410 22:38:18.916043 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has defined IP address 192.168.61.178 and MAC address 52:54:00:d0:b7:c9 in network mk-old-k8s-version-862528
I0410 22:38:18.916290 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetSSHPort
I0410 22:38:18.916614 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetSSHKeyPath
I0410 22:38:18.916907 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetSSHKeyPath
I0410 22:38:18.917098 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetSSHUsername
I0410 22:38:18.917311 54076 main.go:141] libmachine: Using SSH client type: native
I0410 22:38:18.917560 54076 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.61.178 22 <nil> <nil>}
I0410 22:38:18.917577 54076 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0410 22:38:19.021524 54076 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0410 22:38:19.021616 54076 main.go:141] libmachine: found compatible host: buildroot
I0410 22:38:19.021626 54076 main.go:141] libmachine: Provisioning with buildroot...
I0410 22:38:19.021638 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetMachineName
I0410 22:38:19.021896 54076 buildroot.go:166] provisioning hostname "old-k8s-version-862528"
I0410 22:38:19.021920 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetMachineName
I0410 22:38:19.022210 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetSSHHostname
I0410 22:38:19.025409 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has defined MAC address 52:54:00:d0:b7:c9 in network mk-old-k8s-version-862528
I0410 22:38:19.025846 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d0:b7:c9", ip: ""} in network mk-old-k8s-version-862528: {Iface:virbr1 ExpiryTime:2024-04-10 23:38:11 +0000 UTC Type:0 Mac:52:54:00:d0:b7:c9 Iaid: IPaddr:192.168.61.178 Prefix:24 Hostname:old-k8s-version-862528 Clientid:01:52:54:00:d0:b7:c9}
I0410 22:38:19.025880 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has defined IP address 192.168.61.178 and MAC address 52:54:00:d0:b7:c9 in network mk-old-k8s-version-862528
I0410 22:38:19.026059 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetSSHPort
I0410 22:38:19.026251 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetSSHKeyPath
I0410 22:38:19.026407 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetSSHKeyPath
I0410 22:38:19.026549 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetSSHUsername
I0410 22:38:19.026787 54076 main.go:141] libmachine: Using SSH client type: native
I0410 22:38:19.026985 54076 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.61.178 22 <nil> <nil>}
I0410 22:38:19.027004 54076 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-862528 && echo "old-k8s-version-862528" | sudo tee /etc/hostname
I0410 22:38:19.144577 54076 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-862528
I0410 22:38:19.144614 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetSSHHostname
I0410 22:38:19.147460 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has defined MAC address 52:54:00:d0:b7:c9 in network mk-old-k8s-version-862528
I0410 22:38:19.147826 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d0:b7:c9", ip: ""} in network mk-old-k8s-version-862528: {Iface:virbr1 ExpiryTime:2024-04-10 23:38:11 +0000 UTC Type:0 Mac:52:54:00:d0:b7:c9 Iaid: IPaddr:192.168.61.178 Prefix:24 Hostname:old-k8s-version-862528 Clientid:01:52:54:00:d0:b7:c9}
I0410 22:38:19.147858 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has defined IP address 192.168.61.178 and MAC address 52:54:00:d0:b7:c9 in network mk-old-k8s-version-862528
I0410 22:38:19.148005 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetSSHPort
I0410 22:38:19.148221 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetSSHKeyPath
I0410 22:38:19.148391 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetSSHKeyPath
I0410 22:38:19.148607 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetSSHUsername
I0410 22:38:19.148756 54076 main.go:141] libmachine: Using SSH client type: native
I0410 22:38:19.148943 54076 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.61.178 22 <nil> <nil>}
I0410 22:38:19.148969 54076 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-862528' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-862528/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-862528' | sudo tee -a /etc/hosts;
fi
fi
I0410 22:38:19.262704 54076 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0410 22:38:19.262755 54076 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/18610-5679/.minikube CaCertPath:/home/jenkins/minikube-integration/18610-5679/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18610-5679/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18610-5679/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18610-5679/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18610-5679/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18610-5679/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18610-5679/.minikube}
I0410 22:38:19.262783 54076 buildroot.go:174] setting up certificates
I0410 22:38:19.262794 54076 provision.go:84] configureAuth start
I0410 22:38:19.262803 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetMachineName
I0410 22:38:19.263086 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetIP
I0410 22:38:19.265890 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has defined MAC address 52:54:00:d0:b7:c9 in network mk-old-k8s-version-862528
I0410 22:38:19.266290 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d0:b7:c9", ip: ""} in network mk-old-k8s-version-862528: {Iface:virbr1 ExpiryTime:2024-04-10 23:38:11 +0000 UTC Type:0 Mac:52:54:00:d0:b7:c9 Iaid: IPaddr:192.168.61.178 Prefix:24 Hostname:old-k8s-version-862528 Clientid:01:52:54:00:d0:b7:c9}
I0410 22:38:19.266321 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has defined IP address 192.168.61.178 and MAC address 52:54:00:d0:b7:c9 in network mk-old-k8s-version-862528
I0410 22:38:19.266461 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetSSHHostname
I0410 22:38:19.268540 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has defined MAC address 52:54:00:d0:b7:c9 in network mk-old-k8s-version-862528
I0410 22:38:19.268856 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d0:b7:c9", ip: ""} in network mk-old-k8s-version-862528: {Iface:virbr1 ExpiryTime:2024-04-10 23:38:11 +0000 UTC Type:0 Mac:52:54:00:d0:b7:c9 Iaid: IPaddr:192.168.61.178 Prefix:24 Hostname:old-k8s-version-862528 Clientid:01:52:54:00:d0:b7:c9}
I0410 22:38:19.268883 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has defined IP address 192.168.61.178 and MAC address 52:54:00:d0:b7:c9 in network mk-old-k8s-version-862528
I0410 22:38:19.268954 54076 provision.go:143] copyHostCerts
I0410 22:38:19.269004 54076 exec_runner.go:144] found /home/jenkins/minikube-integration/18610-5679/.minikube/ca.pem, removing ...
I0410 22:38:19.269021 54076 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18610-5679/.minikube/ca.pem
I0410 22:38:19.269077 54076 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18610-5679/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18610-5679/.minikube/ca.pem (1082 bytes)
I0410 22:38:19.269187 54076 exec_runner.go:144] found /home/jenkins/minikube-integration/18610-5679/.minikube/cert.pem, removing ...
I0410 22:38:19.269197 54076 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18610-5679/.minikube/cert.pem
I0410 22:38:19.269218 54076 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18610-5679/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18610-5679/.minikube/cert.pem (1123 bytes)
I0410 22:38:19.269277 54076 exec_runner.go:144] found /home/jenkins/minikube-integration/18610-5679/.minikube/key.pem, removing ...
I0410 22:38:19.269286 54076 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18610-5679/.minikube/key.pem
I0410 22:38:19.269360 54076 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18610-5679/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18610-5679/.minikube/key.pem (1679 bytes)
I0410 22:38:19.269445 54076 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18610-5679/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18610-5679/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18610-5679/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-862528 san=[127.0.0.1 192.168.61.178 localhost minikube old-k8s-version-862528]
I0410 22:38:19.536953 54076 provision.go:177] copyRemoteCerts
I0410 22:38:19.537010 54076 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0410 22:38:19.537035 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetSSHHostname
I0410 22:38:19.540218 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has defined MAC address 52:54:00:d0:b7:c9 in network mk-old-k8s-version-862528
I0410 22:38:19.540552 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d0:b7:c9", ip: ""} in network mk-old-k8s-version-862528: {Iface:virbr1 ExpiryTime:2024-04-10 23:38:11 +0000 UTC Type:0 Mac:52:54:00:d0:b7:c9 Iaid: IPaddr:192.168.61.178 Prefix:24 Hostname:old-k8s-version-862528 Clientid:01:52:54:00:d0:b7:c9}
I0410 22:38:19.540582 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has defined IP address 192.168.61.178 and MAC address 52:54:00:d0:b7:c9 in network mk-old-k8s-version-862528
I0410 22:38:19.540779 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetSSHPort
I0410 22:38:19.540974 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetSSHKeyPath
I0410 22:38:19.541134 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetSSHUsername
I0410 22:38:19.541291 54076 sshutil.go:53] new ssh client: &{IP:192.168.61.178 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18610-5679/.minikube/machines/old-k8s-version-862528/id_rsa Username:docker}
I0410 22:38:19.623273 54076 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18610-5679/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0410 22:38:19.649632 54076 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18610-5679/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0410 22:38:19.675483 54076 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18610-5679/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0410 22:38:19.701836 54076 provision.go:87] duration metric: took 439.032033ms to configureAuth
I0410 22:38:19.701871 54076 buildroot.go:189] setting minikube options for container-runtime
I0410 22:38:19.702066 54076 config.go:182] Loaded profile config "old-k8s-version-862528": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0410 22:38:19.702140 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetSSHHostname
I0410 22:38:19.705304 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has defined MAC address 52:54:00:d0:b7:c9 in network mk-old-k8s-version-862528
I0410 22:38:19.705727 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d0:b7:c9", ip: ""} in network mk-old-k8s-version-862528: {Iface:virbr1 ExpiryTime:2024-04-10 23:38:11 +0000 UTC Type:0 Mac:52:54:00:d0:b7:c9 Iaid: IPaddr:192.168.61.178 Prefix:24 Hostname:old-k8s-version-862528 Clientid:01:52:54:00:d0:b7:c9}
I0410 22:38:19.705758 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has defined IP address 192.168.61.178 and MAC address 52:54:00:d0:b7:c9 in network mk-old-k8s-version-862528
I0410 22:38:19.705931 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetSSHPort
I0410 22:38:19.706158 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetSSHKeyPath
I0410 22:38:19.706326 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetSSHKeyPath
I0410 22:38:19.706460 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetSSHUsername
I0410 22:38:19.706627 54076 main.go:141] libmachine: Using SSH client type: native
I0410 22:38:19.706827 54076 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.61.178 22 <nil> <nil>}
I0410 22:38:19.706856 54076 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0410 22:38:19.989492 54076 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0410 22:38:19.989523 54076 main.go:141] libmachine: Checking connection to Docker...
I0410 22:38:19.989535 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetURL
I0410 22:38:19.990985 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | Using libvirt version 6000000
I0410 22:38:19.993875 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has defined MAC address 52:54:00:d0:b7:c9 in network mk-old-k8s-version-862528
I0410 22:38:19.994287 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d0:b7:c9", ip: ""} in network mk-old-k8s-version-862528: {Iface:virbr1 ExpiryTime:2024-04-10 23:38:11 +0000 UTC Type:0 Mac:52:54:00:d0:b7:c9 Iaid: IPaddr:192.168.61.178 Prefix:24 Hostname:old-k8s-version-862528 Clientid:01:52:54:00:d0:b7:c9}
I0410 22:38:19.994321 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has defined IP address 192.168.61.178 and MAC address 52:54:00:d0:b7:c9 in network mk-old-k8s-version-862528
I0410 22:38:19.994532 54076 main.go:141] libmachine: Docker is up and running!
I0410 22:38:19.994549 54076 main.go:141] libmachine: Reticulating splines...
I0410 22:38:19.994556 54076 client.go:171] duration metric: took 24.779035836s to LocalClient.Create
I0410 22:38:19.994578 54076 start.go:167] duration metric: took 24.779102182s to libmachine.API.Create "old-k8s-version-862528"
I0410 22:38:19.994591 54076 start.go:293] postStartSetup for "old-k8s-version-862528" (driver="kvm2")
I0410 22:38:19.994605 54076 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0410 22:38:19.994627 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .DriverName
I0410 22:38:19.994905 54076 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0410 22:38:19.994929 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetSSHHostname
I0410 22:38:19.997421 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has defined MAC address 52:54:00:d0:b7:c9 in network mk-old-k8s-version-862528
I0410 22:38:19.997739 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d0:b7:c9", ip: ""} in network mk-old-k8s-version-862528: {Iface:virbr1 ExpiryTime:2024-04-10 23:38:11 +0000 UTC Type:0 Mac:52:54:00:d0:b7:c9 Iaid: IPaddr:192.168.61.178 Prefix:24 Hostname:old-k8s-version-862528 Clientid:01:52:54:00:d0:b7:c9}
I0410 22:38:19.997757 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has defined IP address 192.168.61.178 and MAC address 52:54:00:d0:b7:c9 in network mk-old-k8s-version-862528
I0410 22:38:19.997985 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetSSHPort
I0410 22:38:19.998193 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetSSHKeyPath
I0410 22:38:19.998367 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetSSHUsername
I0410 22:38:19.998511 54076 sshutil.go:53] new ssh client: &{IP:192.168.61.178 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18610-5679/.minikube/machines/old-k8s-version-862528/id_rsa Username:docker}
I0410 22:38:20.079865 54076 ssh_runner.go:195] Run: cat /etc/os-release
I0410 22:38:20.085089 54076 info.go:137] Remote host: Buildroot 2023.02.9
I0410 22:38:20.085119 54076 filesync.go:126] Scanning /home/jenkins/minikube-integration/18610-5679/.minikube/addons for local assets ...
I0410 22:38:20.085182 54076 filesync.go:126] Scanning /home/jenkins/minikube-integration/18610-5679/.minikube/files for local assets ...
I0410 22:38:20.085257 54076 filesync.go:149] local asset: /home/jenkins/minikube-integration/18610-5679/.minikube/files/etc/ssl/certs/130012.pem -> 130012.pem in /etc/ssl/certs
I0410 22:38:20.085360 54076 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0410 22:38:20.095712 54076 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18610-5679/.minikube/files/etc/ssl/certs/130012.pem --> /etc/ssl/certs/130012.pem (1708 bytes)
I0410 22:38:20.128057 54076 start.go:296] duration metric: took 133.448822ms for postStartSetup
I0410 22:38:20.128124 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetConfigRaw
I0410 22:38:20.128786 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetIP
I0410 22:38:20.132366 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has defined MAC address 52:54:00:d0:b7:c9 in network mk-old-k8s-version-862528
I0410 22:38:20.132862 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d0:b7:c9", ip: ""} in network mk-old-k8s-version-862528: {Iface:virbr1 ExpiryTime:2024-04-10 23:38:11 +0000 UTC Type:0 Mac:52:54:00:d0:b7:c9 Iaid: IPaddr:192.168.61.178 Prefix:24 Hostname:old-k8s-version-862528 Clientid:01:52:54:00:d0:b7:c9}
I0410 22:38:20.132892 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has defined IP address 192.168.61.178 and MAC address 52:54:00:d0:b7:c9 in network mk-old-k8s-version-862528
I0410 22:38:20.133169 54076 profile.go:143] Saving config to /home/jenkins/minikube-integration/18610-5679/.minikube/profiles/old-k8s-version-862528/config.json ...
I0410 22:38:20.133421 54076 start.go:128] duration metric: took 24.935983796s to createHost
I0410 22:38:20.133450 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetSSHHostname
I0410 22:38:20.136569 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has defined MAC address 52:54:00:d0:b7:c9 in network mk-old-k8s-version-862528
I0410 22:38:20.136911 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d0:b7:c9", ip: ""} in network mk-old-k8s-version-862528: {Iface:virbr1 ExpiryTime:2024-04-10 23:38:11 +0000 UTC Type:0 Mac:52:54:00:d0:b7:c9 Iaid: IPaddr:192.168.61.178 Prefix:24 Hostname:old-k8s-version-862528 Clientid:01:52:54:00:d0:b7:c9}
I0410 22:38:20.136959 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has defined IP address 192.168.61.178 and MAC address 52:54:00:d0:b7:c9 in network mk-old-k8s-version-862528
I0410 22:38:20.137168 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetSSHPort
I0410 22:38:20.137460 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetSSHKeyPath
I0410 22:38:20.137655 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetSSHKeyPath
I0410 22:38:20.137862 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetSSHUsername
I0410 22:38:20.138085 54076 main.go:141] libmachine: Using SSH client type: native
I0410 22:38:20.138322 54076 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.61.178 22 <nil> <nil>}
I0410 22:38:20.138340 54076 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0410 22:38:20.249801 54076 main.go:141] libmachine: SSH cmd err, output: <nil>: 1712788700.230922574
I0410 22:38:20.249824 54076 fix.go:216] guest clock: 1712788700.230922574
I0410 22:38:20.249846 54076 fix.go:229] Guest: 2024-04-10 22:38:20.230922574 +0000 UTC Remote: 2024-04-10 22:38:20.133435799 +0000 UTC m=+25.060259928 (delta=97.486775ms)
I0410 22:38:20.249872 54076 fix.go:200] guest clock delta is within tolerance: 97.486775ms
I0410 22:38:20.249878 54076 start.go:83] releasing machines lock for "old-k8s-version-862528", held for 25.052568708s
I0410 22:38:20.249904 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .DriverName
I0410 22:38:20.250201 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetIP
I0410 22:38:20.253492 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has defined MAC address 52:54:00:d0:b7:c9 in network mk-old-k8s-version-862528
I0410 22:38:20.253881 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d0:b7:c9", ip: ""} in network mk-old-k8s-version-862528: {Iface:virbr1 ExpiryTime:2024-04-10 23:38:11 +0000 UTC Type:0 Mac:52:54:00:d0:b7:c9 Iaid: IPaddr:192.168.61.178 Prefix:24 Hostname:old-k8s-version-862528 Clientid:01:52:54:00:d0:b7:c9}
I0410 22:38:20.253912 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has defined IP address 192.168.61.178 and MAC address 52:54:00:d0:b7:c9 in network mk-old-k8s-version-862528
I0410 22:38:20.254125 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .DriverName
I0410 22:38:20.254725 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .DriverName
I0410 22:38:20.254905 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .DriverName
I0410 22:38:20.255008 54076 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0410 22:38:20.255060 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetSSHHostname
I0410 22:38:20.255123 54076 ssh_runner.go:195] Run: cat /version.json
I0410 22:38:20.255161 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetSSHHostname
I0410 22:38:20.258133 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has defined MAC address 52:54:00:d0:b7:c9 in network mk-old-k8s-version-862528
I0410 22:38:20.258212 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has defined MAC address 52:54:00:d0:b7:c9 in network mk-old-k8s-version-862528
I0410 22:38:20.258571 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d0:b7:c9", ip: ""} in network mk-old-k8s-version-862528: {Iface:virbr1 ExpiryTime:2024-04-10 23:38:11 +0000 UTC Type:0 Mac:52:54:00:d0:b7:c9 Iaid: IPaddr:192.168.61.178 Prefix:24 Hostname:old-k8s-version-862528 Clientid:01:52:54:00:d0:b7:c9}
I0410 22:38:20.258612 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d0:b7:c9", ip: ""} in network mk-old-k8s-version-862528: {Iface:virbr1 ExpiryTime:2024-04-10 23:38:11 +0000 UTC Type:0 Mac:52:54:00:d0:b7:c9 Iaid: IPaddr:192.168.61.178 Prefix:24 Hostname:old-k8s-version-862528 Clientid:01:52:54:00:d0:b7:c9}
I0410 22:38:20.258651 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has defined IP address 192.168.61.178 and MAC address 52:54:00:d0:b7:c9 in network mk-old-k8s-version-862528
I0410 22:38:20.258669 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has defined IP address 192.168.61.178 and MAC address 52:54:00:d0:b7:c9 in network mk-old-k8s-version-862528
I0410 22:38:20.258859 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetSSHPort
I0410 22:38:20.258912 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetSSHPort
I0410 22:38:20.259062 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetSSHKeyPath
I0410 22:38:20.259139 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetSSHKeyPath
I0410 22:38:20.259233 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetSSHUsername
I0410 22:38:20.259320 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetSSHUsername
I0410 22:38:20.259399 54076 sshutil.go:53] new ssh client: &{IP:192.168.61.178 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18610-5679/.minikube/machines/old-k8s-version-862528/id_rsa Username:docker}
I0410 22:38:20.259493 54076 sshutil.go:53] new ssh client: &{IP:192.168.61.178 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18610-5679/.minikube/machines/old-k8s-version-862528/id_rsa Username:docker}
I0410 22:38:20.379056 54076 ssh_runner.go:195] Run: systemctl --version
I0410 22:38:20.389333 54076 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0410 22:38:20.571830 54076 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0410 22:38:20.580163 54076 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0410 22:38:20.580236 54076 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0410 22:38:20.597391 54076 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0410 22:38:20.597420 54076 start.go:494] detecting cgroup driver to use...
I0410 22:38:20.597489 54076 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0410 22:38:20.615564 54076 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0410 22:38:20.631667 54076 docker.go:217] disabling cri-docker service (if available) ...
I0410 22:38:20.631750 54076 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0410 22:38:20.646357 54076 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0410 22:38:20.661728 54076 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0410 22:38:20.786804 54076 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0410 22:38:20.958013 54076 docker.go:233] disabling docker service ...
I0410 22:38:20.958075 54076 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0410 22:38:20.981620 54076 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0410 22:38:20.997438 54076 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0410 22:38:21.151965 54076 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0410 22:38:21.309613 54076 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0410 22:38:21.324908 54076 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0410 22:38:21.347527 54076 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0410 22:38:21.347589 54076 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0410 22:38:21.359177 54076 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0410 22:38:21.359266 54076 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0410 22:38:21.374018 54076 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0410 22:38:21.387445 54076 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0410 22:38:21.400067 54076 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0410 22:38:21.415080 54076 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0410 22:38:21.426673 54076 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0410 22:38:21.426745 54076 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0410 22:38:21.442713 54076 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0410 22:38:21.453705 54076 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0410 22:38:21.611568 54076 ssh_runner.go:195] Run: sudo systemctl restart crio
I0410 22:38:21.778886 54076 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0410 22:38:21.778952 54076 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0410 22:38:21.784578 54076 start.go:562] Will wait 60s for crictl version
I0410 22:38:21.784653 54076 ssh_runner.go:195] Run: which crictl
I0410 22:38:21.790051 54076 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0410 22:38:21.831257 54076 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0410 22:38:21.831338 54076 ssh_runner.go:195] Run: crio --version
I0410 22:38:21.864924 54076 ssh_runner.go:195] Run: crio --version
I0410 22:38:21.902810 54076 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0410 22:38:21.904384 54076 main.go:141] libmachine: (old-k8s-version-862528) Calling .GetIP
I0410 22:38:21.907659 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has defined MAC address 52:54:00:d0:b7:c9 in network mk-old-k8s-version-862528
I0410 22:38:21.908239 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d0:b7:c9", ip: ""} in network mk-old-k8s-version-862528: {Iface:virbr1 ExpiryTime:2024-04-10 23:38:11 +0000 UTC Type:0 Mac:52:54:00:d0:b7:c9 Iaid: IPaddr:192.168.61.178 Prefix:24 Hostname:old-k8s-version-862528 Clientid:01:52:54:00:d0:b7:c9}
I0410 22:38:21.908268 54076 main.go:141] libmachine: (old-k8s-version-862528) DBG | domain old-k8s-version-862528 has defined IP address 192.168.61.178 and MAC address 52:54:00:d0:b7:c9 in network mk-old-k8s-version-862528
I0410 22:38:21.908591 54076 ssh_runner.go:195] Run: grep 192.168.61.1 host.minikube.internal$ /etc/hosts
I0410 22:38:21.913572 54076 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.61.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0410 22:38:21.928659 54076 kubeadm.go:877] updating cluster {Name:old-k8s-version-862528 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18610/minikube-v1.33.0-1712743565-18610-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1712743643-18610@sha256:57f6b6f207b748ce717275fbcd6ae3dba156d24f7d9b85b4b7e51b63bacaf9dc Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-862528 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.178 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] M
ountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0410 22:38:21.928832 54076 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0410 22:38:21.928891 54076 ssh_runner.go:195] Run: sudo crictl images --output json
I0410 22:38:21.982315 54076 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0410 22:38:21.982412 54076 ssh_runner.go:195] Run: which lz4
I0410 22:38:21.988847 54076 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0410 22:38:21.994586 54076 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0410 22:38:21.994634 54076 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18610-5679/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0410 22:38:23.889193 54076 crio.go:462] duration metric: took 1.900393525s to copy over tarball
I0410 22:38:23.889273 54076 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0410 22:38:26.601071 54076 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.711755929s)
I0410 22:38:26.601099 54076 crio.go:469] duration metric: took 2.711876956s to extract the tarball
I0410 22:38:26.601105 54076 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0410 22:38:26.643993 54076 ssh_runner.go:195] Run: sudo crictl images --output json
I0410 22:38:26.690553 54076 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0410 22:38:26.690578 54076 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0410 22:38:26.690658 54076 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0410 22:38:26.690739 54076 image.go:134] retrieving image: registry.k8s.io/pause:3.2
I0410 22:38:26.690754 54076 image.go:134] retrieving image: registry.k8s.io/coredns:1.7.0
I0410 22:38:26.690658 54076 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0410 22:38:26.690669 54076 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0410 22:38:26.690949 54076 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0410 22:38:26.690710 54076 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0410 22:38:26.691259 54076 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0410 22:38:26.692443 54076 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0410 22:38:26.692469 54076 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0410 22:38:26.692476 54076 image.go:177] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0410 22:38:26.692484 54076 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0410 22:38:26.692486 54076 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0410 22:38:26.692533 54076 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0410 22:38:26.692547 54076 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0410 22:38:26.692606 54076 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0410 22:38:26.893740 54076 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0410 22:38:26.894378 54076 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0410 22:38:26.895033 54076 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0410 22:38:26.896433 54076 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0410 22:38:26.917503 54076 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0410 22:38:26.924799 54076 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0410 22:38:26.932530 54076 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0410 22:38:27.048366 54076 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0410 22:38:27.048427 54076 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0410 22:38:27.048462 54076 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0410 22:38:27.048497 54076 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0410 22:38:27.048546 54076 ssh_runner.go:195] Run: which crictl
I0410 22:38:27.048474 54076 ssh_runner.go:195] Run: which crictl
I0410 22:38:27.054324 54076 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0410 22:38:27.054371 54076 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0410 22:38:27.054420 54076 ssh_runner.go:195] Run: which crictl
I0410 22:38:27.109039 54076 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0410 22:38:27.109071 54076 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0410 22:38:27.109084 54076 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0410 22:38:27.109099 54076 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0410 22:38:27.109102 54076 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0410 22:38:27.109128 54076 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0410 22:38:27.109133 54076 ssh_runner.go:195] Run: which crictl
I0410 22:38:27.109160 54076 ssh_runner.go:195] Run: which crictl
I0410 22:38:27.109131 54076 ssh_runner.go:195] Run: which crictl
I0410 22:38:27.114975 54076 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0410 22:38:27.115023 54076 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0410 22:38:27.115043 54076 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0410 22:38:27.115054 54076 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0410 22:38:27.115072 54076 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0410 22:38:27.115106 54076 ssh_runner.go:195] Run: which crictl
I0410 22:38:27.121085 54076 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0410 22:38:27.121162 54076 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0410 22:38:27.122572 54076 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0410 22:38:27.136897 54076 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0410 22:38:27.258559 54076 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18610-5679/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0410 22:38:27.287188 54076 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18610-5679/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0410 22:38:27.287239 54076 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18610-5679/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0410 22:38:27.293816 54076 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18610-5679/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0410 22:38:27.293907 54076 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18610-5679/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0410 22:38:27.299127 54076 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18610-5679/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0410 22:38:27.302437 54076 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18610-5679/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0410 22:38:28.047648 54076 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0410 22:38:28.190351 54076 cache_images.go:92] duration metric: took 1.499760847s to LoadCachedImages
W0410 22:38:28.190462 54076 out.go:239] X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/18610-5679/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2: no such file or directory
X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/18610-5679/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2: no such file or directory
I0410 22:38:28.190484 54076 kubeadm.go:928] updating node { 192.168.61.178 8443 v1.20.0 crio true true} ...
I0410 22:38:28.190612 54076 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-862528 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.61.178
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-862528 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0410 22:38:28.190700 54076 ssh_runner.go:195] Run: crio config
I0410 22:38:28.252638 54076 cni.go:84] Creating CNI manager for ""
I0410 22:38:28.252662 54076 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0410 22:38:28.252676 54076 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0410 22:38:28.252693 54076 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.61.178 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-862528 NodeName:old-k8s-version-862528 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.61.178"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.61.178 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0410 22:38:28.252820 54076 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.61.178
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-862528"
kubeletExtraArgs:
node-ip: 192.168.61.178
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.61.178"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0410 22:38:28.252877 54076 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0410 22:38:28.263896 54076 binaries.go:44] Found k8s binaries, skipping transfer
I0410 22:38:28.263972 54076 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0410 22:38:28.278532 54076 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0410 22:38:28.303419 54076 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0410 22:38:28.323926 54076 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0410 22:38:28.345430 54076 ssh_runner.go:195] Run: grep 192.168.61.178 control-plane.minikube.internal$ /etc/hosts
I0410 22:38:28.350087 54076 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.61.178 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0410 22:38:28.364298 54076 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0410 22:38:28.490127 54076 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0410 22:38:28.508394 54076 certs.go:68] Setting up /home/jenkins/minikube-integration/18610-5679/.minikube/profiles/old-k8s-version-862528 for IP: 192.168.61.178
I0410 22:38:28.508435 54076 certs.go:194] generating shared ca certs ...
I0410 22:38:28.508456 54076 certs.go:226] acquiring lock for ca certs: {Name:mkdf516eef4dca65fdb46927a7d7b777d4098df9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0410 22:38:28.508624 54076 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18610-5679/.minikube/ca.key
I0410 22:38:28.508680 54076 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18610-5679/.minikube/proxy-client-ca.key
I0410 22:38:28.508693 54076 certs.go:256] generating profile certs ...
I0410 22:38:28.508754 54076 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/18610-5679/.minikube/profiles/old-k8s-version-862528/client.key
I0410 22:38:28.508772 54076 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18610-5679/.minikube/profiles/old-k8s-version-862528/client.crt with IP's: []
I0410 22:38:28.603375 54076 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18610-5679/.minikube/profiles/old-k8s-version-862528/client.crt ...
I0410 22:38:28.603403 54076 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18610-5679/.minikube/profiles/old-k8s-version-862528/client.crt: {Name:mk6ad76bb551be0d771b2f703efa106dc20ea744 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0410 22:38:28.603581 54076 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18610-5679/.minikube/profiles/old-k8s-version-862528/client.key ...
I0410 22:38:28.603599 54076 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18610-5679/.minikube/profiles/old-k8s-version-862528/client.key: {Name:mk08bec3b5e90ea533a9b55b1f1716f490fd4dcf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0410 22:38:28.603683 54076 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/18610-5679/.minikube/profiles/old-k8s-version-862528/apiserver.key.a46c310c
I0410 22:38:28.603698 54076 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18610-5679/.minikube/profiles/old-k8s-version-862528/apiserver.crt.a46c310c with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.61.178]
I0410 22:38:29.027490 54076 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18610-5679/.minikube/profiles/old-k8s-version-862528/apiserver.crt.a46c310c ...
I0410 22:38:29.027528 54076 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18610-5679/.minikube/profiles/old-k8s-version-862528/apiserver.crt.a46c310c: {Name:mk227923e4a364963acde43e48095c4dcb73a3f4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0410 22:38:29.027687 54076 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18610-5679/.minikube/profiles/old-k8s-version-862528/apiserver.key.a46c310c ...
I0410 22:38:29.027704 54076 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18610-5679/.minikube/profiles/old-k8s-version-862528/apiserver.key.a46c310c: {Name:mk700582629292aecd3bee7cd4582834a9a976d2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0410 22:38:29.027771 54076 certs.go:381] copying /home/jenkins/minikube-integration/18610-5679/.minikube/profiles/old-k8s-version-862528/apiserver.crt.a46c310c -> /home/jenkins/minikube-integration/18610-5679/.minikube/profiles/old-k8s-version-862528/apiserver.crt
I0410 22:38:29.027870 54076 certs.go:385] copying /home/jenkins/minikube-integration/18610-5679/.minikube/profiles/old-k8s-version-862528/apiserver.key.a46c310c -> /home/jenkins/minikube-integration/18610-5679/.minikube/profiles/old-k8s-version-862528/apiserver.key
I0410 22:38:29.027930 54076 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/18610-5679/.minikube/profiles/old-k8s-version-862528/proxy-client.key
I0410 22:38:29.027946 54076 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18610-5679/.minikube/profiles/old-k8s-version-862528/proxy-client.crt with IP's: []
I0410 22:38:29.194777 54076 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18610-5679/.minikube/profiles/old-k8s-version-862528/proxy-client.crt ...
I0410 22:38:29.194808 54076 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18610-5679/.minikube/profiles/old-k8s-version-862528/proxy-client.crt: {Name:mka09de188b61993237834cb2041e559b62178a5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0410 22:38:29.194973 54076 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18610-5679/.minikube/profiles/old-k8s-version-862528/proxy-client.key ...
I0410 22:38:29.194986 54076 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18610-5679/.minikube/profiles/old-k8s-version-862528/proxy-client.key: {Name:mk7349224657258501fd06afee89bf2af50d5afe Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0410 22:38:29.195144 54076 certs.go:484] found cert: /home/jenkins/minikube-integration/18610-5679/.minikube/certs/13001.pem (1338 bytes)
W0410 22:38:29.195182 54076 certs.go:480] ignoring /home/jenkins/minikube-integration/18610-5679/.minikube/certs/13001_empty.pem, impossibly tiny 0 bytes
I0410 22:38:29.195193 54076 certs.go:484] found cert: /home/jenkins/minikube-integration/18610-5679/.minikube/certs/ca-key.pem (1679 bytes)
I0410 22:38:29.195216 54076 certs.go:484] found cert: /home/jenkins/minikube-integration/18610-5679/.minikube/certs/ca.pem (1082 bytes)
I0410 22:38:29.195239 54076 certs.go:484] found cert: /home/jenkins/minikube-integration/18610-5679/.minikube/certs/cert.pem (1123 bytes)
I0410 22:38:29.195263 54076 certs.go:484] found cert: /home/jenkins/minikube-integration/18610-5679/.minikube/certs/key.pem (1679 bytes)
I0410 22:38:29.195297 54076 certs.go:484] found cert: /home/jenkins/minikube-integration/18610-5679/.minikube/files/etc/ssl/certs/130012.pem (1708 bytes)
I0410 22:38:29.195883 54076 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18610-5679/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0410 22:38:29.229299 54076 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18610-5679/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0410 22:38:29.261510 54076 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18610-5679/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0410 22:38:29.294222 54076 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18610-5679/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0410 22:38:29.335035 54076 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18610-5679/.minikube/profiles/old-k8s-version-862528/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0410 22:38:29.436746 54076 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18610-5679/.minikube/profiles/old-k8s-version-862528/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0410 22:38:29.467822 54076 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18610-5679/.minikube/profiles/old-k8s-version-862528/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0410 22:38:29.495555 54076 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18610-5679/.minikube/profiles/old-k8s-version-862528/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0410 22:38:29.522240 54076 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18610-5679/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0410 22:38:29.550133 54076 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18610-5679/.minikube/certs/13001.pem --> /usr/share/ca-certificates/13001.pem (1338 bytes)
I0410 22:38:29.578079 54076 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18610-5679/.minikube/files/etc/ssl/certs/130012.pem --> /usr/share/ca-certificates/130012.pem (1708 bytes)
I0410 22:38:29.608278 54076 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (752 bytes)
I0410 22:38:29.631635 54076 ssh_runner.go:195] Run: openssl version
I0410 22:38:29.637864 54076 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0410 22:38:29.651604 54076 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0410 22:38:29.656501 54076 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Apr 10 21:30 /usr/share/ca-certificates/minikubeCA.pem
I0410 22:38:29.656553 54076 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0410 22:38:29.663045 54076 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0410 22:38:29.675885 54076 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/13001.pem && ln -fs /usr/share/ca-certificates/13001.pem /etc/ssl/certs/13001.pem"
I0410 22:38:29.688249 54076 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/13001.pem
I0410 22:38:29.693520 54076 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Apr 10 21:38 /usr/share/ca-certificates/13001.pem
I0410 22:38:29.693597 54076 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/13001.pem
I0410 22:38:29.699801 54076 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/13001.pem /etc/ssl/certs/51391683.0"
I0410 22:38:29.711770 54076 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/130012.pem && ln -fs /usr/share/ca-certificates/130012.pem /etc/ssl/certs/130012.pem"
I0410 22:38:29.723255 54076 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/130012.pem
I0410 22:38:29.728068 54076 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Apr 10 21:38 /usr/share/ca-certificates/130012.pem
I0410 22:38:29.728130 54076 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/130012.pem
I0410 22:38:29.734410 54076 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/130012.pem /etc/ssl/certs/3ec20f2e.0"
I0410 22:38:29.746623 54076 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0410 22:38:29.750868 54076 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0410 22:38:29.750929 54076 kubeadm.go:391] StartCluster: {Name:old-k8s-version-862528 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18610/minikube-v1.33.0-1712743565-18610-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1712743643-18610@sha256:57f6b6f207b748ce717275fbcd6ae3dba156d24f7d9b85b4b7e51b63bacaf9dc Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-862528 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.178 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0410 22:38:29.751023 54076 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0410 22:38:29.751088 54076 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0410 22:38:29.797461 54076 cri.go:89] found id: ""
I0410 22:38:29.797552 54076 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0410 22:38:29.808851 54076 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0410 22:38:29.819381 54076 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0410 22:38:29.830303 54076 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0410 22:38:29.830326 54076 kubeadm.go:156] found existing configuration files:
I0410 22:38:29.830380 54076 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0410 22:38:29.840439 54076 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0410 22:38:29.840491 54076 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0410 22:38:29.851554 54076 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0410 22:38:29.862184 54076 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0410 22:38:29.862274 54076 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0410 22:38:29.873033 54076 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0410 22:38:29.883226 54076 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0410 22:38:29.883298 54076 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0410 22:38:29.893918 54076 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0410 22:38:29.904038 54076 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0410 22:38:29.904108 54076 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0410 22:38:29.914512 54076 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0410 22:38:30.035859 54076 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0410 22:38:30.035922 54076 kubeadm.go:309] [preflight] Running pre-flight checks
I0410 22:38:30.230966 54076 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0410 22:38:30.231145 54076 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0410 22:38:30.231277 54076 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0410 22:38:30.483348 54076 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0410 22:38:30.528024 54076 out.go:204] - Generating certificates and keys ...
I0410 22:38:30.528167 54076 kubeadm.go:309] [certs] Using existing ca certificate authority
I0410 22:38:30.528304 54076 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0410 22:38:30.761404 54076 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key
I0410 22:38:30.887439 54076 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key
I0410 22:38:31.096114 54076 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key
I0410 22:38:31.251123 54076 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key
I0410 22:38:31.365518 54076 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key
I0410 22:38:31.365739 54076 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-862528] and IPs [192.168.61.178 127.0.0.1 ::1]
I0410 22:38:31.517073 54076 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key
I0410 22:38:31.517297 54076 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-862528] and IPs [192.168.61.178 127.0.0.1 ::1]
I0410 22:38:31.730663 54076 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key
I0410 22:38:31.857826 54076 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key
I0410 22:38:32.083631 54076 kubeadm.go:309] [certs] Generating "sa" key and public key
I0410 22:38:32.083817 54076 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0410 22:38:32.252665 54076 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0410 22:38:32.489627 54076 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0410 22:38:32.687486 54076 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0410 22:38:33.031038 54076 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0410 22:38:33.054184 54076 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0410 22:38:33.055167 54076 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0410 22:38:33.055244 54076 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0410 22:38:33.213337 54076 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0410 22:38:33.215612 54076 out.go:204] - Booting up control plane ...
I0410 22:38:33.215795 54076 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0410 22:38:33.217114 54076 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0410 22:38:33.219624 54076 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0410 22:38:33.220709 54076 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0410 22:38:33.226630 54076 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0410 22:39:13.224347 54076 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0410 22:39:13.224911 54076 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0410 22:39:13.225306 54076 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0410 22:39:18.226004 54076 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0410 22:39:18.226216 54076 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0410 22:39:28.226909 54076 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0410 22:39:28.227132 54076 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0410 22:39:48.228185 54076 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0410 22:39:48.228465 54076 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0410 22:40:28.228301 54076 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0410 22:40:28.228603 54076 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0410 22:40:28.228618 54076 kubeadm.go:309]
I0410 22:40:28.228660 54076 kubeadm.go:309] Unfortunately, an error has occurred:
I0410 22:40:28.228711 54076 kubeadm.go:309] timed out waiting for the condition
I0410 22:40:28.228722 54076 kubeadm.go:309]
I0410 22:40:28.228773 54076 kubeadm.go:309] This error is likely caused by:
I0410 22:40:28.228821 54076 kubeadm.go:309] - The kubelet is not running
I0410 22:40:28.228926 54076 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0410 22:40:28.228935 54076 kubeadm.go:309]
I0410 22:40:28.229059 54076 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0410 22:40:28.229114 54076 kubeadm.go:309] - 'systemctl status kubelet'
I0410 22:40:28.229162 54076 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0410 22:40:28.229173 54076 kubeadm.go:309]
I0410 22:40:28.229321 54076 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0410 22:40:28.229451 54076 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0410 22:40:28.229481 54076 kubeadm.go:309]
I0410 22:40:28.229653 54076 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0410 22:40:28.229796 54076 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0410 22:40:28.229897 54076 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0410 22:40:28.229998 54076 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0410 22:40:28.230014 54076 kubeadm.go:309]
I0410 22:40:28.231380 54076 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0410 22:40:28.231501 54076 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0410 22:40:28.231585 54076 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
W0410 22:40:28.231759 54076 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-862528] and IPs [192.168.61.178 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-862528] and IPs [192.168.61.178 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-862528] and IPs [192.168.61.178 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-862528] and IPs [192.168.61.178 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0410 22:40:28.231855 54076 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0410 22:40:28.753745 54076 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0410 22:40:28.769046 54076 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0410 22:40:28.781221 54076 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0410 22:40:28.781249 54076 kubeadm.go:156] found existing configuration files:
I0410 22:40:28.781302 54076 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0410 22:40:28.791378 54076 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0410 22:40:28.791451 54076 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0410 22:40:28.801651 54076 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0410 22:40:28.812353 54076 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0410 22:40:28.812448 54076 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0410 22:40:28.825269 54076 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0410 22:40:28.835266 54076 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0410 22:40:28.835333 54076 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0410 22:40:28.845624 54076 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0410 22:40:28.855484 54076 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0410 22:40:28.855554 54076 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0410 22:40:28.869399 54076 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0410 22:40:28.947168 54076 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0410 22:40:28.947384 54076 kubeadm.go:309] [preflight] Running pre-flight checks
I0410 22:40:29.094279 54076 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0410 22:40:29.094482 54076 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0410 22:40:29.094622 54076 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0410 22:40:29.333525 54076 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0410 22:40:29.335718 54076 out.go:204] - Generating certificates and keys ...
I0410 22:40:29.335822 54076 kubeadm.go:309] [certs] Using existing ca certificate authority
I0410 22:40:29.335953 54076 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0410 22:40:29.336085 54076 kubeadm.go:309] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0410 22:40:29.336183 54076 kubeadm.go:309] [certs] Using existing front-proxy-ca certificate authority
I0410 22:40:29.336311 54076 kubeadm.go:309] [certs] Using existing front-proxy-client certificate and key on disk
I0410 22:40:29.336421 54076 kubeadm.go:309] [certs] Using existing etcd/ca certificate authority
I0410 22:40:29.336534 54076 kubeadm.go:309] [certs] Using existing etcd/server certificate and key on disk
I0410 22:40:29.336651 54076 kubeadm.go:309] [certs] Using existing etcd/peer certificate and key on disk
I0410 22:40:29.336769 54076 kubeadm.go:309] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0410 22:40:29.336890 54076 kubeadm.go:309] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0410 22:40:29.336956 54076 kubeadm.go:309] [certs] Using the existing "sa" key
I0410 22:40:29.337054 54076 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0410 22:40:29.619559 54076 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0410 22:40:29.856892 54076 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0410 22:40:29.938429 54076 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0410 22:40:30.091196 54076 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0410 22:40:30.111488 54076 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0410 22:40:30.114592 54076 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0410 22:40:30.114827 54076 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0410 22:40:30.300659 54076 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0410 22:40:30.302189 54076 out.go:204] - Booting up control plane ...
I0410 22:40:30.302314 54076 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0410 22:40:30.315525 54076 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0410 22:40:30.317073 54076 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0410 22:40:30.318175 54076 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0410 22:40:30.322031 54076 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0410 22:41:10.328981 54076 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0410 22:41:10.329439 54076 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0410 22:41:10.329712 54076 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0410 22:41:15.330617 54076 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0410 22:41:15.330822 54076 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0410 22:41:25.331339 54076 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0410 22:41:25.331598 54076 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0410 22:41:45.332473 54076 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0410 22:41:45.332689 54076 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0410 22:42:25.332783 54076 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0410 22:42:25.333027 54076 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0410 22:42:25.333045 54076 kubeadm.go:309]
I0410 22:42:25.333097 54076 kubeadm.go:309] Unfortunately, an error has occurred:
I0410 22:42:25.333152 54076 kubeadm.go:309] timed out waiting for the condition
I0410 22:42:25.333164 54076 kubeadm.go:309]
I0410 22:42:25.333209 54076 kubeadm.go:309] This error is likely caused by:
I0410 22:42:25.333256 54076 kubeadm.go:309] - The kubelet is not running
I0410 22:42:25.333393 54076 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0410 22:42:25.333406 54076 kubeadm.go:309]
I0410 22:42:25.333539 54076 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0410 22:42:25.333589 54076 kubeadm.go:309] - 'systemctl status kubelet'
I0410 22:42:25.333634 54076 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0410 22:42:25.333645 54076 kubeadm.go:309]
I0410 22:42:25.333770 54076 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0410 22:42:25.333877 54076 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0410 22:42:25.333916 54076 kubeadm.go:309]
I0410 22:42:25.334061 54076 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0410 22:42:25.334167 54076 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0410 22:42:25.334267 54076 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0410 22:42:25.334363 54076 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0410 22:42:25.334376 54076 kubeadm.go:309]
I0410 22:42:25.336845 54076 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0410 22:42:25.336962 54076 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0410 22:42:25.337051 54076 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
I0410 22:42:25.337121 54076 kubeadm.go:393] duration metric: took 3m55.586206572s to StartCluster
I0410 22:42:25.337169 54076 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0410 22:42:25.337227 54076 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0410 22:42:25.395128 54076 cri.go:89] found id: ""
I0410 22:42:25.395158 54076 logs.go:276] 0 containers: []
W0410 22:42:25.395169 54076 logs.go:278] No container was found matching "kube-apiserver"
I0410 22:42:25.395176 54076 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0410 22:42:25.395233 54076 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0410 22:42:25.442326 54076 cri.go:89] found id: ""
I0410 22:42:25.442358 54076 logs.go:276] 0 containers: []
W0410 22:42:25.442367 54076 logs.go:278] No container was found matching "etcd"
I0410 22:42:25.442374 54076 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0410 22:42:25.442439 54076 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0410 22:42:25.494886 54076 cri.go:89] found id: ""
I0410 22:42:25.494916 54076 logs.go:276] 0 containers: []
W0410 22:42:25.494924 54076 logs.go:278] No container was found matching "coredns"
I0410 22:42:25.494930 54076 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0410 22:42:25.494971 54076 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0410 22:42:25.546191 54076 cri.go:89] found id: ""
I0410 22:42:25.546217 54076 logs.go:276] 0 containers: []
W0410 22:42:25.546226 54076 logs.go:278] No container was found matching "kube-scheduler"
I0410 22:42:25.546233 54076 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0410 22:42:25.546299 54076 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0410 22:42:25.597586 54076 cri.go:89] found id: ""
I0410 22:42:25.597612 54076 logs.go:276] 0 containers: []
W0410 22:42:25.597622 54076 logs.go:278] No container was found matching "kube-proxy"
I0410 22:42:25.597629 54076 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0410 22:42:25.597691 54076 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0410 22:42:25.638970 54076 cri.go:89] found id: ""
I0410 22:42:25.638999 54076 logs.go:276] 0 containers: []
W0410 22:42:25.639010 54076 logs.go:278] No container was found matching "kube-controller-manager"
I0410 22:42:25.639019 54076 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0410 22:42:25.639083 54076 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0410 22:42:25.681477 54076 cri.go:89] found id: ""
I0410 22:42:25.681508 54076 logs.go:276] 0 containers: []
W0410 22:42:25.681518 54076 logs.go:278] No container was found matching "kindnet"
I0410 22:42:25.681530 54076 logs.go:123] Gathering logs for kubelet ...
I0410 22:42:25.681546 54076 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0410 22:42:25.746030 54076 logs.go:123] Gathering logs for dmesg ...
I0410 22:42:25.746065 54076 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0410 22:42:25.766216 54076 logs.go:123] Gathering logs for describe nodes ...
I0410 22:42:25.766245 54076 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0410 22:42:25.896111 54076 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0410 22:42:25.896131 54076 logs.go:123] Gathering logs for CRI-O ...
I0410 22:42:25.896146 54076 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0410 22:42:26.010193 54076 logs.go:123] Gathering logs for container status ...
I0410 22:42:26.010227 54076 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0410 22:42:26.056242 54076 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0410 22:42:26.056297 54076 out.go:239] *
*
W0410 22:42:26.056358 54076 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0410 22:42:26.056388 54076 out.go:239] *
*
W0410 22:42:26.057381 54076 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0410 22:42:26.060736 54076 out.go:177]
W0410 22:42:26.062296 54076 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0410 22:42:26.062352 54076 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0410 22:42:26.062380 54076 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0410 22:42:26.064057 54076 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-862528 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-862528 -n old-k8s-version-862528
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-862528 -n old-k8s-version-862528: exit status 6 (242.843164ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0410 22:42:26.339347 56613 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-862528" does not appear in /home/jenkins/minikube-integration/18610-5679/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-862528" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (271.29s)