=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-576210 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-576210 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m48.383892962s)
-- stdout --
* [old-k8s-version-576210] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=19364
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19364-9607/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19364-9607/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-576210" primary control-plane node in "old-k8s-version-576210" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0804 00:03:44.521707 60214 out.go:291] Setting OutFile to fd 1 ...
I0804 00:03:44.521866 60214 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0804 00:03:44.521896 60214 out.go:304] Setting ErrFile to fd 2...
I0804 00:03:44.521907 60214 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0804 00:03:44.522102 60214 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19364-9607/.minikube/bin
I0804 00:03:44.522688 60214 out.go:298] Setting JSON to false
I0804 00:03:44.523727 60214 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-10","uptime":6368,"bootTime":1722723456,"procs":213,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1065-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0804 00:03:44.523813 60214 start.go:139] virtualization: kvm guest
I0804 00:03:44.526263 60214 out.go:177] * [old-k8s-version-576210] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
I0804 00:03:44.527674 60214 out.go:177] - MINIKUBE_LOCATION=19364
I0804 00:03:44.527734 60214 notify.go:220] Checking for updates...
I0804 00:03:44.530573 60214 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0804 00:03:44.532093 60214 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19364-9607/kubeconfig
I0804 00:03:44.533568 60214 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19364-9607/.minikube
I0804 00:03:44.535197 60214 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0804 00:03:44.536703 60214 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0804 00:03:44.538802 60214 config.go:182] Loaded profile config "NoKubernetes-551054": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3
I0804 00:03:44.538929 60214 config.go:182] Loaded profile config "cert-expiration-705918": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3
I0804 00:03:44.539055 60214 config.go:182] Loaded profile config "kubernetes-upgrade-302198": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.0-rc.0
I0804 00:03:44.539190 60214 driver.go:392] Setting default libvirt URI to qemu:///system
I0804 00:03:44.579300 60214 out.go:177] * Using the kvm2 driver based on user configuration
I0804 00:03:44.580704 60214 start.go:297] selected driver: kvm2
I0804 00:03:44.580724 60214 start.go:901] validating driver "kvm2" against <nil>
I0804 00:03:44.580739 60214 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0804 00:03:44.581623 60214 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0804 00:03:44.581704 60214 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19364-9607/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0804 00:03:44.597469 60214 install.go:137] /home/jenkins/minikube-integration/19364-9607/.minikube/bin/docker-machine-driver-kvm2 version is 1.33.1
I0804 00:03:44.597532 60214 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0804 00:03:44.597803 60214 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0804 00:03:44.597841 60214 cni.go:84] Creating CNI manager for ""
I0804 00:03:44.597857 60214 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0804 00:03:44.597867 60214 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0804 00:03:44.597957 60214 start.go:340] cluster config:
{Name:old-k8s-version-576210 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-576210 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0804 00:03:44.598084 60214 iso.go:125] acquiring lock: {Name:mk4571d359bb27afcefe7b409c27766a0c6a8f14 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0804 00:03:44.599972 60214 out.go:177] * Starting "old-k8s-version-576210" primary control-plane node in "old-k8s-version-576210" cluster
I0804 00:03:44.601607 60214 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0804 00:03:44.601668 60214 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19364-9607/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0804 00:03:44.601681 60214 cache.go:56] Caching tarball of preloaded images
I0804 00:03:44.601774 60214 preload.go:172] Found /home/jenkins/minikube-integration/19364-9607/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0804 00:03:44.601787 60214 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0804 00:03:44.601910 60214 profile.go:143] Saving config to /home/jenkins/minikube-integration/19364-9607/.minikube/profiles/old-k8s-version-576210/config.json ...
I0804 00:03:44.601935 60214 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19364-9607/.minikube/profiles/old-k8s-version-576210/config.json: {Name:mkd2a527d8ed1bf5fb5e6186b932d6f9d027038b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0804 00:03:44.602093 60214 start.go:360] acquireMachinesLock for old-k8s-version-576210: {Name:mkd8753f972f5e4e51f77502e5c8c1796bb2d0ed Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0804 00:04:03.526434 60214 start.go:364] duration metric: took 18.924309812s to acquireMachinesLock for "old-k8s-version-576210"
I0804 00:04:03.526514 60214 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-576210 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19339/minikube-v1.33.1-1722248113-19339-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-576210 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0804 00:04:03.526634 60214 start.go:125] createHost starting for "" (driver="kvm2")
I0804 00:04:03.529676 60214 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0804 00:04:03.529878 60214 main.go:141] libmachine: Found binary path at /home/jenkins/minikube-integration/19364-9607/.minikube/bin/docker-machine-driver-kvm2
I0804 00:04:03.529933 60214 main.go:141] libmachine: Launching plugin server for driver kvm2
I0804 00:04:03.547206 60214 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40427
I0804 00:04:03.547648 60214 main.go:141] libmachine: () Calling .GetVersion
I0804 00:04:03.548311 60214 main.go:141] libmachine: Using API Version 1
I0804 00:04:03.548337 60214 main.go:141] libmachine: () Calling .SetConfigRaw
I0804 00:04:03.548748 60214 main.go:141] libmachine: () Calling .GetMachineName
I0804 00:04:03.548953 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetMachineName
I0804 00:04:03.549144 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .DriverName
I0804 00:04:03.549318 60214 start.go:159] libmachine.API.Create for "old-k8s-version-576210" (driver="kvm2")
I0804 00:04:03.549370 60214 client.go:168] LocalClient.Create starting
I0804 00:04:03.549411 60214 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19364-9607/.minikube/certs/ca.pem
I0804 00:04:03.549451 60214 main.go:141] libmachine: Decoding PEM data...
I0804 00:04:03.549484 60214 main.go:141] libmachine: Parsing certificate...
I0804 00:04:03.549573 60214 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19364-9607/.minikube/certs/cert.pem
I0804 00:04:03.549599 60214 main.go:141] libmachine: Decoding PEM data...
I0804 00:04:03.549608 60214 main.go:141] libmachine: Parsing certificate...
I0804 00:04:03.549623 60214 main.go:141] libmachine: Running pre-create checks...
I0804 00:04:03.549630 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .PreCreateCheck
I0804 00:04:03.549982 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetConfigRaw
I0804 00:04:03.550451 60214 main.go:141] libmachine: Creating machine...
I0804 00:04:03.550464 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .Create
I0804 00:04:03.550581 60214 main.go:141] libmachine: (old-k8s-version-576210) Creating KVM machine...
I0804 00:04:03.552014 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | found existing default KVM network
I0804 00:04:03.553608 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | I0804 00:04:03.553415 60413 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:e6:54:16} reservation:<nil>}
I0804 00:04:03.554641 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | I0804 00:04:03.554546 60413 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:72:6c:d1} reservation:<nil>}
I0804 00:04:03.555597 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | I0804 00:04:03.555506 60413 network.go:211] skipping subnet 192.168.61.0/24 that is taken: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName:virbr3 IfaceIPv4:192.168.61.1 IfaceMTU:1500 IfaceMAC:52:54:00:76:b7:1a} reservation:<nil>}
I0804 00:04:03.556975 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | I0804 00:04:03.556881 60413 network.go:206] using free private subnet 192.168.72.0/24: &{IP:192.168.72.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.72.0/24 Gateway:192.168.72.1 ClientMin:192.168.72.2 ClientMax:192.168.72.254 Broadcast:192.168.72.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000289920}
I0804 00:04:03.557024 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | created network xml:
I0804 00:04:03.557046 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | <network>
I0804 00:04:03.557057 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | <name>mk-old-k8s-version-576210</name>
I0804 00:04:03.557068 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | <dns enable='no'/>
I0804 00:04:03.557076 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG |
I0804 00:04:03.557088 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | <ip address='192.168.72.1' netmask='255.255.255.0'>
I0804 00:04:03.557129 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | <dhcp>
I0804 00:04:03.557145 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | <range start='192.168.72.2' end='192.168.72.253'/>
I0804 00:04:03.557158 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | </dhcp>
I0804 00:04:03.557170 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | </ip>
I0804 00:04:03.557181 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG |
I0804 00:04:03.557188 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | </network>
I0804 00:04:03.557206 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG |
I0804 00:04:03.563141 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | trying to create private KVM network mk-old-k8s-version-576210 192.168.72.0/24...
I0804 00:04:03.639421 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | private KVM network mk-old-k8s-version-576210 192.168.72.0/24 created
I0804 00:04:03.639456 60214 main.go:141] libmachine: (old-k8s-version-576210) Setting up store path in /home/jenkins/minikube-integration/19364-9607/.minikube/machines/old-k8s-version-576210 ...
I0804 00:04:03.639481 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | I0804 00:04:03.639357 60413 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19364-9607/.minikube
I0804 00:04:03.639515 60214 main.go:141] libmachine: (old-k8s-version-576210) Building disk image from file:///home/jenkins/minikube-integration/19364-9607/.minikube/cache/iso/amd64/minikube-v1.33.1-1722248113-19339-amd64.iso
I0804 00:04:03.639557 60214 main.go:141] libmachine: (old-k8s-version-576210) Downloading /home/jenkins/minikube-integration/19364-9607/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19364-9607/.minikube/cache/iso/amd64/minikube-v1.33.1-1722248113-19339-amd64.iso...
I0804 00:04:03.894549 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | I0804 00:04:03.894422 60413 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19364-9607/.minikube/machines/old-k8s-version-576210/id_rsa...
I0804 00:04:04.196974 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | I0804 00:04:04.196823 60413 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19364-9607/.minikube/machines/old-k8s-version-576210/old-k8s-version-576210.rawdisk...
I0804 00:04:04.197004 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | Writing magic tar header
I0804 00:04:04.197021 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | Writing SSH key tar header
I0804 00:04:04.197098 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | I0804 00:04:04.197019 60413 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19364-9607/.minikube/machines/old-k8s-version-576210 ...
I0804 00:04:04.197193 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19364-9607/.minikube/machines/old-k8s-version-576210
I0804 00:04:04.197211 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19364-9607/.minikube/machines
I0804 00:04:04.197229 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19364-9607/.minikube
I0804 00:04:04.197242 60214 main.go:141] libmachine: (old-k8s-version-576210) Setting executable bit set on /home/jenkins/minikube-integration/19364-9607/.minikube/machines/old-k8s-version-576210 (perms=drwx------)
I0804 00:04:04.197259 60214 main.go:141] libmachine: (old-k8s-version-576210) Setting executable bit set on /home/jenkins/minikube-integration/19364-9607/.minikube/machines (perms=drwxr-xr-x)
I0804 00:04:04.197278 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19364-9607
I0804 00:04:04.197297 60214 main.go:141] libmachine: (old-k8s-version-576210) Setting executable bit set on /home/jenkins/minikube-integration/19364-9607/.minikube (perms=drwxr-xr-x)
I0804 00:04:04.197310 60214 main.go:141] libmachine: (old-k8s-version-576210) Setting executable bit set on /home/jenkins/minikube-integration/19364-9607 (perms=drwxrwxr-x)
I0804 00:04:04.197319 60214 main.go:141] libmachine: (old-k8s-version-576210) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0804 00:04:04.197334 60214 main.go:141] libmachine: (old-k8s-version-576210) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0804 00:04:04.197342 60214 main.go:141] libmachine: (old-k8s-version-576210) Creating domain...
I0804 00:04:04.197421 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0804 00:04:04.197453 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | Checking permissions on dir: /home/jenkins
I0804 00:04:04.197467 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | Checking permissions on dir: /home
I0804 00:04:04.197479 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | Skipping /home - not owner
I0804 00:04:04.198892 60214 main.go:141] libmachine: (old-k8s-version-576210) define libvirt domain using xml:
I0804 00:04:04.198915 60214 main.go:141] libmachine: (old-k8s-version-576210) <domain type='kvm'>
I0804 00:04:04.198925 60214 main.go:141] libmachine: (old-k8s-version-576210) <name>old-k8s-version-576210</name>
I0804 00:04:04.198933 60214 main.go:141] libmachine: (old-k8s-version-576210) <memory unit='MiB'>2200</memory>
I0804 00:04:04.198942 60214 main.go:141] libmachine: (old-k8s-version-576210) <vcpu>2</vcpu>
I0804 00:04:04.198953 60214 main.go:141] libmachine: (old-k8s-version-576210) <features>
I0804 00:04:04.198965 60214 main.go:141] libmachine: (old-k8s-version-576210) <acpi/>
I0804 00:04:04.198976 60214 main.go:141] libmachine: (old-k8s-version-576210) <apic/>
I0804 00:04:04.198998 60214 main.go:141] libmachine: (old-k8s-version-576210) <pae/>
I0804 00:04:04.199008 60214 main.go:141] libmachine: (old-k8s-version-576210)
I0804 00:04:04.199017 60214 main.go:141] libmachine: (old-k8s-version-576210) </features>
I0804 00:04:04.199028 60214 main.go:141] libmachine: (old-k8s-version-576210) <cpu mode='host-passthrough'>
I0804 00:04:04.199046 60214 main.go:141] libmachine: (old-k8s-version-576210)
I0804 00:04:04.199057 60214 main.go:141] libmachine: (old-k8s-version-576210) </cpu>
I0804 00:04:04.199068 60214 main.go:141] libmachine: (old-k8s-version-576210) <os>
I0804 00:04:04.199079 60214 main.go:141] libmachine: (old-k8s-version-576210) <type>hvm</type>
I0804 00:04:04.199089 60214 main.go:141] libmachine: (old-k8s-version-576210) <boot dev='cdrom'/>
I0804 00:04:04.199097 60214 main.go:141] libmachine: (old-k8s-version-576210) <boot dev='hd'/>
I0804 00:04:04.199105 60214 main.go:141] libmachine: (old-k8s-version-576210) <bootmenu enable='no'/>
I0804 00:04:04.199112 60214 main.go:141] libmachine: (old-k8s-version-576210) </os>
I0804 00:04:04.199126 60214 main.go:141] libmachine: (old-k8s-version-576210) <devices>
I0804 00:04:04.199143 60214 main.go:141] libmachine: (old-k8s-version-576210) <disk type='file' device='cdrom'>
I0804 00:04:04.199160 60214 main.go:141] libmachine: (old-k8s-version-576210) <source file='/home/jenkins/minikube-integration/19364-9607/.minikube/machines/old-k8s-version-576210/boot2docker.iso'/>
I0804 00:04:04.199171 60214 main.go:141] libmachine: (old-k8s-version-576210) <target dev='hdc' bus='scsi'/>
I0804 00:04:04.199180 60214 main.go:141] libmachine: (old-k8s-version-576210) <readonly/>
I0804 00:04:04.199190 60214 main.go:141] libmachine: (old-k8s-version-576210) </disk>
I0804 00:04:04.199200 60214 main.go:141] libmachine: (old-k8s-version-576210) <disk type='file' device='disk'>
I0804 00:04:04.199212 60214 main.go:141] libmachine: (old-k8s-version-576210) <driver name='qemu' type='raw' cache='default' io='threads' />
I0804 00:04:04.199229 60214 main.go:141] libmachine: (old-k8s-version-576210) <source file='/home/jenkins/minikube-integration/19364-9607/.minikube/machines/old-k8s-version-576210/old-k8s-version-576210.rawdisk'/>
I0804 00:04:04.199241 60214 main.go:141] libmachine: (old-k8s-version-576210) <target dev='hda' bus='virtio'/>
I0804 00:04:04.199252 60214 main.go:141] libmachine: (old-k8s-version-576210) </disk>
I0804 00:04:04.199263 60214 main.go:141] libmachine: (old-k8s-version-576210) <interface type='network'>
I0804 00:04:04.199273 60214 main.go:141] libmachine: (old-k8s-version-576210) <source network='mk-old-k8s-version-576210'/>
I0804 00:04:04.199284 60214 main.go:141] libmachine: (old-k8s-version-576210) <model type='virtio'/>
I0804 00:04:04.199295 60214 main.go:141] libmachine: (old-k8s-version-576210) </interface>
I0804 00:04:04.199307 60214 main.go:141] libmachine: (old-k8s-version-576210) <interface type='network'>
I0804 00:04:04.199319 60214 main.go:141] libmachine: (old-k8s-version-576210) <source network='default'/>
I0804 00:04:04.199329 60214 main.go:141] libmachine: (old-k8s-version-576210) <model type='virtio'/>
I0804 00:04:04.199351 60214 main.go:141] libmachine: (old-k8s-version-576210) </interface>
I0804 00:04:04.199362 60214 main.go:141] libmachine: (old-k8s-version-576210) <serial type='pty'>
I0804 00:04:04.199370 60214 main.go:141] libmachine: (old-k8s-version-576210) <target port='0'/>
I0804 00:04:04.199380 60214 main.go:141] libmachine: (old-k8s-version-576210) </serial>
I0804 00:04:04.199388 60214 main.go:141] libmachine: (old-k8s-version-576210) <console type='pty'>
I0804 00:04:04.199400 60214 main.go:141] libmachine: (old-k8s-version-576210) <target type='serial' port='0'/>
I0804 00:04:04.199411 60214 main.go:141] libmachine: (old-k8s-version-576210) </console>
I0804 00:04:04.199421 60214 main.go:141] libmachine: (old-k8s-version-576210) <rng model='virtio'>
I0804 00:04:04.199470 60214 main.go:141] libmachine: (old-k8s-version-576210) <backend model='random'>/dev/random</backend>
I0804 00:04:04.199514 60214 main.go:141] libmachine: (old-k8s-version-576210) </rng>
I0804 00:04:04.199529 60214 main.go:141] libmachine: (old-k8s-version-576210)
I0804 00:04:04.199541 60214 main.go:141] libmachine: (old-k8s-version-576210)
I0804 00:04:04.199561 60214 main.go:141] libmachine: (old-k8s-version-576210) </devices>
I0804 00:04:04.199573 60214 main.go:141] libmachine: (old-k8s-version-576210) </domain>
I0804 00:04:04.199603 60214 main.go:141] libmachine: (old-k8s-version-576210)
I0804 00:04:04.204569 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has defined MAC address 52:54:00:97:ce:41 in network default
I0804 00:04:04.205184 60214 main.go:141] libmachine: (old-k8s-version-576210) Ensuring networks are active...
I0804 00:04:04.205211 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has defined MAC address 52:54:00:cc:b7:b1 in network mk-old-k8s-version-576210
I0804 00:04:04.205994 60214 main.go:141] libmachine: (old-k8s-version-576210) Ensuring network default is active
I0804 00:04:04.206517 60214 main.go:141] libmachine: (old-k8s-version-576210) Ensuring network mk-old-k8s-version-576210 is active
I0804 00:04:04.207045 60214 main.go:141] libmachine: (old-k8s-version-576210) Getting domain xml...
I0804 00:04:04.207876 60214 main.go:141] libmachine: (old-k8s-version-576210) Creating domain...
I0804 00:04:05.454388 60214 main.go:141] libmachine: (old-k8s-version-576210) Waiting to get IP...
I0804 00:04:05.455306 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has defined MAC address 52:54:00:cc:b7:b1 in network mk-old-k8s-version-576210
I0804 00:04:05.455796 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | unable to find current IP address of domain old-k8s-version-576210 in network mk-old-k8s-version-576210
I0804 00:04:05.455825 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | I0804 00:04:05.455772 60413 retry.go:31] will retry after 278.263794ms: waiting for machine to come up
I0804 00:04:05.736229 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has defined MAC address 52:54:00:cc:b7:b1 in network mk-old-k8s-version-576210
I0804 00:04:05.736774 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | unable to find current IP address of domain old-k8s-version-576210 in network mk-old-k8s-version-576210
I0804 00:04:05.736818 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | I0804 00:04:05.736721 60413 retry.go:31] will retry after 336.297357ms: waiting for machine to come up
I0804 00:04:06.074235 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has defined MAC address 52:54:00:cc:b7:b1 in network mk-old-k8s-version-576210
I0804 00:04:06.074776 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | unable to find current IP address of domain old-k8s-version-576210 in network mk-old-k8s-version-576210
I0804 00:04:06.074806 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | I0804 00:04:06.074753 60413 retry.go:31] will retry after 381.688779ms: waiting for machine to come up
I0804 00:04:06.458602 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has defined MAC address 52:54:00:cc:b7:b1 in network mk-old-k8s-version-576210
I0804 00:04:06.459264 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | unable to find current IP address of domain old-k8s-version-576210 in network mk-old-k8s-version-576210
I0804 00:04:06.459286 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | I0804 00:04:06.459210 60413 retry.go:31] will retry after 403.663955ms: waiting for machine to come up
I0804 00:04:06.864841 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has defined MAC address 52:54:00:cc:b7:b1 in network mk-old-k8s-version-576210
I0804 00:04:06.865318 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | unable to find current IP address of domain old-k8s-version-576210 in network mk-old-k8s-version-576210
I0804 00:04:06.865346 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | I0804 00:04:06.865277 60413 retry.go:31] will retry after 511.267894ms: waiting for machine to come up
I0804 00:04:07.378466 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has defined MAC address 52:54:00:cc:b7:b1 in network mk-old-k8s-version-576210
I0804 00:04:07.378812 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | unable to find current IP address of domain old-k8s-version-576210 in network mk-old-k8s-version-576210
I0804 00:04:07.378839 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | I0804 00:04:07.378790 60413 retry.go:31] will retry after 584.99314ms: waiting for machine to come up
I0804 00:04:07.965535 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has defined MAC address 52:54:00:cc:b7:b1 in network mk-old-k8s-version-576210
I0804 00:04:07.965958 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | unable to find current IP address of domain old-k8s-version-576210 in network mk-old-k8s-version-576210
I0804 00:04:07.965987 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | I0804 00:04:07.965911 60413 retry.go:31] will retry after 798.403734ms: waiting for machine to come up
I0804 00:04:08.766178 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has defined MAC address 52:54:00:cc:b7:b1 in network mk-old-k8s-version-576210
I0804 00:04:08.766701 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | unable to find current IP address of domain old-k8s-version-576210 in network mk-old-k8s-version-576210
I0804 00:04:08.766734 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | I0804 00:04:08.766626 60413 retry.go:31] will retry after 956.831111ms: waiting for machine to come up
I0804 00:04:09.724879 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has defined MAC address 52:54:00:cc:b7:b1 in network mk-old-k8s-version-576210
I0804 00:04:09.725519 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | unable to find current IP address of domain old-k8s-version-576210 in network mk-old-k8s-version-576210
I0804 00:04:09.725542 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | I0804 00:04:09.725466 60413 retry.go:31] will retry after 1.2769079s: waiting for machine to come up
I0804 00:04:11.003824 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has defined MAC address 52:54:00:cc:b7:b1 in network mk-old-k8s-version-576210
I0804 00:04:11.004298 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | unable to find current IP address of domain old-k8s-version-576210 in network mk-old-k8s-version-576210
I0804 00:04:11.004321 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | I0804 00:04:11.004242 60413 retry.go:31] will retry after 2.039459663s: waiting for machine to come up
I0804 00:04:13.046261 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has defined MAC address 52:54:00:cc:b7:b1 in network mk-old-k8s-version-576210
I0804 00:04:13.046725 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | unable to find current IP address of domain old-k8s-version-576210 in network mk-old-k8s-version-576210
I0804 00:04:13.046746 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | I0804 00:04:13.046681 60413 retry.go:31] will retry after 2.573093518s: waiting for machine to come up
I0804 00:04:15.622546 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has defined MAC address 52:54:00:cc:b7:b1 in network mk-old-k8s-version-576210
I0804 00:04:15.623058 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | unable to find current IP address of domain old-k8s-version-576210 in network mk-old-k8s-version-576210
I0804 00:04:15.623084 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | I0804 00:04:15.623011 60413 retry.go:31] will retry after 3.220837529s: waiting for machine to come up
I0804 00:04:18.845240 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has defined MAC address 52:54:00:cc:b7:b1 in network mk-old-k8s-version-576210
I0804 00:04:18.845775 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | unable to find current IP address of domain old-k8s-version-576210 in network mk-old-k8s-version-576210
I0804 00:04:18.845800 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | I0804 00:04:18.845731 60413 retry.go:31] will retry after 3.583638755s: waiting for machine to come up
I0804 00:04:22.430413 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has defined MAC address 52:54:00:cc:b7:b1 in network mk-old-k8s-version-576210
I0804 00:04:22.430842 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | unable to find current IP address of domain old-k8s-version-576210 in network mk-old-k8s-version-576210
I0804 00:04:22.430863 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | I0804 00:04:22.430793 60413 retry.go:31] will retry after 3.774524876s: waiting for machine to come up
I0804 00:04:26.208866 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has defined MAC address 52:54:00:cc:b7:b1 in network mk-old-k8s-version-576210
I0804 00:04:26.209331 60214 main.go:141] libmachine: (old-k8s-version-576210) Found IP for machine: 192.168.72.154
I0804 00:04:26.209368 60214 main.go:141] libmachine: (old-k8s-version-576210) Reserving static IP address...
I0804 00:04:26.209385 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has current primary IP address 192.168.72.154 and MAC address 52:54:00:cc:b7:b1 in network mk-old-k8s-version-576210
I0804 00:04:26.209755 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-576210", mac: "52:54:00:cc:b7:b1", ip: "192.168.72.154"} in network mk-old-k8s-version-576210
I0804 00:04:26.287442 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | Getting to WaitForSSH function...
I0804 00:04:26.287480 60214 main.go:141] libmachine: (old-k8s-version-576210) Reserved static IP address: 192.168.72.154
I0804 00:04:26.287527 60214 main.go:141] libmachine: (old-k8s-version-576210) Waiting for SSH to be available...
I0804 00:04:26.290113 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has defined MAC address 52:54:00:cc:b7:b1 in network mk-old-k8s-version-576210
I0804 00:04:26.290583 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:cc:b7:b1", ip: ""} in network mk-old-k8s-version-576210: {Iface:virbr4 ExpiryTime:2024-08-04 01:04:18 +0000 UTC Type:0 Mac:52:54:00:cc:b7:b1 Iaid: IPaddr:192.168.72.154 Prefix:24 Hostname:minikube Clientid:01:52:54:00:cc:b7:b1}
I0804 00:04:26.290614 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has defined IP address 192.168.72.154 and MAC address 52:54:00:cc:b7:b1 in network mk-old-k8s-version-576210
I0804 00:04:26.290781 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | Using SSH client type: external
I0804 00:04:26.290810 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | Using SSH private key: /home/jenkins/minikube-integration/19364-9607/.minikube/machines/old-k8s-version-576210/id_rsa (-rw-------)
I0804 00:04:26.290855 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.72.154 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19364-9607/.minikube/machines/old-k8s-version-576210/id_rsa -p 22] /usr/bin/ssh <nil>}
I0804 00:04:26.290872 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | About to run SSH command:
I0804 00:04:26.290885 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | exit 0
I0804 00:04:26.417295 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | SSH cmd err, output: <nil>:
I0804 00:04:26.417605 60214 main.go:141] libmachine: (old-k8s-version-576210) KVM machine creation complete!
I0804 00:04:26.417934 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetConfigRaw
I0804 00:04:26.418522 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .DriverName
I0804 00:04:26.418736 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .DriverName
I0804 00:04:26.418911 60214 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0804 00:04:26.418928 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetState
I0804 00:04:26.420304 60214 main.go:141] libmachine: Detecting operating system of created instance...
I0804 00:04:26.420321 60214 main.go:141] libmachine: Waiting for SSH to be available...
I0804 00:04:26.420326 60214 main.go:141] libmachine: Getting to WaitForSSH function...
I0804 00:04:26.420332 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetSSHHostname
I0804 00:04:26.422601 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has defined MAC address 52:54:00:cc:b7:b1 in network mk-old-k8s-version-576210
I0804 00:04:26.422966 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:cc:b7:b1", ip: ""} in network mk-old-k8s-version-576210: {Iface:virbr4 ExpiryTime:2024-08-04 01:04:18 +0000 UTC Type:0 Mac:52:54:00:cc:b7:b1 Iaid: IPaddr:192.168.72.154 Prefix:24 Hostname:old-k8s-version-576210 Clientid:01:52:54:00:cc:b7:b1}
I0804 00:04:26.422994 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has defined IP address 192.168.72.154 and MAC address 52:54:00:cc:b7:b1 in network mk-old-k8s-version-576210
I0804 00:04:26.423150 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetSSHPort
I0804 00:04:26.423297 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetSSHKeyPath
I0804 00:04:26.423441 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetSSHKeyPath
I0804 00:04:26.423569 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetSSHUsername
I0804 00:04:26.423740 60214 main.go:141] libmachine: Using SSH client type: native
I0804 00:04:26.423974 60214 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.72.154 22 <nil> <nil>}
I0804 00:04:26.423991 60214 main.go:141] libmachine: About to run SSH command:
exit 0
I0804 00:04:26.532782 60214 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0804 00:04:26.532811 60214 main.go:141] libmachine: Detecting the provisioner...
I0804 00:04:26.532822 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetSSHHostname
I0804 00:04:26.535654 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has defined MAC address 52:54:00:cc:b7:b1 in network mk-old-k8s-version-576210
I0804 00:04:26.535990 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:cc:b7:b1", ip: ""} in network mk-old-k8s-version-576210: {Iface:virbr4 ExpiryTime:2024-08-04 01:04:18 +0000 UTC Type:0 Mac:52:54:00:cc:b7:b1 Iaid: IPaddr:192.168.72.154 Prefix:24 Hostname:old-k8s-version-576210 Clientid:01:52:54:00:cc:b7:b1}
I0804 00:04:26.536014 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has defined IP address 192.168.72.154 and MAC address 52:54:00:cc:b7:b1 in network mk-old-k8s-version-576210
I0804 00:04:26.536132 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetSSHPort
I0804 00:04:26.536331 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetSSHKeyPath
I0804 00:04:26.536479 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetSSHKeyPath
I0804 00:04:26.536619 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetSSHUsername
I0804 00:04:26.536807 60214 main.go:141] libmachine: Using SSH client type: native
I0804 00:04:26.536968 60214 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.72.154 22 <nil> <nil>}
I0804 00:04:26.536979 60214 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0804 00:04:26.646120 60214 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0804 00:04:26.646214 60214 main.go:141] libmachine: found compatible host: buildroot
I0804 00:04:26.646229 60214 main.go:141] libmachine: Provisioning with buildroot...
I0804 00:04:26.646240 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetMachineName
I0804 00:04:26.646475 60214 buildroot.go:166] provisioning hostname "old-k8s-version-576210"
I0804 00:04:26.646500 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetMachineName
I0804 00:04:26.646676 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetSSHHostname
I0804 00:04:26.649093 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has defined MAC address 52:54:00:cc:b7:b1 in network mk-old-k8s-version-576210
I0804 00:04:26.649430 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:cc:b7:b1", ip: ""} in network mk-old-k8s-version-576210: {Iface:virbr4 ExpiryTime:2024-08-04 01:04:18 +0000 UTC Type:0 Mac:52:54:00:cc:b7:b1 Iaid: IPaddr:192.168.72.154 Prefix:24 Hostname:old-k8s-version-576210 Clientid:01:52:54:00:cc:b7:b1}
I0804 00:04:26.649468 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has defined IP address 192.168.72.154 and MAC address 52:54:00:cc:b7:b1 in network mk-old-k8s-version-576210
I0804 00:04:26.649606 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetSSHPort
I0804 00:04:26.649919 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetSSHKeyPath
I0804 00:04:26.650180 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetSSHKeyPath
I0804 00:04:26.650347 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetSSHUsername
I0804 00:04:26.650542 60214 main.go:141] libmachine: Using SSH client type: native
I0804 00:04:26.650719 60214 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.72.154 22 <nil> <nil>}
I0804 00:04:26.650734 60214 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-576210 && echo "old-k8s-version-576210" | sudo tee /etc/hostname
I0804 00:04:26.776658 60214 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-576210
I0804 00:04:26.776684 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetSSHHostname
I0804 00:04:26.779164 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has defined MAC address 52:54:00:cc:b7:b1 in network mk-old-k8s-version-576210
I0804 00:04:26.779478 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:cc:b7:b1", ip: ""} in network mk-old-k8s-version-576210: {Iface:virbr4 ExpiryTime:2024-08-04 01:04:18 +0000 UTC Type:0 Mac:52:54:00:cc:b7:b1 Iaid: IPaddr:192.168.72.154 Prefix:24 Hostname:old-k8s-version-576210 Clientid:01:52:54:00:cc:b7:b1}
I0804 00:04:26.779507 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has defined IP address 192.168.72.154 and MAC address 52:54:00:cc:b7:b1 in network mk-old-k8s-version-576210
I0804 00:04:26.779661 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetSSHPort
I0804 00:04:26.779859 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetSSHKeyPath
I0804 00:04:26.780025 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetSSHKeyPath
I0804 00:04:26.780185 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetSSHUsername
I0804 00:04:26.780345 60214 main.go:141] libmachine: Using SSH client type: native
I0804 00:04:26.780511 60214 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.72.154 22 <nil> <nil>}
I0804 00:04:26.780527 60214 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-576210' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-576210/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-576210' | sudo tee -a /etc/hosts;
fi
fi
I0804 00:04:26.898556 60214 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0804 00:04:26.898586 60214 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19364-9607/.minikube CaCertPath:/home/jenkins/minikube-integration/19364-9607/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19364-9607/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19364-9607/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19364-9607/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19364-9607/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19364-9607/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19364-9607/.minikube}
I0804 00:04:26.898641 60214 buildroot.go:174] setting up certificates
I0804 00:04:26.898652 60214 provision.go:84] configureAuth start
I0804 00:04:26.898663 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetMachineName
I0804 00:04:26.898934 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetIP
I0804 00:04:26.901576 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has defined MAC address 52:54:00:cc:b7:b1 in network mk-old-k8s-version-576210
I0804 00:04:26.901914 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:cc:b7:b1", ip: ""} in network mk-old-k8s-version-576210: {Iface:virbr4 ExpiryTime:2024-08-04 01:04:18 +0000 UTC Type:0 Mac:52:54:00:cc:b7:b1 Iaid: IPaddr:192.168.72.154 Prefix:24 Hostname:old-k8s-version-576210 Clientid:01:52:54:00:cc:b7:b1}
I0804 00:04:26.901946 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has defined IP address 192.168.72.154 and MAC address 52:54:00:cc:b7:b1 in network mk-old-k8s-version-576210
I0804 00:04:26.902075 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetSSHHostname
I0804 00:04:26.904239 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has defined MAC address 52:54:00:cc:b7:b1 in network mk-old-k8s-version-576210
I0804 00:04:26.904561 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:cc:b7:b1", ip: ""} in network mk-old-k8s-version-576210: {Iface:virbr4 ExpiryTime:2024-08-04 01:04:18 +0000 UTC Type:0 Mac:52:54:00:cc:b7:b1 Iaid: IPaddr:192.168.72.154 Prefix:24 Hostname:old-k8s-version-576210 Clientid:01:52:54:00:cc:b7:b1}
I0804 00:04:26.904590 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has defined IP address 192.168.72.154 and MAC address 52:54:00:cc:b7:b1 in network mk-old-k8s-version-576210
I0804 00:04:26.904692 60214 provision.go:143] copyHostCerts
I0804 00:04:26.904754 60214 exec_runner.go:144] found /home/jenkins/minikube-integration/19364-9607/.minikube/ca.pem, removing ...
I0804 00:04:26.904770 60214 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19364-9607/.minikube/ca.pem
I0804 00:04:26.904837 60214 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19364-9607/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19364-9607/.minikube/ca.pem (1082 bytes)
I0804 00:04:26.904962 60214 exec_runner.go:144] found /home/jenkins/minikube-integration/19364-9607/.minikube/cert.pem, removing ...
I0804 00:04:26.904974 60214 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19364-9607/.minikube/cert.pem
I0804 00:04:26.905005 60214 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19364-9607/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19364-9607/.minikube/cert.pem (1123 bytes)
I0804 00:04:26.905092 60214 exec_runner.go:144] found /home/jenkins/minikube-integration/19364-9607/.minikube/key.pem, removing ...
I0804 00:04:26.905101 60214 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19364-9607/.minikube/key.pem
I0804 00:04:26.905129 60214 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19364-9607/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19364-9607/.minikube/key.pem (1679 bytes)
I0804 00:04:26.905220 60214 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19364-9607/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19364-9607/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19364-9607/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-576210 san=[127.0.0.1 192.168.72.154 localhost minikube old-k8s-version-576210]
I0804 00:04:27.229614 60214 provision.go:177] copyRemoteCerts
I0804 00:04:27.229671 60214 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0804 00:04:27.229693 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetSSHHostname
I0804 00:04:27.232189 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has defined MAC address 52:54:00:cc:b7:b1 in network mk-old-k8s-version-576210
I0804 00:04:27.232522 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:cc:b7:b1", ip: ""} in network mk-old-k8s-version-576210: {Iface:virbr4 ExpiryTime:2024-08-04 01:04:18 +0000 UTC Type:0 Mac:52:54:00:cc:b7:b1 Iaid: IPaddr:192.168.72.154 Prefix:24 Hostname:old-k8s-version-576210 Clientid:01:52:54:00:cc:b7:b1}
I0804 00:04:27.232554 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has defined IP address 192.168.72.154 and MAC address 52:54:00:cc:b7:b1 in network mk-old-k8s-version-576210
I0804 00:04:27.232777 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetSSHPort
I0804 00:04:27.232970 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetSSHKeyPath
I0804 00:04:27.233136 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetSSHUsername
I0804 00:04:27.233266 60214 sshutil.go:53] new ssh client: &{IP:192.168.72.154 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19364-9607/.minikube/machines/old-k8s-version-576210/id_rsa Username:docker}
I0804 00:04:27.319872 60214 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19364-9607/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0804 00:04:27.345863 60214 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19364-9607/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0804 00:04:27.371644 60214 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19364-9607/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0804 00:04:27.396849 60214 provision.go:87] duration metric: took 498.186217ms to configureAuth
I0804 00:04:27.396876 60214 buildroot.go:189] setting minikube options for container-runtime
I0804 00:04:27.397047 60214 config.go:182] Loaded profile config "old-k8s-version-576210": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0804 00:04:27.397112 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetSSHHostname
I0804 00:04:27.399570 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has defined MAC address 52:54:00:cc:b7:b1 in network mk-old-k8s-version-576210
I0804 00:04:27.399900 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:cc:b7:b1", ip: ""} in network mk-old-k8s-version-576210: {Iface:virbr4 ExpiryTime:2024-08-04 01:04:18 +0000 UTC Type:0 Mac:52:54:00:cc:b7:b1 Iaid: IPaddr:192.168.72.154 Prefix:24 Hostname:old-k8s-version-576210 Clientid:01:52:54:00:cc:b7:b1}
I0804 00:04:27.399932 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has defined IP address 192.168.72.154 and MAC address 52:54:00:cc:b7:b1 in network mk-old-k8s-version-576210
I0804 00:04:27.400148 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetSSHPort
I0804 00:04:27.400351 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetSSHKeyPath
I0804 00:04:27.400525 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetSSHKeyPath
I0804 00:04:27.400672 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetSSHUsername
I0804 00:04:27.400814 60214 main.go:141] libmachine: Using SSH client type: native
I0804 00:04:27.401015 60214 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.72.154 22 <nil> <nil>}
I0804 00:04:27.401031 60214 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0804 00:04:27.671546 60214 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0804 00:04:27.671578 60214 main.go:141] libmachine: Checking connection to Docker...
I0804 00:04:27.671590 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetURL
I0804 00:04:27.672819 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | Using libvirt version 6000000
I0804 00:04:27.675228 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has defined MAC address 52:54:00:cc:b7:b1 in network mk-old-k8s-version-576210
I0804 00:04:27.675594 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:cc:b7:b1", ip: ""} in network mk-old-k8s-version-576210: {Iface:virbr4 ExpiryTime:2024-08-04 01:04:18 +0000 UTC Type:0 Mac:52:54:00:cc:b7:b1 Iaid: IPaddr:192.168.72.154 Prefix:24 Hostname:old-k8s-version-576210 Clientid:01:52:54:00:cc:b7:b1}
I0804 00:04:27.675645 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has defined IP address 192.168.72.154 and MAC address 52:54:00:cc:b7:b1 in network mk-old-k8s-version-576210
I0804 00:04:27.675823 60214 main.go:141] libmachine: Docker is up and running!
I0804 00:04:27.675848 60214 main.go:141] libmachine: Reticulating splines...
I0804 00:04:27.675857 60214 client.go:171] duration metric: took 24.126474603s to LocalClient.Create
I0804 00:04:27.675894 60214 start.go:167] duration metric: took 24.12657668s to libmachine.API.Create "old-k8s-version-576210"
I0804 00:04:27.675908 60214 start.go:293] postStartSetup for "old-k8s-version-576210" (driver="kvm2")
I0804 00:04:27.675923 60214 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0804 00:04:27.675946 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .DriverName
I0804 00:04:27.676205 60214 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0804 00:04:27.676229 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetSSHHostname
I0804 00:04:27.678460 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has defined MAC address 52:54:00:cc:b7:b1 in network mk-old-k8s-version-576210
I0804 00:04:27.678776 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:cc:b7:b1", ip: ""} in network mk-old-k8s-version-576210: {Iface:virbr4 ExpiryTime:2024-08-04 01:04:18 +0000 UTC Type:0 Mac:52:54:00:cc:b7:b1 Iaid: IPaddr:192.168.72.154 Prefix:24 Hostname:old-k8s-version-576210 Clientid:01:52:54:00:cc:b7:b1}
I0804 00:04:27.678804 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has defined IP address 192.168.72.154 and MAC address 52:54:00:cc:b7:b1 in network mk-old-k8s-version-576210
I0804 00:04:27.678987 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetSSHPort
I0804 00:04:27.679151 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetSSHKeyPath
I0804 00:04:27.679307 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetSSHUsername
I0804 00:04:27.679455 60214 sshutil.go:53] new ssh client: &{IP:192.168.72.154 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19364-9607/.minikube/machines/old-k8s-version-576210/id_rsa Username:docker}
I0804 00:04:27.768481 60214 ssh_runner.go:195] Run: cat /etc/os-release
I0804 00:04:27.772908 60214 info.go:137] Remote host: Buildroot 2023.02.9
I0804 00:04:27.772930 60214 filesync.go:126] Scanning /home/jenkins/minikube-integration/19364-9607/.minikube/addons for local assets ...
I0804 00:04:27.772991 60214 filesync.go:126] Scanning /home/jenkins/minikube-integration/19364-9607/.minikube/files for local assets ...
I0804 00:04:27.773059 60214 filesync.go:149] local asset: /home/jenkins/minikube-integration/19364-9607/.minikube/files/etc/ssl/certs/167952.pem -> 167952.pem in /etc/ssl/certs
I0804 00:04:27.773149 60214 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0804 00:04:27.783016 60214 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19364-9607/.minikube/files/etc/ssl/certs/167952.pem --> /etc/ssl/certs/167952.pem (1708 bytes)
I0804 00:04:27.808719 60214 start.go:296] duration metric: took 132.79644ms for postStartSetup
I0804 00:04:27.808771 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetConfigRaw
I0804 00:04:27.809296 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetIP
I0804 00:04:27.811765 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has defined MAC address 52:54:00:cc:b7:b1 in network mk-old-k8s-version-576210
I0804 00:04:27.812111 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:cc:b7:b1", ip: ""} in network mk-old-k8s-version-576210: {Iface:virbr4 ExpiryTime:2024-08-04 01:04:18 +0000 UTC Type:0 Mac:52:54:00:cc:b7:b1 Iaid: IPaddr:192.168.72.154 Prefix:24 Hostname:old-k8s-version-576210 Clientid:01:52:54:00:cc:b7:b1}
I0804 00:04:27.812140 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has defined IP address 192.168.72.154 and MAC address 52:54:00:cc:b7:b1 in network mk-old-k8s-version-576210
I0804 00:04:27.812439 60214 profile.go:143] Saving config to /home/jenkins/minikube-integration/19364-9607/.minikube/profiles/old-k8s-version-576210/config.json ...
I0804 00:04:27.812655 60214 start.go:128] duration metric: took 24.286009261s to createHost
I0804 00:04:27.812679 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetSSHHostname
I0804 00:04:27.814819 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has defined MAC address 52:54:00:cc:b7:b1 in network mk-old-k8s-version-576210
I0804 00:04:27.815114 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:cc:b7:b1", ip: ""} in network mk-old-k8s-version-576210: {Iface:virbr4 ExpiryTime:2024-08-04 01:04:18 +0000 UTC Type:0 Mac:52:54:00:cc:b7:b1 Iaid: IPaddr:192.168.72.154 Prefix:24 Hostname:old-k8s-version-576210 Clientid:01:52:54:00:cc:b7:b1}
I0804 00:04:27.815134 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has defined IP address 192.168.72.154 and MAC address 52:54:00:cc:b7:b1 in network mk-old-k8s-version-576210
I0804 00:04:27.815314 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetSSHPort
I0804 00:04:27.815496 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetSSHKeyPath
I0804 00:04:27.815658 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetSSHKeyPath
I0804 00:04:27.815776 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetSSHUsername
I0804 00:04:27.815957 60214 main.go:141] libmachine: Using SSH client type: native
I0804 00:04:27.816109 60214 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.72.154 22 <nil> <nil>}
I0804 00:04:27.816127 60214 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0804 00:04:27.930021 60214 main.go:141] libmachine: SSH cmd err, output: <nil>: 1722729867.904919295
I0804 00:04:27.930045 60214 fix.go:216] guest clock: 1722729867.904919295
I0804 00:04:27.930055 60214 fix.go:229] Guest: 2024-08-04 00:04:27.904919295 +0000 UTC Remote: 2024-08-04 00:04:27.81266844 +0000 UTC m=+43.329595818 (delta=92.250855ms)
I0804 00:04:27.930104 60214 fix.go:200] guest clock delta is within tolerance: 92.250855ms
I0804 00:04:27.930115 60214 start.go:83] releasing machines lock for "old-k8s-version-576210", held for 24.403632414s
I0804 00:04:27.930144 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .DriverName
I0804 00:04:27.930398 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetIP
I0804 00:04:27.933232 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has defined MAC address 52:54:00:cc:b7:b1 in network mk-old-k8s-version-576210
I0804 00:04:27.933613 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:cc:b7:b1", ip: ""} in network mk-old-k8s-version-576210: {Iface:virbr4 ExpiryTime:2024-08-04 01:04:18 +0000 UTC Type:0 Mac:52:54:00:cc:b7:b1 Iaid: IPaddr:192.168.72.154 Prefix:24 Hostname:old-k8s-version-576210 Clientid:01:52:54:00:cc:b7:b1}
I0804 00:04:27.933639 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has defined IP address 192.168.72.154 and MAC address 52:54:00:cc:b7:b1 in network mk-old-k8s-version-576210
I0804 00:04:27.933791 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .DriverName
I0804 00:04:27.934376 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .DriverName
I0804 00:04:27.934538 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .DriverName
I0804 00:04:27.934614 60214 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0804 00:04:27.934661 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetSSHHostname
I0804 00:04:27.934736 60214 ssh_runner.go:195] Run: cat /version.json
I0804 00:04:27.934756 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetSSHHostname
I0804 00:04:27.937298 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has defined MAC address 52:54:00:cc:b7:b1 in network mk-old-k8s-version-576210
I0804 00:04:27.937652 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:cc:b7:b1", ip: ""} in network mk-old-k8s-version-576210: {Iface:virbr4 ExpiryTime:2024-08-04 01:04:18 +0000 UTC Type:0 Mac:52:54:00:cc:b7:b1 Iaid: IPaddr:192.168.72.154 Prefix:24 Hostname:old-k8s-version-576210 Clientid:01:52:54:00:cc:b7:b1}
I0804 00:04:27.937697 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has defined IP address 192.168.72.154 and MAC address 52:54:00:cc:b7:b1 in network mk-old-k8s-version-576210
I0804 00:04:27.937725 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has defined MAC address 52:54:00:cc:b7:b1 in network mk-old-k8s-version-576210
I0804 00:04:27.937838 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetSSHPort
I0804 00:04:27.938074 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetSSHKeyPath
I0804 00:04:27.938222 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:cc:b7:b1", ip: ""} in network mk-old-k8s-version-576210: {Iface:virbr4 ExpiryTime:2024-08-04 01:04:18 +0000 UTC Type:0 Mac:52:54:00:cc:b7:b1 Iaid: IPaddr:192.168.72.154 Prefix:24 Hostname:old-k8s-version-576210 Clientid:01:52:54:00:cc:b7:b1}
I0804 00:04:27.938222 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetSSHUsername
I0804 00:04:27.938247 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has defined IP address 192.168.72.154 and MAC address 52:54:00:cc:b7:b1 in network mk-old-k8s-version-576210
I0804 00:04:27.938414 60214 sshutil.go:53] new ssh client: &{IP:192.168.72.154 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19364-9607/.minikube/machines/old-k8s-version-576210/id_rsa Username:docker}
I0804 00:04:27.938487 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetSSHPort
I0804 00:04:27.938623 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetSSHKeyPath
I0804 00:04:27.938776 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetSSHUsername
I0804 00:04:27.938920 60214 sshutil.go:53] new ssh client: &{IP:192.168.72.154 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19364-9607/.minikube/machines/old-k8s-version-576210/id_rsa Username:docker}
I0804 00:04:28.039444 60214 ssh_runner.go:195] Run: systemctl --version
I0804 00:04:28.045710 60214 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0804 00:04:28.208622 60214 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0804 00:04:28.215082 60214 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0804 00:04:28.215157 60214 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0804 00:04:28.236517 60214 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0804 00:04:28.236545 60214 start.go:495] detecting cgroup driver to use...
I0804 00:04:28.236615 60214 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0804 00:04:28.254055 60214 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0804 00:04:28.268961 60214 docker.go:217] disabling cri-docker service (if available) ...
I0804 00:04:28.269034 60214 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0804 00:04:28.283246 60214 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0804 00:04:28.297381 60214 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0804 00:04:28.427729 60214 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0804 00:04:28.591001 60214 docker.go:233] disabling docker service ...
I0804 00:04:28.591070 60214 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0804 00:04:28.607281 60214 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0804 00:04:28.625017 60214 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0804 00:04:28.778325 60214 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0804 00:04:28.924213 60214 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0804 00:04:28.940281 60214 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0804 00:04:28.960676 60214 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0804 00:04:28.960753 60214 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0804 00:04:28.971808 60214 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0804 00:04:28.971865 60214 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0804 00:04:28.982887 60214 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0804 00:04:28.993975 60214 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0804 00:04:29.005087 60214 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0804 00:04:29.016679 60214 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0804 00:04:29.026430 60214 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0804 00:04:29.026502 60214 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0804 00:04:29.041377 60214 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0804 00:04:29.052889 60214 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0804 00:04:29.183162 60214 ssh_runner.go:195] Run: sudo systemctl restart crio
I0804 00:04:29.325955 60214 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0804 00:04:29.326036 60214 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0804 00:04:29.331298 60214 start.go:563] Will wait 60s for crictl version
I0804 00:04:29.331374 60214 ssh_runner.go:195] Run: which crictl
I0804 00:04:29.335268 60214 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0804 00:04:29.374986 60214 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0804 00:04:29.375080 60214 ssh_runner.go:195] Run: crio --version
I0804 00:04:29.402958 60214 ssh_runner.go:195] Run: crio --version
I0804 00:04:29.436493 60214 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0804 00:04:29.438007 60214 main.go:141] libmachine: (old-k8s-version-576210) Calling .GetIP
I0804 00:04:29.440579 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has defined MAC address 52:54:00:cc:b7:b1 in network mk-old-k8s-version-576210
I0804 00:04:29.440871 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:cc:b7:b1", ip: ""} in network mk-old-k8s-version-576210: {Iface:virbr4 ExpiryTime:2024-08-04 01:04:18 +0000 UTC Type:0 Mac:52:54:00:cc:b7:b1 Iaid: IPaddr:192.168.72.154 Prefix:24 Hostname:old-k8s-version-576210 Clientid:01:52:54:00:cc:b7:b1}
I0804 00:04:29.440892 60214 main.go:141] libmachine: (old-k8s-version-576210) DBG | domain old-k8s-version-576210 has defined IP address 192.168.72.154 and MAC address 52:54:00:cc:b7:b1 in network mk-old-k8s-version-576210
I0804 00:04:29.441091 60214 ssh_runner.go:195] Run: grep 192.168.72.1 host.minikube.internal$ /etc/hosts
I0804 00:04:29.445451 60214 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.72.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0804 00:04:29.457966 60214 kubeadm.go:883] updating cluster {Name:old-k8s-version-576210 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19339/minikube-v1.33.1-1722248113-19339-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-576210 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.154 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] M
ountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0804 00:04:29.458065 60214 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0804 00:04:29.458116 60214 ssh_runner.go:195] Run: sudo crictl images --output json
I0804 00:04:29.490517 60214 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0804 00:04:29.490597 60214 ssh_runner.go:195] Run: which lz4
I0804 00:04:29.494553 60214 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0804 00:04:29.498691 60214 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0804 00:04:29.498721 60214 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19364-9607/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0804 00:04:31.160009 60214 crio.go:462] duration metric: took 1.665492408s to copy over tarball
I0804 00:04:31.160076 60214 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0804 00:04:33.712353 60214 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.552250322s)
I0804 00:04:33.712384 60214 crio.go:469] duration metric: took 2.552346962s to extract the tarball
I0804 00:04:33.712393 60214 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0804 00:04:33.755900 60214 ssh_runner.go:195] Run: sudo crictl images --output json
I0804 00:04:33.813458 60214 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0804 00:04:33.813484 60214 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0804 00:04:33.813561 60214 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0804 00:04:33.813595 60214 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0804 00:04:33.813562 60214 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0804 00:04:33.813648 60214 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0804 00:04:33.813657 60214 image.go:134] retrieving image: registry.k8s.io/pause:3.2
I0804 00:04:33.813624 60214 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0804 00:04:33.813666 60214 image.go:134] retrieving image: registry.k8s.io/coredns:1.7.0
I0804 00:04:33.813621 60214 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0804 00:04:33.815195 60214 image.go:177] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0804 00:04:33.815201 60214 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0804 00:04:33.815226 60214 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0804 00:04:33.815234 60214 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0804 00:04:33.815197 60214 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0804 00:04:33.815195 60214 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0804 00:04:33.815194 60214 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0804 00:04:33.815201 60214 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0804 00:04:33.948148 60214 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0804 00:04:33.969191 60214 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0804 00:04:33.969344 60214 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0804 00:04:33.979949 60214 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0804 00:04:33.985725 60214 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0804 00:04:34.002169 60214 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0804 00:04:34.002212 60214 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0804 00:04:34.002258 60214 ssh_runner.go:195] Run: which crictl
I0804 00:04:34.008154 60214 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0804 00:04:34.052730 60214 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0804 00:04:34.139042 60214 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0804 00:04:34.139095 60214 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0804 00:04:34.139098 60214 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0804 00:04:34.139135 60214 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0804 00:04:34.139140 60214 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0804 00:04:34.139143 60214 ssh_runner.go:195] Run: which crictl
I0804 00:04:34.139168 60214 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0804 00:04:34.139051 60214 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0804 00:04:34.139182 60214 ssh_runner.go:195] Run: which crictl
I0804 00:04:34.139199 60214 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0804 00:04:34.139224 60214 ssh_runner.go:195] Run: which crictl
I0804 00:04:34.139236 60214 ssh_runner.go:195] Run: which crictl
I0804 00:04:34.139253 60214 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0804 00:04:34.167353 60214 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0804 00:04:34.167406 60214 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0804 00:04:34.167457 60214 ssh_runner.go:195] Run: which crictl
I0804 00:04:34.169728 60214 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0804 00:04:34.169772 60214 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0804 00:04:34.169820 60214 ssh_runner.go:195] Run: which crictl
I0804 00:04:34.193547 60214 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0804 00:04:34.193571 60214 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0804 00:04:34.193579 60214 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19364-9607/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0804 00:04:34.193599 60214 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0804 00:04:34.193637 60214 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0804 00:04:34.193653 60214 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0804 00:04:34.193690 60214 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0804 00:04:34.313998 60214 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19364-9607/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0804 00:04:34.325453 60214 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19364-9607/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0804 00:04:34.329139 60214 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19364-9607/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0804 00:04:34.329237 60214 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19364-9607/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0804 00:04:34.332935 60214 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19364-9607/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0804 00:04:34.333094 60214 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19364-9607/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0804 00:04:34.730570 60214 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0804 00:04:34.877791 60214 cache_images.go:92] duration metric: took 1.064289174s to LoadCachedImages
W0804 00:04:34.877872 60214 out.go:239] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19364-9607/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19364-9607/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0: no such file or directory
I0804 00:04:34.877882 60214 kubeadm.go:934] updating node { 192.168.72.154 8443 v1.20.0 crio true true} ...
I0804 00:04:34.878009 60214 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-576210 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.72.154
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-576210 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0804 00:04:34.878096 60214 ssh_runner.go:195] Run: crio config
I0804 00:04:34.927252 60214 cni.go:84] Creating CNI manager for ""
I0804 00:04:34.927274 60214 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0804 00:04:34.927284 60214 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0804 00:04:34.927302 60214 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.72.154 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-576210 NodeName:old-k8s-version-576210 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.72.154"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.72.154 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0804 00:04:34.927442 60214 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.72.154
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-576210"
kubeletExtraArgs:
node-ip: 192.168.72.154
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.72.154"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0804 00:04:34.927516 60214 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0804 00:04:34.937895 60214 binaries.go:44] Found k8s binaries, skipping transfer
I0804 00:04:34.937965 60214 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0804 00:04:34.947809 60214 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0804 00:04:34.965280 60214 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0804 00:04:34.982952 60214 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0804 00:04:35.001200 60214 ssh_runner.go:195] Run: grep 192.168.72.154 control-plane.minikube.internal$ /etc/hosts
I0804 00:04:35.006519 60214 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.72.154 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0804 00:04:35.019369 60214 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0804 00:04:35.134108 60214 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0804 00:04:35.152341 60214 certs.go:68] Setting up /home/jenkins/minikube-integration/19364-9607/.minikube/profiles/old-k8s-version-576210 for IP: 192.168.72.154
I0804 00:04:35.152368 60214 certs.go:194] generating shared ca certs ...
I0804 00:04:35.152397 60214 certs.go:226] acquiring lock for ca certs: {Name:mk9b604da46910ef8c4687f23e694acce87e3522 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0804 00:04:35.152570 60214 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19364-9607/.minikube/ca.key
I0804 00:04:35.152629 60214 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19364-9607/.minikube/proxy-client-ca.key
I0804 00:04:35.152643 60214 certs.go:256] generating profile certs ...
I0804 00:04:35.152716 60214 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19364-9607/.minikube/profiles/old-k8s-version-576210/client.key
I0804 00:04:35.152734 60214 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19364-9607/.minikube/profiles/old-k8s-version-576210/client.crt with IP's: []
I0804 00:04:35.273972 60214 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19364-9607/.minikube/profiles/old-k8s-version-576210/client.crt ...
I0804 00:04:35.274010 60214 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19364-9607/.minikube/profiles/old-k8s-version-576210/client.crt: {Name:mkd8d1c437f47a48cb7ce8e147469f23cd955372 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0804 00:04:35.274227 60214 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19364-9607/.minikube/profiles/old-k8s-version-576210/client.key ...
I0804 00:04:35.274246 60214 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19364-9607/.minikube/profiles/old-k8s-version-576210/client.key: {Name:mk53d7f203fde30ebe5ec7ac63a11fb2c97d5ab7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0804 00:04:35.274383 60214 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19364-9607/.minikube/profiles/old-k8s-version-576210/apiserver.key.5357f842
I0804 00:04:35.274409 60214 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19364-9607/.minikube/profiles/old-k8s-version-576210/apiserver.crt.5357f842 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.72.154]
I0804 00:04:35.335918 60214 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19364-9607/.minikube/profiles/old-k8s-version-576210/apiserver.crt.5357f842 ...
I0804 00:04:35.335944 60214 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19364-9607/.minikube/profiles/old-k8s-version-576210/apiserver.crt.5357f842: {Name:mk6538ae819b817d3819fc1b649c2f6da0e1f200 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0804 00:04:35.336096 60214 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19364-9607/.minikube/profiles/old-k8s-version-576210/apiserver.key.5357f842 ...
I0804 00:04:35.336109 60214 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19364-9607/.minikube/profiles/old-k8s-version-576210/apiserver.key.5357f842: {Name:mk75bf7ff1bfdbf0991e421cd5095a8309731a94 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0804 00:04:35.336182 60214 certs.go:381] copying /home/jenkins/minikube-integration/19364-9607/.minikube/profiles/old-k8s-version-576210/apiserver.crt.5357f842 -> /home/jenkins/minikube-integration/19364-9607/.minikube/profiles/old-k8s-version-576210/apiserver.crt
I0804 00:04:35.336294 60214 certs.go:385] copying /home/jenkins/minikube-integration/19364-9607/.minikube/profiles/old-k8s-version-576210/apiserver.key.5357f842 -> /home/jenkins/minikube-integration/19364-9607/.minikube/profiles/old-k8s-version-576210/apiserver.key
I0804 00:04:35.336391 60214 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19364-9607/.minikube/profiles/old-k8s-version-576210/proxy-client.key
I0804 00:04:35.336413 60214 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19364-9607/.minikube/profiles/old-k8s-version-576210/proxy-client.crt with IP's: []
I0804 00:04:35.405703 60214 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19364-9607/.minikube/profiles/old-k8s-version-576210/proxy-client.crt ...
I0804 00:04:35.405729 60214 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19364-9607/.minikube/profiles/old-k8s-version-576210/proxy-client.crt: {Name:mke95eeb5c7cf229cd5f383ac2f5eefc1e8c1364 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0804 00:04:35.405886 60214 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19364-9607/.minikube/profiles/old-k8s-version-576210/proxy-client.key ...
I0804 00:04:35.405900 60214 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19364-9607/.minikube/profiles/old-k8s-version-576210/proxy-client.key: {Name:mk9feb1ae5778aa11c5f500424a80878aabd5cb2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0804 00:04:35.406068 60214 certs.go:484] found cert: /home/jenkins/minikube-integration/19364-9607/.minikube/certs/16795.pem (1338 bytes)
W0804 00:04:35.406103 60214 certs.go:480] ignoring /home/jenkins/minikube-integration/19364-9607/.minikube/certs/16795_empty.pem, impossibly tiny 0 bytes
I0804 00:04:35.406112 60214 certs.go:484] found cert: /home/jenkins/minikube-integration/19364-9607/.minikube/certs/ca-key.pem (1675 bytes)
I0804 00:04:35.406138 60214 certs.go:484] found cert: /home/jenkins/minikube-integration/19364-9607/.minikube/certs/ca.pem (1082 bytes)
I0804 00:04:35.406166 60214 certs.go:484] found cert: /home/jenkins/minikube-integration/19364-9607/.minikube/certs/cert.pem (1123 bytes)
I0804 00:04:35.406187 60214 certs.go:484] found cert: /home/jenkins/minikube-integration/19364-9607/.minikube/certs/key.pem (1679 bytes)
I0804 00:04:35.406230 60214 certs.go:484] found cert: /home/jenkins/minikube-integration/19364-9607/.minikube/files/etc/ssl/certs/167952.pem (1708 bytes)
I0804 00:04:35.406824 60214 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19364-9607/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0804 00:04:35.432789 60214 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19364-9607/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0804 00:04:35.457876 60214 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19364-9607/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0804 00:04:35.482152 60214 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19364-9607/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0804 00:04:35.506872 60214 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19364-9607/.minikube/profiles/old-k8s-version-576210/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0804 00:04:35.591136 60214 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19364-9607/.minikube/profiles/old-k8s-version-576210/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0804 00:04:35.617124 60214 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19364-9607/.minikube/profiles/old-k8s-version-576210/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0804 00:04:35.641732 60214 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19364-9607/.minikube/profiles/old-k8s-version-576210/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0804 00:04:35.667431 60214 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19364-9607/.minikube/certs/16795.pem --> /usr/share/ca-certificates/16795.pem (1338 bytes)
I0804 00:04:35.691292 60214 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19364-9607/.minikube/files/etc/ssl/certs/167952.pem --> /usr/share/ca-certificates/167952.pem (1708 bytes)
I0804 00:04:35.715937 60214 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19364-9607/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0804 00:04:35.740675 60214 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0804 00:04:35.758056 60214 ssh_runner.go:195] Run: openssl version
I0804 00:04:35.764431 60214 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/16795.pem && ln -fs /usr/share/ca-certificates/16795.pem /etc/ssl/certs/16795.pem"
I0804 00:04:35.779147 60214 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/16795.pem
I0804 00:04:35.784199 60214 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug 3 23:02 /usr/share/ca-certificates/16795.pem
I0804 00:04:35.784252 60214 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/16795.pem
I0804 00:04:35.790098 60214 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/16795.pem /etc/ssl/certs/51391683.0"
I0804 00:04:35.801375 60214 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/167952.pem && ln -fs /usr/share/ca-certificates/167952.pem /etc/ssl/certs/167952.pem"
I0804 00:04:35.814556 60214 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/167952.pem
I0804 00:04:35.819373 60214 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug 3 23:02 /usr/share/ca-certificates/167952.pem
I0804 00:04:35.819432 60214 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/167952.pem
I0804 00:04:35.825486 60214 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/167952.pem /etc/ssl/certs/3ec20f2e.0"
I0804 00:04:35.837613 60214 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0804 00:04:35.849822 60214 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0804 00:04:35.854844 60214 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug 3 22:50 /usr/share/ca-certificates/minikubeCA.pem
I0804 00:04:35.854917 60214 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0804 00:04:35.862424 60214 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0804 00:04:35.876714 60214 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0804 00:04:35.881017 60214 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0804 00:04:35.881083 60214 kubeadm.go:392] StartCluster: {Name:old-k8s-version-576210 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19339/minikube-v1.33.1-1722248113-19339-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-576210 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.154 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0804 00:04:35.881164 60214 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0804 00:04:35.881210 60214 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0804 00:04:35.918665 60214 cri.go:89] found id: ""
I0804 00:04:35.918740 60214 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0804 00:04:35.929582 60214 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0804 00:04:35.940195 60214 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0804 00:04:35.950701 60214 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0804 00:04:35.950727 60214 kubeadm.go:157] found existing configuration files:
I0804 00:04:35.950779 60214 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0804 00:04:35.960211 60214 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0804 00:04:35.960273 60214 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0804 00:04:35.971231 60214 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0804 00:04:35.981812 60214 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0804 00:04:35.981872 60214 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0804 00:04:35.994958 60214 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0804 00:04:36.004385 60214 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0804 00:04:36.004457 60214 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0804 00:04:36.023904 60214 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0804 00:04:36.036383 60214 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0804 00:04:36.036446 60214 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0804 00:04:36.048709 60214 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0804 00:04:36.321621 60214 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0804 00:06:34.911601 60214 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0804 00:06:34.911708 60214 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0804 00:06:34.913288 60214 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0804 00:06:34.913377 60214 kubeadm.go:310] [preflight] Running pre-flight checks
I0804 00:06:34.913476 60214 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0804 00:06:34.913710 60214 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0804 00:06:34.913860 60214 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0804 00:06:34.913954 60214 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0804 00:06:34.915837 60214 out.go:204] - Generating certificates and keys ...
I0804 00:06:34.915935 60214 kubeadm.go:310] [certs] Using existing ca certificate authority
I0804 00:06:34.916025 60214 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0804 00:06:34.916142 60214 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0804 00:06:34.916231 60214 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0804 00:06:34.916337 60214 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0804 00:06:34.916390 60214 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0804 00:06:34.916476 60214 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0804 00:06:34.916647 60214 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-576210] and IPs [192.168.72.154 127.0.0.1 ::1]
I0804 00:06:34.916733 60214 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0804 00:06:34.916911 60214 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-576210] and IPs [192.168.72.154 127.0.0.1 ::1]
I0804 00:06:34.917007 60214 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0804 00:06:34.917100 60214 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0804 00:06:34.917166 60214 kubeadm.go:310] [certs] Generating "sa" key and public key
I0804 00:06:34.917218 60214 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0804 00:06:34.917286 60214 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0804 00:06:34.917366 60214 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0804 00:06:34.917455 60214 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0804 00:06:34.917506 60214 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0804 00:06:34.917633 60214 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0804 00:06:34.917759 60214 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0804 00:06:34.917815 60214 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0804 00:06:34.917910 60214 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0804 00:06:34.919539 60214 out.go:204] - Booting up control plane ...
I0804 00:06:34.919624 60214 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0804 00:06:34.919734 60214 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0804 00:06:34.919855 60214 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0804 00:06:34.919969 60214 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0804 00:06:34.920166 60214 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0804 00:06:34.920247 60214 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0804 00:06:34.920354 60214 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0804 00:06:34.920612 60214 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0804 00:06:34.920707 60214 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0804 00:06:34.921033 60214 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0804 00:06:34.921154 60214 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0804 00:06:34.921376 60214 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0804 00:06:34.921475 60214 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0804 00:06:34.921746 60214 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0804 00:06:34.921843 60214 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0804 00:06:34.922087 60214 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0804 00:06:34.922102 60214 kubeadm.go:310]
I0804 00:06:34.922134 60214 kubeadm.go:310] Unfortunately, an error has occurred:
I0804 00:06:34.922188 60214 kubeadm.go:310] timed out waiting for the condition
I0804 00:06:34.922198 60214 kubeadm.go:310]
I0804 00:06:34.922252 60214 kubeadm.go:310] This error is likely caused by:
I0804 00:06:34.922301 60214 kubeadm.go:310] - The kubelet is not running
I0804 00:06:34.922452 60214 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0804 00:06:34.922463 60214 kubeadm.go:310]
I0804 00:06:34.922613 60214 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0804 00:06:34.922652 60214 kubeadm.go:310] - 'systemctl status kubelet'
I0804 00:06:34.922680 60214 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0804 00:06:34.922690 60214 kubeadm.go:310]
I0804 00:06:34.922809 60214 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0804 00:06:34.922892 60214 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0804 00:06:34.922900 60214 kubeadm.go:310]
I0804 00:06:34.922987 60214 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0804 00:06:34.923064 60214 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0804 00:06:34.923133 60214 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0804 00:06:34.923205 60214 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0804 00:06:34.923314 60214 kubeadm.go:310]
W0804 00:06:34.923337 60214 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-576210] and IPs [192.168.72.154 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-576210] and IPs [192.168.72.154 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-576210] and IPs [192.168.72.154 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-576210] and IPs [192.168.72.154 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0804 00:06:34.923381 60214 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0804 00:06:35.392750 60214 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0804 00:06:35.412971 60214 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0804 00:06:35.424772 60214 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0804 00:06:35.424794 60214 kubeadm.go:157] found existing configuration files:
I0804 00:06:35.424843 60214 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0804 00:06:35.435612 60214 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0804 00:06:35.435672 60214 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0804 00:06:35.445874 60214 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0804 00:06:35.455254 60214 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0804 00:06:35.455320 60214 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0804 00:06:35.464565 60214 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0804 00:06:35.473253 60214 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0804 00:06:35.473302 60214 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0804 00:06:35.482331 60214 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0804 00:06:35.491552 60214 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0804 00:06:35.491606 60214 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0804 00:06:35.500676 60214 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0804 00:06:35.737772 60214 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0804 00:08:32.242209 60214 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0804 00:08:32.242299 60214 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0804 00:08:32.244203 60214 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0804 00:08:32.244322 60214 kubeadm.go:310] [preflight] Running pre-flight checks
I0804 00:08:32.244433 60214 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0804 00:08:32.244558 60214 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0804 00:08:32.244672 60214 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0804 00:08:32.244773 60214 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0804 00:08:32.246608 60214 out.go:204] - Generating certificates and keys ...
I0804 00:08:32.246685 60214 kubeadm.go:310] [certs] Using existing ca certificate authority
I0804 00:08:32.246743 60214 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0804 00:08:32.246865 60214 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0804 00:08:32.246928 60214 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0804 00:08:32.246987 60214 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0804 00:08:32.247042 60214 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0804 00:08:32.247097 60214 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0804 00:08:32.247157 60214 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0804 00:08:32.247220 60214 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0804 00:08:32.247306 60214 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0804 00:08:32.247357 60214 kubeadm.go:310] [certs] Using the existing "sa" key
I0804 00:08:32.247401 60214 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0804 00:08:32.247441 60214 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0804 00:08:32.247485 60214 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0804 00:08:32.247545 60214 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0804 00:08:32.247592 60214 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0804 00:08:32.247681 60214 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0804 00:08:32.247751 60214 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0804 00:08:32.247792 60214 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0804 00:08:32.247885 60214 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0804 00:08:32.250356 60214 out.go:204] - Booting up control plane ...
I0804 00:08:32.250440 60214 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0804 00:08:32.250506 60214 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0804 00:08:32.250562 60214 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0804 00:08:32.250632 60214 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0804 00:08:32.250854 60214 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0804 00:08:32.250917 60214 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0804 00:08:32.250975 60214 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0804 00:08:32.251195 60214 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0804 00:08:32.251297 60214 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0804 00:08:32.251484 60214 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0804 00:08:32.251550 60214 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0804 00:08:32.251758 60214 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0804 00:08:32.251819 60214 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0804 00:08:32.251981 60214 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0804 00:08:32.252057 60214 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0804 00:08:32.252349 60214 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0804 00:08:32.252371 60214 kubeadm.go:310]
I0804 00:08:32.252428 60214 kubeadm.go:310] Unfortunately, an error has occurred:
I0804 00:08:32.252484 60214 kubeadm.go:310] timed out waiting for the condition
I0804 00:08:32.252495 60214 kubeadm.go:310]
I0804 00:08:32.252548 60214 kubeadm.go:310] This error is likely caused by:
I0804 00:08:32.252600 60214 kubeadm.go:310] - The kubelet is not running
I0804 00:08:32.252692 60214 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0804 00:08:32.252698 60214 kubeadm.go:310]
I0804 00:08:32.252817 60214 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0804 00:08:32.252875 60214 kubeadm.go:310] - 'systemctl status kubelet'
I0804 00:08:32.252933 60214 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0804 00:08:32.252943 60214 kubeadm.go:310]
I0804 00:08:32.253036 60214 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0804 00:08:32.253121 60214 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0804 00:08:32.253128 60214 kubeadm.go:310]
I0804 00:08:32.253213 60214 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0804 00:08:32.253280 60214 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0804 00:08:32.253401 60214 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0804 00:08:32.253484 60214 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0804 00:08:32.253538 60214 kubeadm.go:310]
I0804 00:08:32.253562 60214 kubeadm.go:394] duration metric: took 3m56.372483865s to StartCluster
I0804 00:08:32.253619 60214 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0804 00:08:32.253673 60214 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0804 00:08:32.298732 60214 cri.go:89] found id: ""
I0804 00:08:32.298760 60214 logs.go:276] 0 containers: []
W0804 00:08:32.298771 60214 logs.go:278] No container was found matching "kube-apiserver"
I0804 00:08:32.298778 60214 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0804 00:08:32.298841 60214 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0804 00:08:32.340463 60214 cri.go:89] found id: ""
I0804 00:08:32.340492 60214 logs.go:276] 0 containers: []
W0804 00:08:32.340501 60214 logs.go:278] No container was found matching "etcd"
I0804 00:08:32.340508 60214 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0804 00:08:32.340571 60214 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0804 00:08:32.386531 60214 cri.go:89] found id: ""
I0804 00:08:32.386559 60214 logs.go:276] 0 containers: []
W0804 00:08:32.386569 60214 logs.go:278] No container was found matching "coredns"
I0804 00:08:32.386577 60214 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0804 00:08:32.386642 60214 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0804 00:08:32.422632 60214 cri.go:89] found id: ""
I0804 00:08:32.422659 60214 logs.go:276] 0 containers: []
W0804 00:08:32.422670 60214 logs.go:278] No container was found matching "kube-scheduler"
I0804 00:08:32.422677 60214 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0804 00:08:32.422738 60214 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0804 00:08:32.466415 60214 cri.go:89] found id: ""
I0804 00:08:32.466445 60214 logs.go:276] 0 containers: []
W0804 00:08:32.466457 60214 logs.go:278] No container was found matching "kube-proxy"
I0804 00:08:32.466464 60214 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0804 00:08:32.466521 60214 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0804 00:08:32.503601 60214 cri.go:89] found id: ""
I0804 00:08:32.503631 60214 logs.go:276] 0 containers: []
W0804 00:08:32.503641 60214 logs.go:278] No container was found matching "kube-controller-manager"
I0804 00:08:32.503649 60214 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0804 00:08:32.503729 60214 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0804 00:08:32.539015 60214 cri.go:89] found id: ""
I0804 00:08:32.539047 60214 logs.go:276] 0 containers: []
W0804 00:08:32.539056 60214 logs.go:278] No container was found matching "kindnet"
I0804 00:08:32.539072 60214 logs.go:123] Gathering logs for kubelet ...
I0804 00:08:32.539092 60214 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0804 00:08:32.590939 60214 logs.go:123] Gathering logs for dmesg ...
I0804 00:08:32.590970 60214 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0804 00:08:32.605962 60214 logs.go:123] Gathering logs for describe nodes ...
I0804 00:08:32.605996 60214 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0804 00:08:32.716956 60214 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0804 00:08:32.716982 60214 logs.go:123] Gathering logs for CRI-O ...
I0804 00:08:32.716998 60214 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0804 00:08:32.810557 60214 logs.go:123] Gathering logs for container status ...
I0804 00:08:32.810595 60214 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0804 00:08:32.851916 60214 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0804 00:08:32.851965 60214 out.go:239] *
*
W0804 00:08:32.852038 60214 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0804 00:08:32.852069 60214 out.go:239] *
*
W0804 00:08:32.852984 60214 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0804 00:08:32.856256 60214 out.go:177]
W0804 00:08:32.857610 60214 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0804 00:08:32.857661 60214 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0804 00:08:32.857680 60214 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0804 00:08:32.859284 60214 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-576210 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-576210 -n old-k8s-version-576210
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-576210 -n old-k8s-version-576210: exit status 6 (221.731408ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0804 00:08:33.121979 63902 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-576210" does not appear in /home/jenkins/minikube-integration/19364-9607/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-576210" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (288.66s)