=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:184: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-191446 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:184: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-191446 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m32.945037558s)
-- stdout --
* [old-k8s-version-191446] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=20242
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/20242-1920423/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/20242-1920423/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-191446" primary control-plane node in "old-k8s-version-191446" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0120 13:55:20.170444 1967169 out.go:345] Setting OutFile to fd 1 ...
I0120 13:55:20.170590 1967169 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0120 13:55:20.170599 1967169 out.go:358] Setting ErrFile to fd 2...
I0120 13:55:20.170626 1967169 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0120 13:55:20.170881 1967169 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20242-1920423/.minikube/bin
I0120 13:55:20.171692 1967169 out.go:352] Setting JSON to false
I0120 13:55:20.173148 1967169 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":20266,"bootTime":1737361054,"procs":213,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1074-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0120 13:55:20.173320 1967169 start.go:139] virtualization: kvm guest
I0120 13:55:20.175687 1967169 out.go:177] * [old-k8s-version-191446] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
I0120 13:55:20.177755 1967169 out.go:177] - MINIKUBE_LOCATION=20242
I0120 13:55:20.177758 1967169 notify.go:220] Checking for updates...
I0120 13:55:20.179219 1967169 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0120 13:55:20.180618 1967169 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/20242-1920423/kubeconfig
I0120 13:55:20.182066 1967169 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/20242-1920423/.minikube
I0120 13:55:20.183534 1967169 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0120 13:55:20.184994 1967169 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0120 13:55:20.186823 1967169 config.go:182] Loaded profile config "cert-expiration-038404": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.0
I0120 13:55:20.186946 1967169 config.go:182] Loaded profile config "kubernetes-upgrade-377526": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0120 13:55:20.187086 1967169 config.go:182] Loaded profile config "stopped-upgrade-795137": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.24.1
I0120 13:55:20.187203 1967169 driver.go:394] Setting default libvirt URI to qemu:///system
I0120 13:55:20.231223 1967169 out.go:177] * Using the kvm2 driver based on user configuration
I0120 13:55:20.232567 1967169 start.go:297] selected driver: kvm2
I0120 13:55:20.232590 1967169 start.go:901] validating driver "kvm2" against <nil>
I0120 13:55:20.232605 1967169 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0120 13:55:20.233652 1967169 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0120 13:55:20.233743 1967169 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/20242-1920423/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0120 13:55:20.250741 1967169 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.35.0
I0120 13:55:20.250809 1967169 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0120 13:55:20.251135 1967169 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0120 13:55:20.251181 1967169 cni.go:84] Creating CNI manager for ""
I0120 13:55:20.251235 1967169 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0120 13:55:20.251249 1967169 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0120 13:55:20.251336 1967169 start.go:340] cluster config:
{Name:old-k8s-version-191446 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-191446 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRI
Socket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:
0 GPUs: AutoPauseInterval:1m0s}
I0120 13:55:20.251476 1967169 iso.go:125] acquiring lock: {Name:mk18c81b0efa5cc8efe9d47dc52684752f206ae9 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0120 13:55:20.253683 1967169 out.go:177] * Starting "old-k8s-version-191446" primary control-plane node in "old-k8s-version-191446" cluster
I0120 13:55:20.254997 1967169 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0120 13:55:20.255046 1967169 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20242-1920423/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0120 13:55:20.255056 1967169 cache.go:56] Caching tarball of preloaded images
I0120 13:55:20.255161 1967169 preload.go:172] Found /home/jenkins/minikube-integration/20242-1920423/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0120 13:55:20.255177 1967169 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0120 13:55:20.255278 1967169 profile.go:143] Saving config to /home/jenkins/minikube-integration/20242-1920423/.minikube/profiles/old-k8s-version-191446/config.json ...
I0120 13:55:20.255299 1967169 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20242-1920423/.minikube/profiles/old-k8s-version-191446/config.json: {Name:mka616f378b5a696b8d19b34cf750b7a2cf6f047 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0120 13:55:20.255444 1967169 start.go:360] acquireMachinesLock for old-k8s-version-191446: {Name:mkbf148c6fec0c722eed081be3cef9d0990100c3 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0120 13:55:21.283812 1967169 start.go:364] duration metric: took 1.02832496s to acquireMachinesLock for "old-k8s-version-191446"
I0120 13:55:21.283900 1967169 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-191446 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-versi
on-191446 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMir
ror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0120 13:55:21.284050 1967169 start.go:125] createHost starting for "" (driver="kvm2")
I0120 13:55:21.286047 1967169 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0120 13:55:21.286266 1967169 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0120 13:55:21.286350 1967169 main.go:141] libmachine: Launching plugin server for driver kvm2
I0120 13:55:21.305587 1967169 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33005
I0120 13:55:21.306184 1967169 main.go:141] libmachine: () Calling .GetVersion
I0120 13:55:21.306907 1967169 main.go:141] libmachine: Using API Version 1
I0120 13:55:21.306960 1967169 main.go:141] libmachine: () Calling .SetConfigRaw
I0120 13:55:21.307371 1967169 main.go:141] libmachine: () Calling .GetMachineName
I0120 13:55:21.307616 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetMachineName
I0120 13:55:21.307820 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .DriverName
I0120 13:55:21.308026 1967169 start.go:159] libmachine.API.Create for "old-k8s-version-191446" (driver="kvm2")
I0120 13:55:21.308065 1967169 client.go:168] LocalClient.Create starting
I0120 13:55:21.308111 1967169 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20242-1920423/.minikube/certs/ca.pem
I0120 13:55:21.308161 1967169 main.go:141] libmachine: Decoding PEM data...
I0120 13:55:21.308189 1967169 main.go:141] libmachine: Parsing certificate...
I0120 13:55:21.308264 1967169 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20242-1920423/.minikube/certs/cert.pem
I0120 13:55:21.308291 1967169 main.go:141] libmachine: Decoding PEM data...
I0120 13:55:21.308308 1967169 main.go:141] libmachine: Parsing certificate...
I0120 13:55:21.308332 1967169 main.go:141] libmachine: Running pre-create checks...
I0120 13:55:21.308356 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .PreCreateCheck
I0120 13:55:21.308848 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetConfigRaw
I0120 13:55:21.309325 1967169 main.go:141] libmachine: Creating machine...
I0120 13:55:21.309348 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .Create
I0120 13:55:21.309514 1967169 main.go:141] libmachine: (old-k8s-version-191446) creating KVM machine...
I0120 13:55:21.309538 1967169 main.go:141] libmachine: (old-k8s-version-191446) creating network...
I0120 13:55:21.311187 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | found existing default KVM network
I0120 13:55:21.314092 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | I0120 13:55:21.313860 1967192 network.go:209] skipping subnet 192.168.39.0/24 that is reserved: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}
I0120 13:55:21.315135 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | I0120 13:55:21.315005 1967192 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:fd:09:3b} reservation:<nil>}
I0120 13:55:21.316332 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | I0120 13:55:21.316228 1967192 network.go:206] using free private subnet 192.168.61.0/24: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000285520}
I0120 13:55:21.316367 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | created network xml:
I0120 13:55:21.316377 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | <network>
I0120 13:55:21.316393 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | <name>mk-old-k8s-version-191446</name>
I0120 13:55:21.316403 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | <dns enable='no'/>
I0120 13:55:21.316410 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG |
I0120 13:55:21.316424 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | <ip address='192.168.61.1' netmask='255.255.255.0'>
I0120 13:55:21.316449 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | <dhcp>
I0120 13:55:21.316463 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | <range start='192.168.61.2' end='192.168.61.253'/>
I0120 13:55:21.316469 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | </dhcp>
I0120 13:55:21.316515 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | </ip>
I0120 13:55:21.316536 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG |
I0120 13:55:21.316543 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | </network>
I0120 13:55:21.316547 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG |
I0120 13:55:21.322242 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | trying to create private KVM network mk-old-k8s-version-191446 192.168.61.0/24...
I0120 13:55:21.403400 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | private KVM network mk-old-k8s-version-191446 192.168.61.0/24 created
I0120 13:55:21.403442 1967169 main.go:141] libmachine: (old-k8s-version-191446) setting up store path in /home/jenkins/minikube-integration/20242-1920423/.minikube/machines/old-k8s-version-191446 ...
I0120 13:55:21.403467 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | I0120 13:55:21.403361 1967192 common.go:144] Making disk image using store path: /home/jenkins/minikube-integration/20242-1920423/.minikube
I0120 13:55:21.403481 1967169 main.go:141] libmachine: (old-k8s-version-191446) building disk image from file:///home/jenkins/minikube-integration/20242-1920423/.minikube/cache/iso/amd64/minikube-v1.35.0-amd64.iso
I0120 13:55:21.403506 1967169 main.go:141] libmachine: (old-k8s-version-191446) Downloading /home/jenkins/minikube-integration/20242-1920423/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/20242-1920423/.minikube/cache/iso/amd64/minikube-v1.35.0-amd64.iso...
I0120 13:55:21.699311 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | I0120 13:55:21.699132 1967192 common.go:151] Creating ssh key: /home/jenkins/minikube-integration/20242-1920423/.minikube/machines/old-k8s-version-191446/id_rsa...
I0120 13:55:21.819839 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | I0120 13:55:21.819670 1967192 common.go:157] Creating raw disk image: /home/jenkins/minikube-integration/20242-1920423/.minikube/machines/old-k8s-version-191446/old-k8s-version-191446.rawdisk...
I0120 13:55:21.819874 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | Writing magic tar header
I0120 13:55:21.819929 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | Writing SSH key tar header
I0120 13:55:21.819967 1967169 main.go:141] libmachine: (old-k8s-version-191446) setting executable bit set on /home/jenkins/minikube-integration/20242-1920423/.minikube/machines/old-k8s-version-191446 (perms=drwx------)
I0120 13:55:21.819987 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | I0120 13:55:21.819799 1967192 common.go:171] Fixing permissions on /home/jenkins/minikube-integration/20242-1920423/.minikube/machines/old-k8s-version-191446 ...
I0120 13:55:21.820008 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20242-1920423/.minikube/machines/old-k8s-version-191446
I0120 13:55:21.820019 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20242-1920423/.minikube/machines
I0120 13:55:21.820027 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20242-1920423/.minikube
I0120 13:55:21.820044 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20242-1920423
I0120 13:55:21.820073 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | checking permissions on dir: /home/jenkins/minikube-integration
I0120 13:55:21.820092 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | checking permissions on dir: /home/jenkins
I0120 13:55:21.820105 1967169 main.go:141] libmachine: (old-k8s-version-191446) setting executable bit set on /home/jenkins/minikube-integration/20242-1920423/.minikube/machines (perms=drwxr-xr-x)
I0120 13:55:21.820123 1967169 main.go:141] libmachine: (old-k8s-version-191446) setting executable bit set on /home/jenkins/minikube-integration/20242-1920423/.minikube (perms=drwxr-xr-x)
I0120 13:55:21.820137 1967169 main.go:141] libmachine: (old-k8s-version-191446) setting executable bit set on /home/jenkins/minikube-integration/20242-1920423 (perms=drwxrwxr-x)
I0120 13:55:21.820152 1967169 main.go:141] libmachine: (old-k8s-version-191446) setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0120 13:55:21.820181 1967169 main.go:141] libmachine: (old-k8s-version-191446) setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0120 13:55:21.820195 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | checking permissions on dir: /home
I0120 13:55:21.820209 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | skipping /home - not owner
I0120 13:55:21.820221 1967169 main.go:141] libmachine: (old-k8s-version-191446) creating domain...
I0120 13:55:21.821513 1967169 main.go:141] libmachine: (old-k8s-version-191446) define libvirt domain using xml:
I0120 13:55:21.821574 1967169 main.go:141] libmachine: (old-k8s-version-191446) <domain type='kvm'>
I0120 13:55:21.821584 1967169 main.go:141] libmachine: (old-k8s-version-191446) <name>old-k8s-version-191446</name>
I0120 13:55:21.821591 1967169 main.go:141] libmachine: (old-k8s-version-191446) <memory unit='MiB'>2200</memory>
I0120 13:55:21.821599 1967169 main.go:141] libmachine: (old-k8s-version-191446) <vcpu>2</vcpu>
I0120 13:55:21.821606 1967169 main.go:141] libmachine: (old-k8s-version-191446) <features>
I0120 13:55:21.821621 1967169 main.go:141] libmachine: (old-k8s-version-191446) <acpi/>
I0120 13:55:21.821632 1967169 main.go:141] libmachine: (old-k8s-version-191446) <apic/>
I0120 13:55:21.821639 1967169 main.go:141] libmachine: (old-k8s-version-191446) <pae/>
I0120 13:55:21.821648 1967169 main.go:141] libmachine: (old-k8s-version-191446)
I0120 13:55:21.821657 1967169 main.go:141] libmachine: (old-k8s-version-191446) </features>
I0120 13:55:21.821670 1967169 main.go:141] libmachine: (old-k8s-version-191446) <cpu mode='host-passthrough'>
I0120 13:55:21.821680 1967169 main.go:141] libmachine: (old-k8s-version-191446)
I0120 13:55:21.821686 1967169 main.go:141] libmachine: (old-k8s-version-191446) </cpu>
I0120 13:55:21.821694 1967169 main.go:141] libmachine: (old-k8s-version-191446) <os>
I0120 13:55:21.821701 1967169 main.go:141] libmachine: (old-k8s-version-191446) <type>hvm</type>
I0120 13:55:21.821713 1967169 main.go:141] libmachine: (old-k8s-version-191446) <boot dev='cdrom'/>
I0120 13:55:21.821722 1967169 main.go:141] libmachine: (old-k8s-version-191446) <boot dev='hd'/>
I0120 13:55:21.821730 1967169 main.go:141] libmachine: (old-k8s-version-191446) <bootmenu enable='no'/>
I0120 13:55:21.821738 1967169 main.go:141] libmachine: (old-k8s-version-191446) </os>
I0120 13:55:21.821746 1967169 main.go:141] libmachine: (old-k8s-version-191446) <devices>
I0120 13:55:21.821756 1967169 main.go:141] libmachine: (old-k8s-version-191446) <disk type='file' device='cdrom'>
I0120 13:55:21.821780 1967169 main.go:141] libmachine: (old-k8s-version-191446) <source file='/home/jenkins/minikube-integration/20242-1920423/.minikube/machines/old-k8s-version-191446/boot2docker.iso'/>
I0120 13:55:21.821801 1967169 main.go:141] libmachine: (old-k8s-version-191446) <target dev='hdc' bus='scsi'/>
I0120 13:55:21.821809 1967169 main.go:141] libmachine: (old-k8s-version-191446) <readonly/>
I0120 13:55:21.821819 1967169 main.go:141] libmachine: (old-k8s-version-191446) </disk>
I0120 13:55:21.821852 1967169 main.go:141] libmachine: (old-k8s-version-191446) <disk type='file' device='disk'>
I0120 13:55:21.821879 1967169 main.go:141] libmachine: (old-k8s-version-191446) <driver name='qemu' type='raw' cache='default' io='threads' />
I0120 13:55:21.821895 1967169 main.go:141] libmachine: (old-k8s-version-191446) <source file='/home/jenkins/minikube-integration/20242-1920423/.minikube/machines/old-k8s-version-191446/old-k8s-version-191446.rawdisk'/>
I0120 13:55:21.821907 1967169 main.go:141] libmachine: (old-k8s-version-191446) <target dev='hda' bus='virtio'/>
I0120 13:55:21.821917 1967169 main.go:141] libmachine: (old-k8s-version-191446) </disk>
I0120 13:55:21.821928 1967169 main.go:141] libmachine: (old-k8s-version-191446) <interface type='network'>
I0120 13:55:21.821937 1967169 main.go:141] libmachine: (old-k8s-version-191446) <source network='mk-old-k8s-version-191446'/>
I0120 13:55:21.821948 1967169 main.go:141] libmachine: (old-k8s-version-191446) <model type='virtio'/>
I0120 13:55:21.821974 1967169 main.go:141] libmachine: (old-k8s-version-191446) </interface>
I0120 13:55:21.822020 1967169 main.go:141] libmachine: (old-k8s-version-191446) <interface type='network'>
I0120 13:55:21.822031 1967169 main.go:141] libmachine: (old-k8s-version-191446) <source network='default'/>
I0120 13:55:21.822035 1967169 main.go:141] libmachine: (old-k8s-version-191446) <model type='virtio'/>
I0120 13:55:21.822040 1967169 main.go:141] libmachine: (old-k8s-version-191446) </interface>
I0120 13:55:21.822047 1967169 main.go:141] libmachine: (old-k8s-version-191446) <serial type='pty'>
I0120 13:55:21.822066 1967169 main.go:141] libmachine: (old-k8s-version-191446) <target port='0'/>
I0120 13:55:21.822074 1967169 main.go:141] libmachine: (old-k8s-version-191446) </serial>
I0120 13:55:21.822079 1967169 main.go:141] libmachine: (old-k8s-version-191446) <console type='pty'>
I0120 13:55:21.822087 1967169 main.go:141] libmachine: (old-k8s-version-191446) <target type='serial' port='0'/>
I0120 13:55:21.822092 1967169 main.go:141] libmachine: (old-k8s-version-191446) </console>
I0120 13:55:21.822099 1967169 main.go:141] libmachine: (old-k8s-version-191446) <rng model='virtio'>
I0120 13:55:21.822105 1967169 main.go:141] libmachine: (old-k8s-version-191446) <backend model='random'>/dev/random</backend>
I0120 13:55:21.822116 1967169 main.go:141] libmachine: (old-k8s-version-191446) </rng>
I0120 13:55:21.822121 1967169 main.go:141] libmachine: (old-k8s-version-191446)
I0120 13:55:21.822128 1967169 main.go:141] libmachine: (old-k8s-version-191446)
I0120 13:55:21.822133 1967169 main.go:141] libmachine: (old-k8s-version-191446) </devices>
I0120 13:55:21.822139 1967169 main.go:141] libmachine: (old-k8s-version-191446) </domain>
I0120 13:55:21.822147 1967169 main.go:141] libmachine: (old-k8s-version-191446)
I0120 13:55:21.826810 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has defined MAC address 52:54:00:57:e6:f8 in network default
I0120 13:55:21.827456 1967169 main.go:141] libmachine: (old-k8s-version-191446) starting domain...
I0120 13:55:21.827480 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has defined MAC address 52:54:00:87:83:fb in network mk-old-k8s-version-191446
I0120 13:55:21.827488 1967169 main.go:141] libmachine: (old-k8s-version-191446) ensuring networks are active...
I0120 13:55:21.828264 1967169 main.go:141] libmachine: (old-k8s-version-191446) Ensuring network default is active
I0120 13:55:21.828653 1967169 main.go:141] libmachine: (old-k8s-version-191446) Ensuring network mk-old-k8s-version-191446 is active
I0120 13:55:21.829317 1967169 main.go:141] libmachine: (old-k8s-version-191446) getting domain XML...
I0120 13:55:21.830246 1967169 main.go:141] libmachine: (old-k8s-version-191446) creating domain...
I0120 13:55:23.249060 1967169 main.go:141] libmachine: (old-k8s-version-191446) waiting for IP...
I0120 13:55:23.250206 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has defined MAC address 52:54:00:87:83:fb in network mk-old-k8s-version-191446
I0120 13:55:23.250863 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | unable to find current IP address of domain old-k8s-version-191446 in network mk-old-k8s-version-191446
I0120 13:55:23.250957 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | I0120 13:55:23.250871 1967192 retry.go:31] will retry after 202.264582ms: waiting for domain to come up
I0120 13:55:23.455461 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has defined MAC address 52:54:00:87:83:fb in network mk-old-k8s-version-191446
I0120 13:55:23.456079 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | unable to find current IP address of domain old-k8s-version-191446 in network mk-old-k8s-version-191446
I0120 13:55:23.456111 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | I0120 13:55:23.456022 1967192 retry.go:31] will retry after 374.940164ms: waiting for domain to come up
I0120 13:55:23.832660 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has defined MAC address 52:54:00:87:83:fb in network mk-old-k8s-version-191446
I0120 13:55:23.833483 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | unable to find current IP address of domain old-k8s-version-191446 in network mk-old-k8s-version-191446
I0120 13:55:23.833535 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | I0120 13:55:23.833452 1967192 retry.go:31] will retry after 373.752504ms: waiting for domain to come up
I0120 13:55:24.209031 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has defined MAC address 52:54:00:87:83:fb in network mk-old-k8s-version-191446
I0120 13:55:24.209693 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | unable to find current IP address of domain old-k8s-version-191446 in network mk-old-k8s-version-191446
I0120 13:55:24.209727 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | I0120 13:55:24.209653 1967192 retry.go:31] will retry after 599.169374ms: waiting for domain to come up
I0120 13:55:24.810528 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has defined MAC address 52:54:00:87:83:fb in network mk-old-k8s-version-191446
I0120 13:55:24.811104 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | unable to find current IP address of domain old-k8s-version-191446 in network mk-old-k8s-version-191446
I0120 13:55:24.811167 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | I0120 13:55:24.811087 1967192 retry.go:31] will retry after 663.611218ms: waiting for domain to come up
I0120 13:55:25.476979 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has defined MAC address 52:54:00:87:83:fb in network mk-old-k8s-version-191446
I0120 13:55:25.477492 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | unable to find current IP address of domain old-k8s-version-191446 in network mk-old-k8s-version-191446
I0120 13:55:25.477528 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | I0120 13:55:25.477418 1967192 retry.go:31] will retry after 614.952298ms: waiting for domain to come up
I0120 13:55:26.093830 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has defined MAC address 52:54:00:87:83:fb in network mk-old-k8s-version-191446
I0120 13:55:26.094396 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | unable to find current IP address of domain old-k8s-version-191446 in network mk-old-k8s-version-191446
I0120 13:55:26.094516 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | I0120 13:55:26.094397 1967192 retry.go:31] will retry after 943.092022ms: waiting for domain to come up
I0120 13:55:27.039257 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has defined MAC address 52:54:00:87:83:fb in network mk-old-k8s-version-191446
I0120 13:55:27.040125 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | unable to find current IP address of domain old-k8s-version-191446 in network mk-old-k8s-version-191446
I0120 13:55:27.040152 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | I0120 13:55:27.040017 1967192 retry.go:31] will retry after 1.0450906s: waiting for domain to come up
I0120 13:55:28.087226 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has defined MAC address 52:54:00:87:83:fb in network mk-old-k8s-version-191446
I0120 13:55:28.087782 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | unable to find current IP address of domain old-k8s-version-191446 in network mk-old-k8s-version-191446
I0120 13:55:28.087876 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | I0120 13:55:28.087754 1967192 retry.go:31] will retry after 1.431088334s: waiting for domain to come up
I0120 13:55:29.521550 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has defined MAC address 52:54:00:87:83:fb in network mk-old-k8s-version-191446
I0120 13:55:29.522064 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | unable to find current IP address of domain old-k8s-version-191446 in network mk-old-k8s-version-191446
I0120 13:55:29.522093 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | I0120 13:55:29.522031 1967192 retry.go:31] will retry after 2.048834536s: waiting for domain to come up
I0120 13:55:31.572846 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has defined MAC address 52:54:00:87:83:fb in network mk-old-k8s-version-191446
I0120 13:55:31.573338 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | unable to find current IP address of domain old-k8s-version-191446 in network mk-old-k8s-version-191446
I0120 13:55:31.573377 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | I0120 13:55:31.573275 1967192 retry.go:31] will retry after 2.482933591s: waiting for domain to come up
I0120 13:55:34.059144 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has defined MAC address 52:54:00:87:83:fb in network mk-old-k8s-version-191446
I0120 13:55:34.059787 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | unable to find current IP address of domain old-k8s-version-191446 in network mk-old-k8s-version-191446
I0120 13:55:34.059820 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | I0120 13:55:34.059724 1967192 retry.go:31] will retry after 3.566613542s: waiting for domain to come up
I0120 13:55:37.628495 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has defined MAC address 52:54:00:87:83:fb in network mk-old-k8s-version-191446
I0120 13:55:37.629189 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | unable to find current IP address of domain old-k8s-version-191446 in network mk-old-k8s-version-191446
I0120 13:55:37.629220 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | I0120 13:55:37.629151 1967192 retry.go:31] will retry after 3.209411081s: waiting for domain to come up
I0120 13:55:40.842831 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has defined MAC address 52:54:00:87:83:fb in network mk-old-k8s-version-191446
I0120 13:55:40.843428 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | unable to find current IP address of domain old-k8s-version-191446 in network mk-old-k8s-version-191446
I0120 13:55:40.843463 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | I0120 13:55:40.843376 1967192 retry.go:31] will retry after 3.808564501s: waiting for domain to come up
I0120 13:55:44.655971 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has defined MAC address 52:54:00:87:83:fb in network mk-old-k8s-version-191446
I0120 13:55:44.656646 1967169 main.go:141] libmachine: (old-k8s-version-191446) found domain IP: 192.168.61.215
I0120 13:55:44.656683 1967169 main.go:141] libmachine: (old-k8s-version-191446) reserving static IP address...
I0120 13:55:44.656701 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has current primary IP address 192.168.61.215 and MAC address 52:54:00:87:83:fb in network mk-old-k8s-version-191446
I0120 13:55:44.657092 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-191446", mac: "52:54:00:87:83:fb", ip: "192.168.61.215"} in network mk-old-k8s-version-191446
I0120 13:55:44.743055 1967169 main.go:141] libmachine: (old-k8s-version-191446) reserved static IP address 192.168.61.215 for domain old-k8s-version-191446
I0120 13:55:44.743089 1967169 main.go:141] libmachine: (old-k8s-version-191446) waiting for SSH...
I0120 13:55:44.743099 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | Getting to WaitForSSH function...
I0120 13:55:44.746222 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has defined MAC address 52:54:00:87:83:fb in network mk-old-k8s-version-191446
I0120 13:55:44.746752 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:87:83:fb", ip: ""} in network mk-old-k8s-version-191446: {Iface:virbr3 ExpiryTime:2025-01-20 14:55:37 +0000 UTC Type:0 Mac:52:54:00:87:83:fb Iaid: IPaddr:192.168.61.215 Prefix:24 Hostname:minikube Clientid:01:52:54:00:87:83:fb}
I0120 13:55:44.746779 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has defined IP address 192.168.61.215 and MAC address 52:54:00:87:83:fb in network mk-old-k8s-version-191446
I0120 13:55:44.746948 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | Using SSH client type: external
I0120 13:55:44.746977 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | Using SSH private key: /home/jenkins/minikube-integration/20242-1920423/.minikube/machines/old-k8s-version-191446/id_rsa (-rw-------)
I0120 13:55:44.747018 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.61.215 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/20242-1920423/.minikube/machines/old-k8s-version-191446/id_rsa -p 22] /usr/bin/ssh <nil>}
I0120 13:55:44.747030 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | About to run SSH command:
I0120 13:55:44.747043 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | exit 0
I0120 13:55:44.883554 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | SSH cmd err, output: <nil>:
I0120 13:55:44.883783 1967169 main.go:141] libmachine: (old-k8s-version-191446) KVM machine creation complete
I0120 13:55:44.884199 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetConfigRaw
I0120 13:55:44.884780 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .DriverName
I0120 13:55:44.884966 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .DriverName
I0120 13:55:44.885115 1967169 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0120 13:55:44.885126 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetState
I0120 13:55:44.886648 1967169 main.go:141] libmachine: Detecting operating system of created instance...
I0120 13:55:44.886665 1967169 main.go:141] libmachine: Waiting for SSH to be available...
I0120 13:55:44.886671 1967169 main.go:141] libmachine: Getting to WaitForSSH function...
I0120 13:55:44.886677 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetSSHHostname
I0120 13:55:44.889008 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has defined MAC address 52:54:00:87:83:fb in network mk-old-k8s-version-191446
I0120 13:55:44.889393 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:87:83:fb", ip: ""} in network mk-old-k8s-version-191446: {Iface:virbr3 ExpiryTime:2025-01-20 14:55:37 +0000 UTC Type:0 Mac:52:54:00:87:83:fb Iaid: IPaddr:192.168.61.215 Prefix:24 Hostname:old-k8s-version-191446 Clientid:01:52:54:00:87:83:fb}
I0120 13:55:44.889418 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has defined IP address 192.168.61.215 and MAC address 52:54:00:87:83:fb in network mk-old-k8s-version-191446
I0120 13:55:44.889552 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetSSHPort
I0120 13:55:44.889759 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetSSHKeyPath
I0120 13:55:44.889947 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetSSHKeyPath
I0120 13:55:44.890111 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetSSHUsername
I0120 13:55:44.890331 1967169 main.go:141] libmachine: Using SSH client type: native
I0120 13:55:44.890533 1967169 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.61.215 22 <nil> <nil>}
I0120 13:55:44.890543 1967169 main.go:141] libmachine: About to run SSH command:
exit 0
I0120 13:55:45.010109 1967169 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0120 13:55:45.010142 1967169 main.go:141] libmachine: Detecting the provisioner...
I0120 13:55:45.010155 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetSSHHostname
I0120 13:55:45.013119 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has defined MAC address 52:54:00:87:83:fb in network mk-old-k8s-version-191446
I0120 13:55:45.013436 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:87:83:fb", ip: ""} in network mk-old-k8s-version-191446: {Iface:virbr3 ExpiryTime:2025-01-20 14:55:37 +0000 UTC Type:0 Mac:52:54:00:87:83:fb Iaid: IPaddr:192.168.61.215 Prefix:24 Hostname:old-k8s-version-191446 Clientid:01:52:54:00:87:83:fb}
I0120 13:55:45.013469 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has defined IP address 192.168.61.215 and MAC address 52:54:00:87:83:fb in network mk-old-k8s-version-191446
I0120 13:55:45.013654 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetSSHPort
I0120 13:55:45.013841 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetSSHKeyPath
I0120 13:55:45.014027 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetSSHKeyPath
I0120 13:55:45.014188 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetSSHUsername
I0120 13:55:45.014357 1967169 main.go:141] libmachine: Using SSH client type: native
I0120 13:55:45.014534 1967169 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.61.215 22 <nil> <nil>}
I0120 13:55:45.014545 1967169 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0120 13:55:45.136077 1967169 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0120 13:55:45.136172 1967169 main.go:141] libmachine: found compatible host: buildroot
I0120 13:55:45.136199 1967169 main.go:141] libmachine: Provisioning with buildroot...
I0120 13:55:45.136221 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetMachineName
I0120 13:55:45.136482 1967169 buildroot.go:166] provisioning hostname "old-k8s-version-191446"
I0120 13:55:45.136519 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetMachineName
I0120 13:55:45.136705 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetSSHHostname
I0120 13:55:45.139694 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has defined MAC address 52:54:00:87:83:fb in network mk-old-k8s-version-191446
I0120 13:55:45.140217 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:87:83:fb", ip: ""} in network mk-old-k8s-version-191446: {Iface:virbr3 ExpiryTime:2025-01-20 14:55:37 +0000 UTC Type:0 Mac:52:54:00:87:83:fb Iaid: IPaddr:192.168.61.215 Prefix:24 Hostname:old-k8s-version-191446 Clientid:01:52:54:00:87:83:fb}
I0120 13:55:45.140250 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has defined IP address 192.168.61.215 and MAC address 52:54:00:87:83:fb in network mk-old-k8s-version-191446
I0120 13:55:45.140467 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetSSHPort
I0120 13:55:45.140672 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetSSHKeyPath
I0120 13:55:45.140869 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetSSHKeyPath
I0120 13:55:45.141080 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetSSHUsername
I0120 13:55:45.141303 1967169 main.go:141] libmachine: Using SSH client type: native
I0120 13:55:45.141515 1967169 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.61.215 22 <nil> <nil>}
I0120 13:55:45.141535 1967169 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-191446 && echo "old-k8s-version-191446" | sudo tee /etc/hostname
I0120 13:55:45.284653 1967169 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-191446
I0120 13:55:45.284691 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetSSHHostname
I0120 13:55:45.288413 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has defined MAC address 52:54:00:87:83:fb in network mk-old-k8s-version-191446
I0120 13:55:45.288917 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:87:83:fb", ip: ""} in network mk-old-k8s-version-191446: {Iface:virbr3 ExpiryTime:2025-01-20 14:55:37 +0000 UTC Type:0 Mac:52:54:00:87:83:fb Iaid: IPaddr:192.168.61.215 Prefix:24 Hostname:old-k8s-version-191446 Clientid:01:52:54:00:87:83:fb}
I0120 13:55:45.288942 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has defined IP address 192.168.61.215 and MAC address 52:54:00:87:83:fb in network mk-old-k8s-version-191446
I0120 13:55:45.289204 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetSSHPort
I0120 13:55:45.289448 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetSSHKeyPath
I0120 13:55:45.289633 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetSSHKeyPath
I0120 13:55:45.289799 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetSSHUsername
I0120 13:55:45.289994 1967169 main.go:141] libmachine: Using SSH client type: native
I0120 13:55:45.290272 1967169 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.61.215 22 <nil> <nil>}
I0120 13:55:45.290299 1967169 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-191446' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-191446/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-191446' | sudo tee -a /etc/hosts;
fi
fi
I0120 13:55:45.421857 1967169 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0120 13:55:45.421892 1967169 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/20242-1920423/.minikube CaCertPath:/home/jenkins/minikube-integration/20242-1920423/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20242-1920423/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20242-1920423/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20242-1920423/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20242-1920423/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20242-1920423/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20242-1920423/.minikube}
I0120 13:55:45.421940 1967169 buildroot.go:174] setting up certificates
I0120 13:55:45.421953 1967169 provision.go:84] configureAuth start
I0120 13:55:45.421974 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetMachineName
I0120 13:55:45.422329 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetIP
I0120 13:55:45.425649 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has defined MAC address 52:54:00:87:83:fb in network mk-old-k8s-version-191446
I0120 13:55:45.426006 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:87:83:fb", ip: ""} in network mk-old-k8s-version-191446: {Iface:virbr3 ExpiryTime:2025-01-20 14:55:37 +0000 UTC Type:0 Mac:52:54:00:87:83:fb Iaid: IPaddr:192.168.61.215 Prefix:24 Hostname:old-k8s-version-191446 Clientid:01:52:54:00:87:83:fb}
I0120 13:55:45.426037 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has defined IP address 192.168.61.215 and MAC address 52:54:00:87:83:fb in network mk-old-k8s-version-191446
I0120 13:55:45.426301 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetSSHHostname
I0120 13:55:45.429044 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has defined MAC address 52:54:00:87:83:fb in network mk-old-k8s-version-191446
I0120 13:55:45.429408 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:87:83:fb", ip: ""} in network mk-old-k8s-version-191446: {Iface:virbr3 ExpiryTime:2025-01-20 14:55:37 +0000 UTC Type:0 Mac:52:54:00:87:83:fb Iaid: IPaddr:192.168.61.215 Prefix:24 Hostname:old-k8s-version-191446 Clientid:01:52:54:00:87:83:fb}
I0120 13:55:45.429441 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has defined IP address 192.168.61.215 and MAC address 52:54:00:87:83:fb in network mk-old-k8s-version-191446
I0120 13:55:45.429635 1967169 provision.go:143] copyHostCerts
I0120 13:55:45.429713 1967169 exec_runner.go:144] found /home/jenkins/minikube-integration/20242-1920423/.minikube/ca.pem, removing ...
I0120 13:55:45.429742 1967169 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20242-1920423/.minikube/ca.pem
I0120 13:55:45.429813 1967169 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20242-1920423/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20242-1920423/.minikube/ca.pem (1082 bytes)
I0120 13:55:45.429949 1967169 exec_runner.go:144] found /home/jenkins/minikube-integration/20242-1920423/.minikube/cert.pem, removing ...
I0120 13:55:45.429960 1967169 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20242-1920423/.minikube/cert.pem
I0120 13:55:45.429983 1967169 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20242-1920423/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20242-1920423/.minikube/cert.pem (1123 bytes)
I0120 13:55:45.430049 1967169 exec_runner.go:144] found /home/jenkins/minikube-integration/20242-1920423/.minikube/key.pem, removing ...
I0120 13:55:45.430057 1967169 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20242-1920423/.minikube/key.pem
I0120 13:55:45.430079 1967169 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20242-1920423/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20242-1920423/.minikube/key.pem (1679 bytes)
I0120 13:55:45.430191 1967169 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20242-1920423/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20242-1920423/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20242-1920423/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-191446 san=[127.0.0.1 192.168.61.215 localhost minikube old-k8s-version-191446]
I0120 13:55:45.758693 1967169 provision.go:177] copyRemoteCerts
I0120 13:55:45.758766 1967169 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0120 13:55:45.758791 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetSSHHostname
I0120 13:55:45.762004 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has defined MAC address 52:54:00:87:83:fb in network mk-old-k8s-version-191446
I0120 13:55:45.762491 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:87:83:fb", ip: ""} in network mk-old-k8s-version-191446: {Iface:virbr3 ExpiryTime:2025-01-20 14:55:37 +0000 UTC Type:0 Mac:52:54:00:87:83:fb Iaid: IPaddr:192.168.61.215 Prefix:24 Hostname:old-k8s-version-191446 Clientid:01:52:54:00:87:83:fb}
I0120 13:55:45.762535 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has defined IP address 192.168.61.215 and MAC address 52:54:00:87:83:fb in network mk-old-k8s-version-191446
I0120 13:55:45.762744 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetSSHPort
I0120 13:55:45.762963 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetSSHKeyPath
I0120 13:55:45.763134 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetSSHUsername
I0120 13:55:45.763321 1967169 sshutil.go:53] new ssh client: &{IP:192.168.61.215 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20242-1920423/.minikube/machines/old-k8s-version-191446/id_rsa Username:docker}
I0120 13:55:45.855104 1967169 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20242-1920423/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0120 13:55:45.884267 1967169 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20242-1920423/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0120 13:55:45.913054 1967169 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20242-1920423/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0120 13:55:45.941084 1967169 provision.go:87] duration metric: took 519.109687ms to configureAuth
I0120 13:55:45.941107 1967169 buildroot.go:189] setting minikube options for container-runtime
I0120 13:55:45.941318 1967169 config.go:182] Loaded profile config "old-k8s-version-191446": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0120 13:55:45.941413 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetSSHHostname
I0120 13:55:45.944292 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has defined MAC address 52:54:00:87:83:fb in network mk-old-k8s-version-191446
I0120 13:55:45.944658 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:87:83:fb", ip: ""} in network mk-old-k8s-version-191446: {Iface:virbr3 ExpiryTime:2025-01-20 14:55:37 +0000 UTC Type:0 Mac:52:54:00:87:83:fb Iaid: IPaddr:192.168.61.215 Prefix:24 Hostname:old-k8s-version-191446 Clientid:01:52:54:00:87:83:fb}
I0120 13:55:45.944691 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has defined IP address 192.168.61.215 and MAC address 52:54:00:87:83:fb in network mk-old-k8s-version-191446
I0120 13:55:45.944902 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetSSHPort
I0120 13:55:45.945168 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetSSHKeyPath
I0120 13:55:45.945392 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetSSHKeyPath
I0120 13:55:45.945568 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetSSHUsername
I0120 13:55:45.945771 1967169 main.go:141] libmachine: Using SSH client type: native
I0120 13:55:45.946026 1967169 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.61.215 22 <nil> <nil>}
I0120 13:55:45.946054 1967169 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0120 13:55:46.206287 1967169 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0120 13:55:46.206320 1967169 main.go:141] libmachine: Checking connection to Docker...
I0120 13:55:46.206328 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetURL
I0120 13:55:46.207694 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | using libvirt version 6000000
I0120 13:55:46.210177 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has defined MAC address 52:54:00:87:83:fb in network mk-old-k8s-version-191446
I0120 13:55:46.210668 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:87:83:fb", ip: ""} in network mk-old-k8s-version-191446: {Iface:virbr3 ExpiryTime:2025-01-20 14:55:37 +0000 UTC Type:0 Mac:52:54:00:87:83:fb Iaid: IPaddr:192.168.61.215 Prefix:24 Hostname:old-k8s-version-191446 Clientid:01:52:54:00:87:83:fb}
I0120 13:55:46.210701 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has defined IP address 192.168.61.215 and MAC address 52:54:00:87:83:fb in network mk-old-k8s-version-191446
I0120 13:55:46.210880 1967169 main.go:141] libmachine: Docker is up and running!
I0120 13:55:46.210895 1967169 main.go:141] libmachine: Reticulating splines...
I0120 13:55:46.210903 1967169 client.go:171] duration metric: took 24.902825178s to LocalClient.Create
I0120 13:55:46.210935 1967169 start.go:167] duration metric: took 24.902910498s to libmachine.API.Create "old-k8s-version-191446"
I0120 13:55:46.210951 1967169 start.go:293] postStartSetup for "old-k8s-version-191446" (driver="kvm2")
I0120 13:55:46.210964 1967169 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0120 13:55:46.210988 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .DriverName
I0120 13:55:46.211266 1967169 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0120 13:55:46.211296 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetSSHHostname
I0120 13:55:46.213485 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has defined MAC address 52:54:00:87:83:fb in network mk-old-k8s-version-191446
I0120 13:55:46.213863 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:87:83:fb", ip: ""} in network mk-old-k8s-version-191446: {Iface:virbr3 ExpiryTime:2025-01-20 14:55:37 +0000 UTC Type:0 Mac:52:54:00:87:83:fb Iaid: IPaddr:192.168.61.215 Prefix:24 Hostname:old-k8s-version-191446 Clientid:01:52:54:00:87:83:fb}
I0120 13:55:46.213894 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has defined IP address 192.168.61.215 and MAC address 52:54:00:87:83:fb in network mk-old-k8s-version-191446
I0120 13:55:46.214078 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetSSHPort
I0120 13:55:46.214286 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetSSHKeyPath
I0120 13:55:46.214437 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetSSHUsername
I0120 13:55:46.214551 1967169 sshutil.go:53] new ssh client: &{IP:192.168.61.215 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20242-1920423/.minikube/machines/old-k8s-version-191446/id_rsa Username:docker}
I0120 13:55:46.302392 1967169 ssh_runner.go:195] Run: cat /etc/os-release
I0120 13:55:46.308404 1967169 info.go:137] Remote host: Buildroot 2023.02.9
I0120 13:55:46.308440 1967169 filesync.go:126] Scanning /home/jenkins/minikube-integration/20242-1920423/.minikube/addons for local assets ...
I0120 13:55:46.308523 1967169 filesync.go:126] Scanning /home/jenkins/minikube-integration/20242-1920423/.minikube/files for local assets ...
I0120 13:55:46.308660 1967169 filesync.go:149] local asset: /home/jenkins/minikube-integration/20242-1920423/.minikube/files/etc/ssl/certs/19276722.pem -> 19276722.pem in /etc/ssl/certs
I0120 13:55:46.308807 1967169 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0120 13:55:46.322304 1967169 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20242-1920423/.minikube/files/etc/ssl/certs/19276722.pem --> /etc/ssl/certs/19276722.pem (1708 bytes)
I0120 13:55:46.352970 1967169 start.go:296] duration metric: took 142.001414ms for postStartSetup
I0120 13:55:46.353043 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetConfigRaw
I0120 13:55:46.353809 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetIP
I0120 13:55:46.356572 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has defined MAC address 52:54:00:87:83:fb in network mk-old-k8s-version-191446
I0120 13:55:46.357071 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:87:83:fb", ip: ""} in network mk-old-k8s-version-191446: {Iface:virbr3 ExpiryTime:2025-01-20 14:55:37 +0000 UTC Type:0 Mac:52:54:00:87:83:fb Iaid: IPaddr:192.168.61.215 Prefix:24 Hostname:old-k8s-version-191446 Clientid:01:52:54:00:87:83:fb}
I0120 13:55:46.357121 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has defined IP address 192.168.61.215 and MAC address 52:54:00:87:83:fb in network mk-old-k8s-version-191446
I0120 13:55:46.357354 1967169 profile.go:143] Saving config to /home/jenkins/minikube-integration/20242-1920423/.minikube/profiles/old-k8s-version-191446/config.json ...
I0120 13:55:46.357580 1967169 start.go:128] duration metric: took 25.073511866s to createHost
I0120 13:55:46.357621 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetSSHHostname
I0120 13:55:46.360046 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has defined MAC address 52:54:00:87:83:fb in network mk-old-k8s-version-191446
I0120 13:55:46.360389 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:87:83:fb", ip: ""} in network mk-old-k8s-version-191446: {Iface:virbr3 ExpiryTime:2025-01-20 14:55:37 +0000 UTC Type:0 Mac:52:54:00:87:83:fb Iaid: IPaddr:192.168.61.215 Prefix:24 Hostname:old-k8s-version-191446 Clientid:01:52:54:00:87:83:fb}
I0120 13:55:46.360420 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has defined IP address 192.168.61.215 and MAC address 52:54:00:87:83:fb in network mk-old-k8s-version-191446
I0120 13:55:46.360564 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetSSHPort
I0120 13:55:46.360773 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetSSHKeyPath
I0120 13:55:46.360975 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetSSHKeyPath
I0120 13:55:46.361139 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetSSHUsername
I0120 13:55:46.361316 1967169 main.go:141] libmachine: Using SSH client type: native
I0120 13:55:46.361563 1967169 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.61.215 22 <nil> <nil>}
I0120 13:55:46.361580 1967169 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0120 13:55:46.489339 1967169 main.go:141] libmachine: SSH cmd err, output: <nil>: 1737381346.461371584
I0120 13:55:46.489368 1967169 fix.go:216] guest clock: 1737381346.461371584
I0120 13:55:46.489377 1967169 fix.go:229] Guest: 2025-01-20 13:55:46.461371584 +0000 UTC Remote: 2025-01-20 13:55:46.357605867 +0000 UTC m=+26.228395931 (delta=103.765717ms)
I0120 13:55:46.489397 1967169 fix.go:200] guest clock delta is within tolerance: 103.765717ms
I0120 13:55:46.489402 1967169 start.go:83] releasing machines lock for "old-k8s-version-191446", held for 25.205545425s
I0120 13:55:46.489420 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .DriverName
I0120 13:55:46.489733 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetIP
I0120 13:55:46.492703 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has defined MAC address 52:54:00:87:83:fb in network mk-old-k8s-version-191446
I0120 13:55:46.493058 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:87:83:fb", ip: ""} in network mk-old-k8s-version-191446: {Iface:virbr3 ExpiryTime:2025-01-20 14:55:37 +0000 UTC Type:0 Mac:52:54:00:87:83:fb Iaid: IPaddr:192.168.61.215 Prefix:24 Hostname:old-k8s-version-191446 Clientid:01:52:54:00:87:83:fb}
I0120 13:55:46.493097 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has defined IP address 192.168.61.215 and MAC address 52:54:00:87:83:fb in network mk-old-k8s-version-191446
I0120 13:55:46.493316 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .DriverName
I0120 13:55:46.493839 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .DriverName
I0120 13:55:46.494041 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .DriverName
I0120 13:55:46.494167 1967169 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0120 13:55:46.494233 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetSSHHostname
I0120 13:55:46.494370 1967169 ssh_runner.go:195] Run: cat /version.json
I0120 13:55:46.494401 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetSSHHostname
I0120 13:55:46.497184 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has defined MAC address 52:54:00:87:83:fb in network mk-old-k8s-version-191446
I0120 13:55:46.497560 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:87:83:fb", ip: ""} in network mk-old-k8s-version-191446: {Iface:virbr3 ExpiryTime:2025-01-20 14:55:37 +0000 UTC Type:0 Mac:52:54:00:87:83:fb Iaid: IPaddr:192.168.61.215 Prefix:24 Hostname:old-k8s-version-191446 Clientid:01:52:54:00:87:83:fb}
I0120 13:55:46.497607 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has defined IP address 192.168.61.215 and MAC address 52:54:00:87:83:fb in network mk-old-k8s-version-191446
I0120 13:55:46.497629 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has defined MAC address 52:54:00:87:83:fb in network mk-old-k8s-version-191446
I0120 13:55:46.497810 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetSSHPort
I0120 13:55:46.498009 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetSSHKeyPath
I0120 13:55:46.498104 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:87:83:fb", ip: ""} in network mk-old-k8s-version-191446: {Iface:virbr3 ExpiryTime:2025-01-20 14:55:37 +0000 UTC Type:0 Mac:52:54:00:87:83:fb Iaid: IPaddr:192.168.61.215 Prefix:24 Hostname:old-k8s-version-191446 Clientid:01:52:54:00:87:83:fb}
I0120 13:55:46.498130 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has defined IP address 192.168.61.215 and MAC address 52:54:00:87:83:fb in network mk-old-k8s-version-191446
I0120 13:55:46.498207 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetSSHUsername
I0120 13:55:46.498370 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetSSHPort
I0120 13:55:46.498395 1967169 sshutil.go:53] new ssh client: &{IP:192.168.61.215 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20242-1920423/.minikube/machines/old-k8s-version-191446/id_rsa Username:docker}
I0120 13:55:46.498571 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetSSHKeyPath
I0120 13:55:46.498744 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetSSHUsername
I0120 13:55:46.498936 1967169 sshutil.go:53] new ssh client: &{IP:192.168.61.215 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20242-1920423/.minikube/machines/old-k8s-version-191446/id_rsa Username:docker}
I0120 13:55:46.610777 1967169 ssh_runner.go:195] Run: systemctl --version
I0120 13:55:46.617858 1967169 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0120 13:55:46.783452 1967169 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0120 13:55:46.791725 1967169 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0120 13:55:46.791804 1967169 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0120 13:55:46.810879 1967169 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0120 13:55:46.810934 1967169 start.go:495] detecting cgroup driver to use...
I0120 13:55:46.811029 1967169 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0120 13:55:46.829634 1967169 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0120 13:55:46.845983 1967169 docker.go:217] disabling cri-docker service (if available) ...
I0120 13:55:46.846063 1967169 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0120 13:55:46.860973 1967169 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0120 13:55:46.876973 1967169 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0120 13:55:47.018539 1967169 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0120 13:55:47.204886 1967169 docker.go:233] disabling docker service ...
I0120 13:55:47.204970 1967169 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0120 13:55:47.225774 1967169 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0120 13:55:47.241075 1967169 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0120 13:55:47.404470 1967169 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0120 13:55:47.553180 1967169 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0120 13:55:47.568137 1967169 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0120 13:55:47.593495 1967169 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0120 13:55:47.593582 1967169 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0120 13:55:47.607749 1967169 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0120 13:55:47.607828 1967169 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0120 13:55:47.619966 1967169 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0120 13:55:47.632297 1967169 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0120 13:55:47.644352 1967169 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0120 13:55:47.656744 1967169 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0120 13:55:47.668220 1967169 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0120 13:55:47.668301 1967169 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0120 13:55:47.683386 1967169 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0120 13:55:47.694315 1967169 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0120 13:55:47.841072 1967169 ssh_runner.go:195] Run: sudo systemctl restart crio
I0120 13:55:47.958726 1967169 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0120 13:55:47.958812 1967169 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0120 13:55:47.965514 1967169 start.go:563] Will wait 60s for crictl version
I0120 13:55:47.965592 1967169 ssh_runner.go:195] Run: which crictl
I0120 13:55:47.970495 1967169 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0120 13:55:48.025267 1967169 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0120 13:55:48.025350 1967169 ssh_runner.go:195] Run: crio --version
I0120 13:55:48.067721 1967169 ssh_runner.go:195] Run: crio --version
I0120 13:55:48.104531 1967169 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0120 13:55:48.106124 1967169 main.go:141] libmachine: (old-k8s-version-191446) Calling .GetIP
I0120 13:55:48.109373 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has defined MAC address 52:54:00:87:83:fb in network mk-old-k8s-version-191446
I0120 13:55:48.109675 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:87:83:fb", ip: ""} in network mk-old-k8s-version-191446: {Iface:virbr3 ExpiryTime:2025-01-20 14:55:37 +0000 UTC Type:0 Mac:52:54:00:87:83:fb Iaid: IPaddr:192.168.61.215 Prefix:24 Hostname:old-k8s-version-191446 Clientid:01:52:54:00:87:83:fb}
I0120 13:55:48.109709 1967169 main.go:141] libmachine: (old-k8s-version-191446) DBG | domain old-k8s-version-191446 has defined IP address 192.168.61.215 and MAC address 52:54:00:87:83:fb in network mk-old-k8s-version-191446
I0120 13:55:48.110110 1967169 ssh_runner.go:195] Run: grep 192.168.61.1 host.minikube.internal$ /etc/hosts
I0120 13:55:48.115192 1967169 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.61.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0120 13:55:48.129915 1967169 kubeadm.go:883] updating cluster {Name:old-k8s-version-191446 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-191446 Namespace
:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.215 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror:
DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0120 13:55:48.130067 1967169 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0120 13:55:48.130132 1967169 ssh_runner.go:195] Run: sudo crictl images --output json
I0120 13:55:48.167000 1967169 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0120 13:55:48.167072 1967169 ssh_runner.go:195] Run: which lz4
I0120 13:55:48.173178 1967169 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0120 13:55:48.177808 1967169 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0120 13:55:48.177856 1967169 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20242-1920423/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0120 13:55:50.109502 1967169 crio.go:462] duration metric: took 1.936353737s to copy over tarball
I0120 13:55:50.109598 1967169 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0120 13:55:52.887879 1967169 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.778246279s)
I0120 13:55:52.887932 1967169 crio.go:469] duration metric: took 2.778386909s to extract the tarball
I0120 13:55:52.887952 1967169 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0120 13:55:52.932150 1967169 ssh_runner.go:195] Run: sudo crictl images --output json
I0120 13:55:53.005701 1967169 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0120 13:55:53.005737 1967169 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0120 13:55:53.005795 1967169 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0120 13:55:53.005830 1967169 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0120 13:55:53.005880 1967169 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0120 13:55:53.005920 1967169 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0120 13:55:53.005923 1967169 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0120 13:55:53.005990 1967169 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0120 13:55:53.006109 1967169 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0120 13:55:53.006163 1967169 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0120 13:55:53.007649 1967169 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0120 13:55:53.007675 1967169 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0120 13:55:53.007681 1967169 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0120 13:55:53.007654 1967169 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0120 13:55:53.007733 1967169 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0120 13:55:53.008050 1967169 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0120 13:55:53.008069 1967169 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0120 13:55:53.008117 1967169 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0120 13:55:53.189254 1967169 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0120 13:55:53.196469 1967169 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0120 13:55:53.203944 1967169 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0120 13:55:53.209191 1967169 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0120 13:55:53.214657 1967169 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0120 13:55:53.222953 1967169 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0120 13:55:53.266928 1967169 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0120 13:55:53.292483 1967169 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0120 13:55:53.292530 1967169 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0120 13:55:53.292585 1967169 ssh_runner.go:195] Run: which crictl
I0120 13:55:53.333536 1967169 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0120 13:55:53.333625 1967169 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0120 13:55:53.333700 1967169 ssh_runner.go:195] Run: which crictl
I0120 13:55:53.345481 1967169 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0120 13:55:53.345540 1967169 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0120 13:55:53.345614 1967169 ssh_runner.go:195] Run: which crictl
I0120 13:55:53.366064 1967169 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0120 13:55:53.366121 1967169 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0120 13:55:53.366173 1967169 ssh_runner.go:195] Run: which crictl
I0120 13:55:53.390452 1967169 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0120 13:55:53.390519 1967169 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0120 13:55:53.390574 1967169 ssh_runner.go:195] Run: which crictl
I0120 13:55:53.391047 1967169 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0120 13:55:53.391090 1967169 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0120 13:55:53.391134 1967169 ssh_runner.go:195] Run: which crictl
I0120 13:55:53.399622 1967169 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0120 13:55:53.399621 1967169 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0120 13:55:53.399732 1967169 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0120 13:55:53.399759 1967169 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0120 13:55:53.399793 1967169 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0120 13:55:53.399814 1967169 ssh_runner.go:195] Run: which crictl
I0120 13:55:53.399702 1967169 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0120 13:55:53.399836 1967169 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0120 13:55:53.399864 1967169 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0120 13:55:53.448217 1967169 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0120 13:55:53.541162 1967169 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0120 13:55:53.541267 1967169 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0120 13:55:53.578035 1967169 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0120 13:55:53.578235 1967169 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0120 13:55:53.578283 1967169 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0120 13:55:53.578339 1967169 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0120 13:55:53.578375 1967169 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0120 13:55:53.761174 1967169 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0120 13:55:53.761295 1967169 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0120 13:55:53.763633 1967169 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0120 13:55:53.763819 1967169 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0120 13:55:53.767617 1967169 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0120 13:55:53.768795 1967169 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0120 13:55:53.768815 1967169 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0120 13:55:53.922981 1967169 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20242-1920423/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0120 13:55:53.923041 1967169 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0120 13:55:53.923066 1967169 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20242-1920423/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0120 13:55:53.923104 1967169 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20242-1920423/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0120 13:55:53.923048 1967169 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20242-1920423/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0120 13:55:53.923171 1967169 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20242-1920423/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0120 13:55:53.928017 1967169 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20242-1920423/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0120 13:55:53.960449 1967169 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20242-1920423/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0120 13:55:53.960526 1967169 cache_images.go:92] duration metric: took 954.770041ms to LoadCachedImages
W0120 13:55:53.960615 1967169 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20242-1920423/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20242-1920423/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0: no such file or directory
I0120 13:55:53.960631 1967169 kubeadm.go:934] updating node { 192.168.61.215 8443 v1.20.0 crio true true} ...
I0120 13:55:53.960742 1967169 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-191446 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.61.215
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-191446 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0120 13:55:53.960840 1967169 ssh_runner.go:195] Run: crio config
I0120 13:55:54.016304 1967169 cni.go:84] Creating CNI manager for ""
I0120 13:55:54.016337 1967169 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0120 13:55:54.016351 1967169 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0120 13:55:54.016386 1967169 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.61.215 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-191446 NodeName:old-k8s-version-191446 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.61.215"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.61.215 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0120 13:55:54.016555 1967169 kubeadm.go:195] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.61.215
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-191446"
kubeletExtraArgs:
node-ip: 192.168.61.215
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.61.215"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0120 13:55:54.016639 1967169 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0120 13:55:54.027649 1967169 binaries.go:44] Found k8s binaries, skipping transfer
I0120 13:55:54.027737 1967169 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0120 13:55:54.039032 1967169 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0120 13:55:54.060472 1967169 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0120 13:55:54.080258 1967169 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0120 13:55:54.098811 1967169 ssh_runner.go:195] Run: grep 192.168.61.215 control-plane.minikube.internal$ /etc/hosts
I0120 13:55:54.102971 1967169 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.61.215 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0120 13:55:54.116688 1967169 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0120 13:55:54.241315 1967169 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0120 13:55:54.259847 1967169 certs.go:68] Setting up /home/jenkins/minikube-integration/20242-1920423/.minikube/profiles/old-k8s-version-191446 for IP: 192.168.61.215
I0120 13:55:54.259884 1967169 certs.go:194] generating shared ca certs ...
I0120 13:55:54.259907 1967169 certs.go:226] acquiring lock for ca certs: {Name:mk6a9e370987a20273940cc7fb21abf350c4ac33 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0120 13:55:54.260106 1967169 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20242-1920423/.minikube/ca.key
I0120 13:55:54.260173 1967169 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20242-1920423/.minikube/proxy-client-ca.key
I0120 13:55:54.260186 1967169 certs.go:256] generating profile certs ...
I0120 13:55:54.260273 1967169 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/20242-1920423/.minikube/profiles/old-k8s-version-191446/client.key
I0120 13:55:54.260305 1967169 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20242-1920423/.minikube/profiles/old-k8s-version-191446/client.crt with IP's: []
I0120 13:55:54.424028 1967169 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20242-1920423/.minikube/profiles/old-k8s-version-191446/client.crt ...
I0120 13:55:54.424062 1967169 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20242-1920423/.minikube/profiles/old-k8s-version-191446/client.crt: {Name:mke0251f3325ebccf5703d44cd3dcc21f864bde8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0120 13:55:54.424235 1967169 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20242-1920423/.minikube/profiles/old-k8s-version-191446/client.key ...
I0120 13:55:54.424262 1967169 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20242-1920423/.minikube/profiles/old-k8s-version-191446/client.key: {Name:mk0f932398796d42166e2f826db15634301007a0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0120 13:55:54.424348 1967169 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20242-1920423/.minikube/profiles/old-k8s-version-191446/apiserver.key.d5f4b946
I0120 13:55:54.424366 1967169 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20242-1920423/.minikube/profiles/old-k8s-version-191446/apiserver.crt.d5f4b946 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.61.215]
I0120 13:55:54.528608 1967169 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20242-1920423/.minikube/profiles/old-k8s-version-191446/apiserver.crt.d5f4b946 ...
I0120 13:55:54.528664 1967169 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20242-1920423/.minikube/profiles/old-k8s-version-191446/apiserver.crt.d5f4b946: {Name:mkc260c1f63803bc6c509c47b51b028dbca7a96d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0120 13:55:54.528871 1967169 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20242-1920423/.minikube/profiles/old-k8s-version-191446/apiserver.key.d5f4b946 ...
I0120 13:55:54.528897 1967169 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20242-1920423/.minikube/profiles/old-k8s-version-191446/apiserver.key.d5f4b946: {Name:mk82337a52da360ef09275cd7422ca144d430abe Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0120 13:55:54.529032 1967169 certs.go:381] copying /home/jenkins/minikube-integration/20242-1920423/.minikube/profiles/old-k8s-version-191446/apiserver.crt.d5f4b946 -> /home/jenkins/minikube-integration/20242-1920423/.minikube/profiles/old-k8s-version-191446/apiserver.crt
I0120 13:55:54.529119 1967169 certs.go:385] copying /home/jenkins/minikube-integration/20242-1920423/.minikube/profiles/old-k8s-version-191446/apiserver.key.d5f4b946 -> /home/jenkins/minikube-integration/20242-1920423/.minikube/profiles/old-k8s-version-191446/apiserver.key
I0120 13:55:54.529171 1967169 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/20242-1920423/.minikube/profiles/old-k8s-version-191446/proxy-client.key
I0120 13:55:54.529188 1967169 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20242-1920423/.minikube/profiles/old-k8s-version-191446/proxy-client.crt with IP's: []
I0120 13:55:54.719602 1967169 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20242-1920423/.minikube/profiles/old-k8s-version-191446/proxy-client.crt ...
I0120 13:55:54.719638 1967169 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20242-1920423/.minikube/profiles/old-k8s-version-191446/proxy-client.crt: {Name:mkf3ce825f6cd72ce46eca661cd2511ac9671553 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0120 13:55:54.719807 1967169 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20242-1920423/.minikube/profiles/old-k8s-version-191446/proxy-client.key ...
I0120 13:55:54.719819 1967169 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20242-1920423/.minikube/profiles/old-k8s-version-191446/proxy-client.key: {Name:mkaf55c3b3a106252e04b8678ffc4524aa447d63 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0120 13:55:54.719989 1967169 certs.go:484] found cert: /home/jenkins/minikube-integration/20242-1920423/.minikube/certs/1927672.pem (1338 bytes)
W0120 13:55:54.720025 1967169 certs.go:480] ignoring /home/jenkins/minikube-integration/20242-1920423/.minikube/certs/1927672_empty.pem, impossibly tiny 0 bytes
I0120 13:55:54.720036 1967169 certs.go:484] found cert: /home/jenkins/minikube-integration/20242-1920423/.minikube/certs/ca-key.pem (1675 bytes)
I0120 13:55:54.720058 1967169 certs.go:484] found cert: /home/jenkins/minikube-integration/20242-1920423/.minikube/certs/ca.pem (1082 bytes)
I0120 13:55:54.720091 1967169 certs.go:484] found cert: /home/jenkins/minikube-integration/20242-1920423/.minikube/certs/cert.pem (1123 bytes)
I0120 13:55:54.720113 1967169 certs.go:484] found cert: /home/jenkins/minikube-integration/20242-1920423/.minikube/certs/key.pem (1679 bytes)
I0120 13:55:54.720150 1967169 certs.go:484] found cert: /home/jenkins/minikube-integration/20242-1920423/.minikube/files/etc/ssl/certs/19276722.pem (1708 bytes)
I0120 13:55:54.720731 1967169 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20242-1920423/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0120 13:55:54.751090 1967169 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20242-1920423/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0120 13:55:54.777838 1967169 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20242-1920423/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0120 13:55:54.805905 1967169 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20242-1920423/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0120 13:55:54.834241 1967169 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20242-1920423/.minikube/profiles/old-k8s-version-191446/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0120 13:55:54.861649 1967169 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20242-1920423/.minikube/profiles/old-k8s-version-191446/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0120 13:55:54.886615 1967169 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20242-1920423/.minikube/profiles/old-k8s-version-191446/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0120 13:55:54.911366 1967169 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20242-1920423/.minikube/profiles/old-k8s-version-191446/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0120 13:55:54.939666 1967169 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20242-1920423/.minikube/files/etc/ssl/certs/19276722.pem --> /usr/share/ca-certificates/19276722.pem (1708 bytes)
I0120 13:55:54.968638 1967169 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20242-1920423/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0120 13:55:54.996570 1967169 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20242-1920423/.minikube/certs/1927672.pem --> /usr/share/ca-certificates/1927672.pem (1338 bytes)
I0120 13:55:55.021985 1967169 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0120 13:55:55.040483 1967169 ssh_runner.go:195] Run: openssl version
I0120 13:55:55.047736 1967169 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/19276722.pem && ln -fs /usr/share/ca-certificates/19276722.pem /etc/ssl/certs/19276722.pem"
I0120 13:55:55.061013 1967169 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/19276722.pem
I0120 13:55:55.066001 1967169 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jan 20 12:58 /usr/share/ca-certificates/19276722.pem
I0120 13:55:55.066085 1967169 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/19276722.pem
I0120 13:55:55.073323 1967169 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/19276722.pem /etc/ssl/certs/3ec20f2e.0"
I0120 13:55:55.086044 1967169 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0120 13:55:55.100135 1967169 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0120 13:55:55.105253 1967169 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jan 20 12:50 /usr/share/ca-certificates/minikubeCA.pem
I0120 13:55:55.105331 1967169 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0120 13:55:55.111820 1967169 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0120 13:55:55.126336 1967169 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1927672.pem && ln -fs /usr/share/ca-certificates/1927672.pem /etc/ssl/certs/1927672.pem"
I0120 13:55:55.151222 1967169 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1927672.pem
I0120 13:55:55.156573 1967169 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jan 20 12:58 /usr/share/ca-certificates/1927672.pem
I0120 13:55:55.156652 1967169 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1927672.pem
I0120 13:55:55.165746 1967169 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1927672.pem /etc/ssl/certs/51391683.0"
I0120 13:55:55.180378 1967169 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0120 13:55:55.186067 1967169 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0120 13:55:55.186136 1967169 kubeadm.go:392] StartCluster: {Name:old-k8s-version-191446 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-191446 Namespace:de
fault APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.215 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Dis
ableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0120 13:55:55.186249 1967169 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0120 13:55:55.186313 1967169 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0120 13:55:55.250742 1967169 cri.go:89] found id: ""
I0120 13:55:55.250854 1967169 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0120 13:55:55.261938 1967169 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0120 13:55:55.272673 1967169 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0120 13:55:55.286422 1967169 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0120 13:55:55.286445 1967169 kubeadm.go:157] found existing configuration files:
I0120 13:55:55.286495 1967169 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0120 13:55:55.299224 1967169 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0120 13:55:55.299306 1967169 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0120 13:55:55.310999 1967169 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0120 13:55:55.321540 1967169 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0120 13:55:55.321622 1967169 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0120 13:55:55.332572 1967169 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0120 13:55:55.342908 1967169 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0120 13:55:55.342985 1967169 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0120 13:55:55.354234 1967169 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0120 13:55:55.364444 1967169 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0120 13:55:55.364523 1967169 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0120 13:55:55.374792 1967169 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0120 13:55:55.508776 1967169 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0120 13:55:55.508897 1967169 kubeadm.go:310] [preflight] Running pre-flight checks
I0120 13:55:55.682124 1967169 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0120 13:55:55.682297 1967169 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0120 13:55:55.682434 1967169 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0120 13:55:55.879174 1967169 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0120 13:55:55.913759 1967169 out.go:235] - Generating certificates and keys ...
I0120 13:55:55.913919 1967169 kubeadm.go:310] [certs] Using existing ca certificate authority
I0120 13:55:55.914063 1967169 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0120 13:55:55.964949 1967169 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0120 13:55:56.169230 1967169 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0120 13:55:56.457722 1967169 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0120 13:55:56.564071 1967169 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0120 13:55:56.880750 1967169 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0120 13:55:56.881011 1967169 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-191446] and IPs [192.168.61.215 127.0.0.1 ::1]
I0120 13:55:56.997232 1967169 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0120 13:55:56.997486 1967169 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-191446] and IPs [192.168.61.215 127.0.0.1 ::1]
I0120 13:55:57.211464 1967169 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0120 13:55:57.332749 1967169 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0120 13:55:57.619622 1967169 kubeadm.go:310] [certs] Generating "sa" key and public key
I0120 13:55:57.619730 1967169 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0120 13:55:57.732365 1967169 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0120 13:55:57.891441 1967169 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0120 13:55:58.227322 1967169 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0120 13:55:58.383446 1967169 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0120 13:55:58.405718 1967169 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0120 13:55:58.407987 1967169 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0120 13:55:58.408968 1967169 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0120 13:55:58.582866 1967169 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0120 13:55:58.584885 1967169 out.go:235] - Booting up control plane ...
I0120 13:55:58.585033 1967169 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0120 13:55:58.606804 1967169 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0120 13:55:58.609001 1967169 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0120 13:55:58.610443 1967169 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0120 13:55:58.618211 1967169 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0120 13:56:38.611982 1967169 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0120 13:56:38.612184 1967169 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0120 13:56:38.612486 1967169 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0120 13:56:43.613001 1967169 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0120 13:56:43.613227 1967169 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0120 13:56:53.612157 1967169 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0120 13:56:53.612420 1967169 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0120 13:57:13.611480 1967169 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0120 13:57:13.611724 1967169 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0120 13:57:53.615368 1967169 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0120 13:57:53.615647 1967169 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0120 13:57:53.615675 1967169 kubeadm.go:310]
I0120 13:57:53.615734 1967169 kubeadm.go:310] Unfortunately, an error has occurred:
I0120 13:57:53.615798 1967169 kubeadm.go:310] timed out waiting for the condition
I0120 13:57:53.615806 1967169 kubeadm.go:310]
I0120 13:57:53.615863 1967169 kubeadm.go:310] This error is likely caused by:
I0120 13:57:53.615924 1967169 kubeadm.go:310] - The kubelet is not running
I0120 13:57:53.616117 1967169 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0120 13:57:53.616131 1967169 kubeadm.go:310]
I0120 13:57:53.616269 1967169 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0120 13:57:53.616312 1967169 kubeadm.go:310] - 'systemctl status kubelet'
I0120 13:57:53.616354 1967169 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0120 13:57:53.616361 1967169 kubeadm.go:310]
I0120 13:57:53.616503 1967169 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0120 13:57:53.616646 1967169 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0120 13:57:53.616656 1967169 kubeadm.go:310]
I0120 13:57:53.616795 1967169 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0120 13:57:53.616921 1967169 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0120 13:57:53.617040 1967169 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0120 13:57:53.617137 1967169 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0120 13:57:53.617187 1967169 kubeadm.go:310]
I0120 13:57:53.617325 1967169 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0120 13:57:53.617445 1967169 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0120 13:57:53.617556 1967169 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
W0120 13:57:53.617721 1967169 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-191446] and IPs [192.168.61.215 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-191446] and IPs [192.168.61.215 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-191446] and IPs [192.168.61.215 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-191446] and IPs [192.168.61.215 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0120 13:57:53.617773 1967169 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0120 13:57:55.919261 1967169 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (2.301449355s)
I0120 13:57:55.919390 1967169 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0120 13:57:55.938129 1967169 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0120 13:57:55.952121 1967169 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0120 13:57:55.952146 1967169 kubeadm.go:157] found existing configuration files:
I0120 13:57:55.952201 1967169 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0120 13:57:55.964375 1967169 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0120 13:57:55.964438 1967169 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0120 13:57:55.975340 1967169 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0120 13:57:55.985132 1967169 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0120 13:57:55.985209 1967169 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0120 13:57:55.995645 1967169 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0120 13:57:56.006414 1967169 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0120 13:57:56.006493 1967169 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0120 13:57:56.021114 1967169 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0120 13:57:56.035115 1967169 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0120 13:57:56.035196 1967169 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0120 13:57:56.046387 1967169 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0120 13:57:56.120924 1967169 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0120 13:57:56.121016 1967169 kubeadm.go:310] [preflight] Running pre-flight checks
I0120 13:57:56.296535 1967169 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0120 13:57:56.296687 1967169 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0120 13:57:56.296833 1967169 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0120 13:57:56.528646 1967169 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0120 13:57:56.718656 1967169 out.go:235] - Generating certificates and keys ...
I0120 13:57:56.718810 1967169 kubeadm.go:310] [certs] Using existing ca certificate authority
I0120 13:57:56.718903 1967169 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0120 13:57:56.719022 1967169 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0120 13:57:56.719098 1967169 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0120 13:57:56.719229 1967169 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0120 13:57:56.719316 1967169 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0120 13:57:56.719402 1967169 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0120 13:57:56.719477 1967169 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0120 13:57:56.719580 1967169 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0120 13:57:56.719701 1967169 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0120 13:57:56.719760 1967169 kubeadm.go:310] [certs] Using the existing "sa" key
I0120 13:57:56.719849 1967169 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0120 13:57:56.719939 1967169 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0120 13:57:56.727755 1967169 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0120 13:57:56.942623 1967169 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0120 13:57:57.179596 1967169 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0120 13:57:57.197821 1967169 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0120 13:57:57.199025 1967169 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0120 13:57:57.199103 1967169 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0120 13:57:57.362184 1967169 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0120 13:57:57.416102 1967169 out.go:235] - Booting up control plane ...
I0120 13:57:57.416316 1967169 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0120 13:57:57.416452 1967169 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0120 13:57:57.416555 1967169 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0120 13:57:57.416662 1967169 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0120 13:57:57.416882 1967169 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0120 13:58:37.381488 1967169 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0120 13:58:37.381657 1967169 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0120 13:58:37.381965 1967169 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0120 13:58:42.383087 1967169 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0120 13:58:42.383314 1967169 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0120 13:58:52.384038 1967169 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0120 13:58:52.384291 1967169 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0120 13:59:12.383365 1967169 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0120 13:59:12.383652 1967169 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0120 13:59:52.383434 1967169 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0120 13:59:52.383693 1967169 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0120 13:59:52.383712 1967169 kubeadm.go:310]
I0120 13:59:52.383781 1967169 kubeadm.go:310] Unfortunately, an error has occurred:
I0120 13:59:52.383852 1967169 kubeadm.go:310] timed out waiting for the condition
I0120 13:59:52.383871 1967169 kubeadm.go:310]
I0120 13:59:52.383930 1967169 kubeadm.go:310] This error is likely caused by:
I0120 13:59:52.383996 1967169 kubeadm.go:310] - The kubelet is not running
I0120 13:59:52.384157 1967169 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0120 13:59:52.384168 1967169 kubeadm.go:310]
I0120 13:59:52.384356 1967169 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0120 13:59:52.384421 1967169 kubeadm.go:310] - 'systemctl status kubelet'
I0120 13:59:52.384469 1967169 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0120 13:59:52.384478 1967169 kubeadm.go:310]
I0120 13:59:52.384637 1967169 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0120 13:59:52.384773 1967169 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0120 13:59:52.384783 1967169 kubeadm.go:310]
I0120 13:59:52.384927 1967169 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0120 13:59:52.385057 1967169 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0120 13:59:52.385171 1967169 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0120 13:59:52.385286 1967169 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0120 13:59:52.385298 1967169 kubeadm.go:310]
I0120 13:59:52.386216 1967169 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0120 13:59:52.386337 1967169 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0120 13:59:52.386434 1967169 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0120 13:59:52.386513 1967169 kubeadm.go:394] duration metric: took 3m57.200382652s to StartCluster
I0120 13:59:52.386571 1967169 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0120 13:59:52.386663 1967169 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0120 13:59:52.445478 1967169 cri.go:89] found id: ""
I0120 13:59:52.445517 1967169 logs.go:282] 0 containers: []
W0120 13:59:52.445530 1967169 logs.go:284] No container was found matching "kube-apiserver"
I0120 13:59:52.445539 1967169 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0120 13:59:52.445615 1967169 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0120 13:59:52.496705 1967169 cri.go:89] found id: ""
I0120 13:59:52.496739 1967169 logs.go:282] 0 containers: []
W0120 13:59:52.496750 1967169 logs.go:284] No container was found matching "etcd"
I0120 13:59:52.496758 1967169 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0120 13:59:52.496835 1967169 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0120 13:59:52.542385 1967169 cri.go:89] found id: ""
I0120 13:59:52.542420 1967169 logs.go:282] 0 containers: []
W0120 13:59:52.542431 1967169 logs.go:284] No container was found matching "coredns"
I0120 13:59:52.542441 1967169 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0120 13:59:52.542518 1967169 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0120 13:59:52.586427 1967169 cri.go:89] found id: ""
I0120 13:59:52.586464 1967169 logs.go:282] 0 containers: []
W0120 13:59:52.586473 1967169 logs.go:284] No container was found matching "kube-scheduler"
I0120 13:59:52.586479 1967169 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0120 13:59:52.586541 1967169 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0120 13:59:52.625607 1967169 cri.go:89] found id: ""
I0120 13:59:52.625644 1967169 logs.go:282] 0 containers: []
W0120 13:59:52.625657 1967169 logs.go:284] No container was found matching "kube-proxy"
I0120 13:59:52.625667 1967169 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0120 13:59:52.625745 1967169 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0120 13:59:52.662132 1967169 cri.go:89] found id: ""
I0120 13:59:52.662169 1967169 logs.go:282] 0 containers: []
W0120 13:59:52.662181 1967169 logs.go:284] No container was found matching "kube-controller-manager"
I0120 13:59:52.662190 1967169 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0120 13:59:52.662259 1967169 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0120 13:59:52.708118 1967169 cri.go:89] found id: ""
I0120 13:59:52.708146 1967169 logs.go:282] 0 containers: []
W0120 13:59:52.708155 1967169 logs.go:284] No container was found matching "kindnet"
I0120 13:59:52.708166 1967169 logs.go:123] Gathering logs for kubelet ...
I0120 13:59:52.708183 1967169 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0120 13:59:52.759246 1967169 logs.go:123] Gathering logs for dmesg ...
I0120 13:59:52.759295 1967169 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0120 13:59:52.773898 1967169 logs.go:123] Gathering logs for describe nodes ...
I0120 13:59:52.773931 1967169 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0120 13:59:52.901102 1967169 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0120 13:59:52.901138 1967169 logs.go:123] Gathering logs for CRI-O ...
I0120 13:59:52.901160 1967169 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0120 13:59:53.005721 1967169 logs.go:123] Gathering logs for container status ...
I0120 13:59:53.005772 1967169 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0120 13:59:53.055174 1967169 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0120 13:59:53.055285 1967169 out.go:270] *
*
W0120 13:59:53.055379 1967169 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0120 13:59:53.055400 1967169 out.go:270] *
*
W0120 13:59:53.056316 1967169 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0120 13:59:53.059339 1967169 out.go:201]
W0120 13:59:53.060706 1967169 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0120 13:59:53.060751 1967169 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0120 13:59:53.060778 1967169 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0120 13:59:53.062591 1967169 out.go:201]
** /stderr **
start_stop_delete_test.go:186: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-191446 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-191446 -n old-k8s-version-191446
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-191446 -n old-k8s-version-191446: exit status 6 (268.502265ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0120 13:59:53.370350 1970308 status.go:458] kubeconfig endpoint: get endpoint: "old-k8s-version-191446" does not appear in /home/jenkins/minikube-integration/20242-1920423/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-191446" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (273.27s)