=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:184: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-510006 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
E0210 11:40:53.023562 116470 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20385-109271/.minikube/profiles/addons-176336/client.crt: no such file or directory" logger="UnhandledError"
start_stop_delete_test.go:184: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-510006 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m54.635527216s)
-- stdout --
* [old-k8s-version-510006] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=20385
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/20385-109271/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/20385-109271/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-510006" primary control-plane node in "old-k8s-version-510006" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0210 11:40:33.836746 166167 out.go:345] Setting OutFile to fd 1 ...
I0210 11:40:33.836847 166167 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0210 11:40:33.836858 166167 out.go:358] Setting ErrFile to fd 2...
I0210 11:40:33.836865 166167 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0210 11:40:33.837045 166167 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20385-109271/.minikube/bin
I0210 11:40:33.837684 166167 out.go:352] Setting JSON to false
I0210 11:40:33.838761 166167 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-9","uptime":8576,"bootTime":1739179058,"procs":300,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1075-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0210 11:40:33.838875 166167 start.go:139] virtualization: kvm guest
I0210 11:40:33.840932 166167 out.go:177] * [old-k8s-version-510006] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
I0210 11:40:33.842170 166167 out.go:177] - MINIKUBE_LOCATION=20385
I0210 11:40:33.842200 166167 notify.go:220] Checking for updates...
I0210 11:40:33.844559 166167 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0210 11:40:33.845725 166167 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/20385-109271/kubeconfig
I0210 11:40:33.846881 166167 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/20385-109271/.minikube
I0210 11:40:33.847978 166167 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0210 11:40:33.849154 166167 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0210 11:40:33.851093 166167 config.go:182] Loaded profile config "bridge-804475": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.1
I0210 11:40:33.851249 166167 config.go:182] Loaded profile config "flannel-804475": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.1
I0210 11:40:33.851382 166167 config.go:182] Loaded profile config "kubernetes-upgrade-557458": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.1
I0210 11:40:33.851509 166167 driver.go:394] Setting default libvirt URI to qemu:///system
I0210 11:40:33.890654 166167 out.go:177] * Using the kvm2 driver based on user configuration
I0210 11:40:33.891961 166167 start.go:297] selected driver: kvm2
I0210 11:40:33.891977 166167 start.go:901] validating driver "kvm2" against <nil>
I0210 11:40:33.891988 166167 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0210 11:40:33.892751 166167 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0210 11:40:33.892855 166167 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/20385-109271/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0210 11:40:33.911241 166167 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.35.0
I0210 11:40:33.911307 166167 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0210 11:40:33.911642 166167 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0210 11:40:33.911682 166167 cni.go:84] Creating CNI manager for ""
I0210 11:40:33.911742 166167 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0210 11:40:33.911755 166167 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0210 11:40:33.911839 166167 start.go:340] cluster config:
{Name:old-k8s-version-510006 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-510006 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRI
Socket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:
0 GPUs: AutoPauseInterval:1m0s}
I0210 11:40:33.911973 166167 iso.go:125] acquiring lock: {Name:mk479d49a84808a4b16be867aad83d1d3d802291 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0210 11:40:33.914057 166167 out.go:177] * Starting "old-k8s-version-510006" primary control-plane node in "old-k8s-version-510006" cluster
I0210 11:40:33.915294 166167 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0210 11:40:33.915329 166167 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20385-109271/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0210 11:40:33.915336 166167 cache.go:56] Caching tarball of preloaded images
I0210 11:40:33.915421 166167 preload.go:172] Found /home/jenkins/minikube-integration/20385-109271/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0210 11:40:33.915440 166167 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0210 11:40:33.915521 166167 profile.go:143] Saving config to /home/jenkins/minikube-integration/20385-109271/.minikube/profiles/old-k8s-version-510006/config.json ...
I0210 11:40:33.915538 166167 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20385-109271/.minikube/profiles/old-k8s-version-510006/config.json: {Name:mk754076024f66b063392bd8e7b86a0c5202ea5b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0210 11:40:33.915665 166167 start.go:360] acquireMachinesLock for old-k8s-version-510006: {Name:mke6c3a615c5915495f0682c0833d8830c2c1004 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0210 11:40:54.743764 166167 start.go:364] duration metric: took 20.828064323s to acquireMachinesLock for "old-k8s-version-510006"
I0210 11:40:54.743850 166167 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-510006 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-versi
on-510006 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMir
ror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0210 11:40:54.743993 166167 start.go:125] createHost starting for "" (driver="kvm2")
I0210 11:40:54.745767 166167 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0210 11:40:54.745976 166167 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0210 11:40:54.746018 166167 main.go:141] libmachine: Launching plugin server for driver kvm2
I0210 11:40:54.762803 166167 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34195
I0210 11:40:54.763211 166167 main.go:141] libmachine: () Calling .GetVersion
I0210 11:40:54.763849 166167 main.go:141] libmachine: Using API Version 1
I0210 11:40:54.763872 166167 main.go:141] libmachine: () Calling .SetConfigRaw
I0210 11:40:54.764204 166167 main.go:141] libmachine: () Calling .GetMachineName
I0210 11:40:54.764423 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetMachineName
I0210 11:40:54.764570 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .DriverName
I0210 11:40:54.764779 166167 start.go:159] libmachine.API.Create for "old-k8s-version-510006" (driver="kvm2")
I0210 11:40:54.764820 166167 client.go:168] LocalClient.Create starting
I0210 11:40:54.764860 166167 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20385-109271/.minikube/certs/ca.pem
I0210 11:40:54.764907 166167 main.go:141] libmachine: Decoding PEM data...
I0210 11:40:54.764928 166167 main.go:141] libmachine: Parsing certificate...
I0210 11:40:54.765003 166167 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20385-109271/.minikube/certs/cert.pem
I0210 11:40:54.765032 166167 main.go:141] libmachine: Decoding PEM data...
I0210 11:40:54.765046 166167 main.go:141] libmachine: Parsing certificate...
I0210 11:40:54.765059 166167 main.go:141] libmachine: Running pre-create checks...
I0210 11:40:54.765069 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .PreCreateCheck
I0210 11:40:54.765488 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetConfigRaw
I0210 11:40:54.765934 166167 main.go:141] libmachine: Creating machine...
I0210 11:40:54.765954 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .Create
I0210 11:40:54.766085 166167 main.go:141] libmachine: (old-k8s-version-510006) creating KVM machine...
I0210 11:40:54.766114 166167 main.go:141] libmachine: (old-k8s-version-510006) creating network...
I0210 11:40:54.767087 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | found existing default KVM network
I0210 11:40:54.768530 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | I0210 11:40:54.768372 166356 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:a0:37:f0} reservation:<nil>}
I0210 11:40:54.769367 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | I0210 11:40:54.769280 166356 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:da:f8:fc} reservation:<nil>}
I0210 11:40:54.770503 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | I0210 11:40:54.770401 166356 network.go:206] using free private subnet 192.168.61.0/24: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00026d620}
I0210 11:40:54.770528 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | created network xml:
I0210 11:40:54.770540 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | <network>
I0210 11:40:54.770561 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | <name>mk-old-k8s-version-510006</name>
I0210 11:40:54.770571 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | <dns enable='no'/>
I0210 11:40:54.770577 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG |
I0210 11:40:54.770599 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | <ip address='192.168.61.1' netmask='255.255.255.0'>
I0210 11:40:54.770635 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | <dhcp>
I0210 11:40:54.770648 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | <range start='192.168.61.2' end='192.168.61.253'/>
I0210 11:40:54.770655 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | </dhcp>
I0210 11:40:54.770661 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | </ip>
I0210 11:40:54.770665 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG |
I0210 11:40:54.770680 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | </network>
I0210 11:40:54.770687 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG |
I0210 11:40:54.775561 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | trying to create private KVM network mk-old-k8s-version-510006 192.168.61.0/24...
I0210 11:40:54.851626 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | private KVM network mk-old-k8s-version-510006 192.168.61.0/24 created
I0210 11:40:54.851660 166167 main.go:141] libmachine: (old-k8s-version-510006) setting up store path in /home/jenkins/minikube-integration/20385-109271/.minikube/machines/old-k8s-version-510006 ...
I0210 11:40:54.851674 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | I0210 11:40:54.851602 166356 common.go:144] Making disk image using store path: /home/jenkins/minikube-integration/20385-109271/.minikube
I0210 11:40:54.851691 166167 main.go:141] libmachine: (old-k8s-version-510006) building disk image from file:///home/jenkins/minikube-integration/20385-109271/.minikube/cache/iso/amd64/minikube-v1.35.0-amd64.iso
I0210 11:40:54.851815 166167 main.go:141] libmachine: (old-k8s-version-510006) Downloading /home/jenkins/minikube-integration/20385-109271/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/20385-109271/.minikube/cache/iso/amd64/minikube-v1.35.0-amd64.iso...
I0210 11:40:55.111266 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | I0210 11:40:55.111102 166356 common.go:151] Creating ssh key: /home/jenkins/minikube-integration/20385-109271/.minikube/machines/old-k8s-version-510006/id_rsa...
I0210 11:40:55.176624 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | I0210 11:40:55.176475 166356 common.go:157] Creating raw disk image: /home/jenkins/minikube-integration/20385-109271/.minikube/machines/old-k8s-version-510006/old-k8s-version-510006.rawdisk...
I0210 11:40:55.176662 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | Writing magic tar header
I0210 11:40:55.176680 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | Writing SSH key tar header
I0210 11:40:55.176693 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | I0210 11:40:55.176628 166356 common.go:171] Fixing permissions on /home/jenkins/minikube-integration/20385-109271/.minikube/machines/old-k8s-version-510006 ...
I0210 11:40:55.176784 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20385-109271/.minikube/machines/old-k8s-version-510006
I0210 11:40:55.176841 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20385-109271/.minikube/machines
I0210 11:40:55.176867 166167 main.go:141] libmachine: (old-k8s-version-510006) setting executable bit set on /home/jenkins/minikube-integration/20385-109271/.minikube/machines/old-k8s-version-510006 (perms=drwx------)
I0210 11:40:55.176894 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20385-109271/.minikube
I0210 11:40:55.176924 166167 main.go:141] libmachine: (old-k8s-version-510006) setting executable bit set on /home/jenkins/minikube-integration/20385-109271/.minikube/machines (perms=drwxr-xr-x)
I0210 11:40:55.176948 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20385-109271
I0210 11:40:55.176964 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | checking permissions on dir: /home/jenkins/minikube-integration
I0210 11:40:55.176977 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | checking permissions on dir: /home/jenkins
I0210 11:40:55.176988 166167 main.go:141] libmachine: (old-k8s-version-510006) setting executable bit set on /home/jenkins/minikube-integration/20385-109271/.minikube (perms=drwxr-xr-x)
I0210 11:40:55.177003 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | checking permissions on dir: /home
I0210 11:40:55.177013 166167 main.go:141] libmachine: (old-k8s-version-510006) setting executable bit set on /home/jenkins/minikube-integration/20385-109271 (perms=drwxrwxr-x)
I0210 11:40:55.177031 166167 main.go:141] libmachine: (old-k8s-version-510006) setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0210 11:40:55.177044 166167 main.go:141] libmachine: (old-k8s-version-510006) setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0210 11:40:55.177058 166167 main.go:141] libmachine: (old-k8s-version-510006) creating domain...
I0210 11:40:55.177069 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | skipping /home - not owner
I0210 11:40:55.178351 166167 main.go:141] libmachine: (old-k8s-version-510006) define libvirt domain using xml:
I0210 11:40:55.178373 166167 main.go:141] libmachine: (old-k8s-version-510006) <domain type='kvm'>
I0210 11:40:55.178384 166167 main.go:141] libmachine: (old-k8s-version-510006) <name>old-k8s-version-510006</name>
I0210 11:40:55.178392 166167 main.go:141] libmachine: (old-k8s-version-510006) <memory unit='MiB'>2200</memory>
I0210 11:40:55.178400 166167 main.go:141] libmachine: (old-k8s-version-510006) <vcpu>2</vcpu>
I0210 11:40:55.178426 166167 main.go:141] libmachine: (old-k8s-version-510006) <features>
I0210 11:40:55.178441 166167 main.go:141] libmachine: (old-k8s-version-510006) <acpi/>
I0210 11:40:55.178454 166167 main.go:141] libmachine: (old-k8s-version-510006) <apic/>
I0210 11:40:55.178465 166167 main.go:141] libmachine: (old-k8s-version-510006) <pae/>
I0210 11:40:55.178472 166167 main.go:141] libmachine: (old-k8s-version-510006)
I0210 11:40:55.178483 166167 main.go:141] libmachine: (old-k8s-version-510006) </features>
I0210 11:40:55.178491 166167 main.go:141] libmachine: (old-k8s-version-510006) <cpu mode='host-passthrough'>
I0210 11:40:55.178502 166167 main.go:141] libmachine: (old-k8s-version-510006)
I0210 11:40:55.178515 166167 main.go:141] libmachine: (old-k8s-version-510006) </cpu>
I0210 11:40:55.178523 166167 main.go:141] libmachine: (old-k8s-version-510006) <os>
I0210 11:40:55.178541 166167 main.go:141] libmachine: (old-k8s-version-510006) <type>hvm</type>
I0210 11:40:55.178567 166167 main.go:141] libmachine: (old-k8s-version-510006) <boot dev='cdrom'/>
I0210 11:40:55.178589 166167 main.go:141] libmachine: (old-k8s-version-510006) <boot dev='hd'/>
I0210 11:40:55.178601 166167 main.go:141] libmachine: (old-k8s-version-510006) <bootmenu enable='no'/>
I0210 11:40:55.178610 166167 main.go:141] libmachine: (old-k8s-version-510006) </os>
I0210 11:40:55.178617 166167 main.go:141] libmachine: (old-k8s-version-510006) <devices>
I0210 11:40:55.178630 166167 main.go:141] libmachine: (old-k8s-version-510006) <disk type='file' device='cdrom'>
I0210 11:40:55.178644 166167 main.go:141] libmachine: (old-k8s-version-510006) <source file='/home/jenkins/minikube-integration/20385-109271/.minikube/machines/old-k8s-version-510006/boot2docker.iso'/>
I0210 11:40:55.178664 166167 main.go:141] libmachine: (old-k8s-version-510006) <target dev='hdc' bus='scsi'/>
I0210 11:40:55.178680 166167 main.go:141] libmachine: (old-k8s-version-510006) <readonly/>
I0210 11:40:55.178714 166167 main.go:141] libmachine: (old-k8s-version-510006) </disk>
I0210 11:40:55.178734 166167 main.go:141] libmachine: (old-k8s-version-510006) <disk type='file' device='disk'>
I0210 11:40:55.178761 166167 main.go:141] libmachine: (old-k8s-version-510006) <driver name='qemu' type='raw' cache='default' io='threads' />
I0210 11:40:55.178778 166167 main.go:141] libmachine: (old-k8s-version-510006) <source file='/home/jenkins/minikube-integration/20385-109271/.minikube/machines/old-k8s-version-510006/old-k8s-version-510006.rawdisk'/>
I0210 11:40:55.178792 166167 main.go:141] libmachine: (old-k8s-version-510006) <target dev='hda' bus='virtio'/>
I0210 11:40:55.178803 166167 main.go:141] libmachine: (old-k8s-version-510006) </disk>
I0210 11:40:55.178816 166167 main.go:141] libmachine: (old-k8s-version-510006) <interface type='network'>
I0210 11:40:55.178829 166167 main.go:141] libmachine: (old-k8s-version-510006) <source network='mk-old-k8s-version-510006'/>
I0210 11:40:55.178842 166167 main.go:141] libmachine: (old-k8s-version-510006) <model type='virtio'/>
I0210 11:40:55.178852 166167 main.go:141] libmachine: (old-k8s-version-510006) </interface>
I0210 11:40:55.178862 166167 main.go:141] libmachine: (old-k8s-version-510006) <interface type='network'>
I0210 11:40:55.178874 166167 main.go:141] libmachine: (old-k8s-version-510006) <source network='default'/>
I0210 11:40:55.178884 166167 main.go:141] libmachine: (old-k8s-version-510006) <model type='virtio'/>
I0210 11:40:55.178894 166167 main.go:141] libmachine: (old-k8s-version-510006) </interface>
I0210 11:40:55.178904 166167 main.go:141] libmachine: (old-k8s-version-510006) <serial type='pty'>
I0210 11:40:55.178914 166167 main.go:141] libmachine: (old-k8s-version-510006) <target port='0'/>
I0210 11:40:55.178922 166167 main.go:141] libmachine: (old-k8s-version-510006) </serial>
I0210 11:40:55.178933 166167 main.go:141] libmachine: (old-k8s-version-510006) <console type='pty'>
I0210 11:40:55.178945 166167 main.go:141] libmachine: (old-k8s-version-510006) <target type='serial' port='0'/>
I0210 11:40:55.178956 166167 main.go:141] libmachine: (old-k8s-version-510006) </console>
I0210 11:40:55.178969 166167 main.go:141] libmachine: (old-k8s-version-510006) <rng model='virtio'>
I0210 11:40:55.178981 166167 main.go:141] libmachine: (old-k8s-version-510006) <backend model='random'>/dev/random</backend>
I0210 11:40:55.178990 166167 main.go:141] libmachine: (old-k8s-version-510006) </rng>
I0210 11:40:55.179000 166167 main.go:141] libmachine: (old-k8s-version-510006)
I0210 11:40:55.179008 166167 main.go:141] libmachine: (old-k8s-version-510006)
I0210 11:40:55.179018 166167 main.go:141] libmachine: (old-k8s-version-510006) </devices>
I0210 11:40:55.179026 166167 main.go:141] libmachine: (old-k8s-version-510006) </domain>
I0210 11:40:55.179035 166167 main.go:141] libmachine: (old-k8s-version-510006)
I0210 11:40:55.183970 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has defined MAC address 52:54:00:f1:bf:b8 in network default
I0210 11:40:55.184659 166167 main.go:141] libmachine: (old-k8s-version-510006) starting domain...
I0210 11:40:55.184681 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has defined MAC address 52:54:00:57:cc:39 in network mk-old-k8s-version-510006
I0210 11:40:55.184690 166167 main.go:141] libmachine: (old-k8s-version-510006) ensuring networks are active...
I0210 11:40:55.185492 166167 main.go:141] libmachine: (old-k8s-version-510006) Ensuring network default is active
I0210 11:40:55.185867 166167 main.go:141] libmachine: (old-k8s-version-510006) Ensuring network mk-old-k8s-version-510006 is active
I0210 11:40:55.186453 166167 main.go:141] libmachine: (old-k8s-version-510006) getting domain XML...
I0210 11:40:55.187329 166167 main.go:141] libmachine: (old-k8s-version-510006) creating domain...
I0210 11:40:56.766544 166167 main.go:141] libmachine: (old-k8s-version-510006) waiting for IP...
I0210 11:40:56.767626 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has defined MAC address 52:54:00:57:cc:39 in network mk-old-k8s-version-510006
I0210 11:40:56.768142 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | unable to find current IP address of domain old-k8s-version-510006 in network mk-old-k8s-version-510006
I0210 11:40:56.768214 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | I0210 11:40:56.768132 166356 retry.go:31] will retry after 276.457487ms: waiting for domain to come up
I0210 11:40:57.046927 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has defined MAC address 52:54:00:57:cc:39 in network mk-old-k8s-version-510006
I0210 11:40:57.047743 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | unable to find current IP address of domain old-k8s-version-510006 in network mk-old-k8s-version-510006
I0210 11:40:57.047767 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | I0210 11:40:57.047653 166356 retry.go:31] will retry after 313.855375ms: waiting for domain to come up
I0210 11:40:57.363765 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has defined MAC address 52:54:00:57:cc:39 in network mk-old-k8s-version-510006
I0210 11:40:57.364406 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | unable to find current IP address of domain old-k8s-version-510006 in network mk-old-k8s-version-510006
I0210 11:40:57.364432 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | I0210 11:40:57.364299 166356 retry.go:31] will retry after 332.646369ms: waiting for domain to come up
I0210 11:40:57.699062 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has defined MAC address 52:54:00:57:cc:39 in network mk-old-k8s-version-510006
I0210 11:40:57.699734 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | unable to find current IP address of domain old-k8s-version-510006 in network mk-old-k8s-version-510006
I0210 11:40:57.699765 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | I0210 11:40:57.699708 166356 retry.go:31] will retry after 553.723279ms: waiting for domain to come up
I0210 11:40:58.255647 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has defined MAC address 52:54:00:57:cc:39 in network mk-old-k8s-version-510006
I0210 11:40:58.256293 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | unable to find current IP address of domain old-k8s-version-510006 in network mk-old-k8s-version-510006
I0210 11:40:58.256321 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | I0210 11:40:58.256241 166356 retry.go:31] will retry after 601.932201ms: waiting for domain to come up
I0210 11:40:58.861039 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has defined MAC address 52:54:00:57:cc:39 in network mk-old-k8s-version-510006
I0210 11:40:58.862190 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | unable to find current IP address of domain old-k8s-version-510006 in network mk-old-k8s-version-510006
I0210 11:40:58.862220 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | I0210 11:40:58.862157 166356 retry.go:31] will retry after 790.215455ms: waiting for domain to come up
I0210 11:40:59.653446 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has defined MAC address 52:54:00:57:cc:39 in network mk-old-k8s-version-510006
I0210 11:40:59.653945 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | unable to find current IP address of domain old-k8s-version-510006 in network mk-old-k8s-version-510006
I0210 11:40:59.654017 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | I0210 11:40:59.653948 166356 retry.go:31] will retry after 1.174587269s: waiting for domain to come up
I0210 11:41:00.830402 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has defined MAC address 52:54:00:57:cc:39 in network mk-old-k8s-version-510006
I0210 11:41:00.830964 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | unable to find current IP address of domain old-k8s-version-510006 in network mk-old-k8s-version-510006
I0210 11:41:00.831021 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | I0210 11:41:00.830943 166356 retry.go:31] will retry after 1.387688538s: waiting for domain to come up
I0210 11:41:02.220592 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has defined MAC address 52:54:00:57:cc:39 in network mk-old-k8s-version-510006
I0210 11:41:02.221115 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | unable to find current IP address of domain old-k8s-version-510006 in network mk-old-k8s-version-510006
I0210 11:41:02.221139 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | I0210 11:41:02.221092 166356 retry.go:31] will retry after 1.360750997s: waiting for domain to come up
I0210 11:41:03.583785 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has defined MAC address 52:54:00:57:cc:39 in network mk-old-k8s-version-510006
I0210 11:41:03.584298 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | unable to find current IP address of domain old-k8s-version-510006 in network mk-old-k8s-version-510006
I0210 11:41:03.584327 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | I0210 11:41:03.584257 166356 retry.go:31] will retry after 1.611350912s: waiting for domain to come up
I0210 11:41:05.197083 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has defined MAC address 52:54:00:57:cc:39 in network mk-old-k8s-version-510006
I0210 11:41:05.197656 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | unable to find current IP address of domain old-k8s-version-510006 in network mk-old-k8s-version-510006
I0210 11:41:05.197679 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | I0210 11:41:05.197618 166356 retry.go:31] will retry after 2.811278567s: waiting for domain to come up
I0210 11:41:08.012676 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has defined MAC address 52:54:00:57:cc:39 in network mk-old-k8s-version-510006
I0210 11:41:08.013205 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | unable to find current IP address of domain old-k8s-version-510006 in network mk-old-k8s-version-510006
I0210 11:41:08.013234 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | I0210 11:41:08.013167 166356 retry.go:31] will retry after 2.475673006s: waiting for domain to come up
I0210 11:41:10.490144 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has defined MAC address 52:54:00:57:cc:39 in network mk-old-k8s-version-510006
I0210 11:41:10.490698 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | unable to find current IP address of domain old-k8s-version-510006 in network mk-old-k8s-version-510006
I0210 11:41:10.490729 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | I0210 11:41:10.490658 166356 retry.go:31] will retry after 4.311882097s: waiting for domain to come up
I0210 11:41:14.804339 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has defined MAC address 52:54:00:57:cc:39 in network mk-old-k8s-version-510006
I0210 11:41:14.804899 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | unable to find current IP address of domain old-k8s-version-510006 in network mk-old-k8s-version-510006
I0210 11:41:14.804929 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | I0210 11:41:14.804877 166356 retry.go:31] will retry after 5.641913651s: waiting for domain to come up
I0210 11:41:20.448245 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has defined MAC address 52:54:00:57:cc:39 in network mk-old-k8s-version-510006
I0210 11:41:20.448772 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has current primary IP address 192.168.61.244 and MAC address 52:54:00:57:cc:39 in network mk-old-k8s-version-510006
I0210 11:41:20.448806 166167 main.go:141] libmachine: (old-k8s-version-510006) found domain IP: 192.168.61.244
I0210 11:41:20.448818 166167 main.go:141] libmachine: (old-k8s-version-510006) reserving static IP address...
I0210 11:41:20.449197 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-510006", mac: "52:54:00:57:cc:39", ip: "192.168.61.244"} in network mk-old-k8s-version-510006
I0210 11:41:20.529812 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | Getting to WaitForSSH function...
I0210 11:41:20.529849 166167 main.go:141] libmachine: (old-k8s-version-510006) reserved static IP address 192.168.61.244 for domain old-k8s-version-510006
I0210 11:41:20.529868 166167 main.go:141] libmachine: (old-k8s-version-510006) waiting for SSH...
I0210 11:41:20.533599 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has defined MAC address 52:54:00:57:cc:39 in network mk-old-k8s-version-510006
I0210 11:41:20.534129 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:57:cc:39", ip: ""} in network mk-old-k8s-version-510006: {Iface:virbr3 ExpiryTime:2025-02-10 12:41:10 +0000 UTC Type:0 Mac:52:54:00:57:cc:39 Iaid: IPaddr:192.168.61.244 Prefix:24 Hostname:minikube Clientid:01:52:54:00:57:cc:39}
I0210 11:41:20.534158 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has defined IP address 192.168.61.244 and MAC address 52:54:00:57:cc:39 in network mk-old-k8s-version-510006
I0210 11:41:20.534247 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | Using SSH client type: external
I0210 11:41:20.534280 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | Using SSH private key: /home/jenkins/minikube-integration/20385-109271/.minikube/machines/old-k8s-version-510006/id_rsa (-rw-------)
I0210 11:41:20.534318 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.61.244 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/20385-109271/.minikube/machines/old-k8s-version-510006/id_rsa -p 22] /usr/bin/ssh <nil>}
I0210 11:41:20.534328 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | About to run SSH command:
I0210 11:41:20.534341 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | exit 0
I0210 11:41:20.663940 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | SSH cmd err, output: <nil>:
I0210 11:41:20.664224 166167 main.go:141] libmachine: (old-k8s-version-510006) KVM machine creation complete
I0210 11:41:20.664621 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetConfigRaw
I0210 11:41:20.665329 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .DriverName
I0210 11:41:20.665539 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .DriverName
I0210 11:41:20.665695 166167 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0210 11:41:20.665716 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetState
I0210 11:41:20.667317 166167 main.go:141] libmachine: Detecting operating system of created instance...
I0210 11:41:20.667335 166167 main.go:141] libmachine: Waiting for SSH to be available...
I0210 11:41:20.667342 166167 main.go:141] libmachine: Getting to WaitForSSH function...
I0210 11:41:20.667358 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetSSHHostname
I0210 11:41:20.670404 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has defined MAC address 52:54:00:57:cc:39 in network mk-old-k8s-version-510006
I0210 11:41:20.670882 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:57:cc:39", ip: ""} in network mk-old-k8s-version-510006: {Iface:virbr3 ExpiryTime:2025-02-10 12:41:10 +0000 UTC Type:0 Mac:52:54:00:57:cc:39 Iaid: IPaddr:192.168.61.244 Prefix:24 Hostname:old-k8s-version-510006 Clientid:01:52:54:00:57:cc:39}
I0210 11:41:20.670909 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has defined IP address 192.168.61.244 and MAC address 52:54:00:57:cc:39 in network mk-old-k8s-version-510006
I0210 11:41:20.671044 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetSSHPort
I0210 11:41:20.671289 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetSSHKeyPath
I0210 11:41:20.671458 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetSSHKeyPath
I0210 11:41:20.671587 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetSSHUsername
I0210 11:41:20.671738 166167 main.go:141] libmachine: Using SSH client type: native
I0210 11:41:20.671988 166167 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x865a00] 0x8686e0 <nil> [] 0s} 192.168.61.244 22 <nil> <nil>}
I0210 11:41:20.672002 166167 main.go:141] libmachine: About to run SSH command:
exit 0
I0210 11:41:20.782299 166167 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0210 11:41:20.782328 166167 main.go:141] libmachine: Detecting the provisioner...
I0210 11:41:20.782340 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetSSHHostname
I0210 11:41:20.785817 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has defined MAC address 52:54:00:57:cc:39 in network mk-old-k8s-version-510006
I0210 11:41:20.786202 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:57:cc:39", ip: ""} in network mk-old-k8s-version-510006: {Iface:virbr3 ExpiryTime:2025-02-10 12:41:10 +0000 UTC Type:0 Mac:52:54:00:57:cc:39 Iaid: IPaddr:192.168.61.244 Prefix:24 Hostname:old-k8s-version-510006 Clientid:01:52:54:00:57:cc:39}
I0210 11:41:20.786232 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has defined IP address 192.168.61.244 and MAC address 52:54:00:57:cc:39 in network mk-old-k8s-version-510006
I0210 11:41:20.786424 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetSSHPort
I0210 11:41:20.786629 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetSSHKeyPath
I0210 11:41:20.786819 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetSSHKeyPath
I0210 11:41:20.787013 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetSSHUsername
I0210 11:41:20.787241 166167 main.go:141] libmachine: Using SSH client type: native
I0210 11:41:20.787438 166167 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x865a00] 0x8686e0 <nil> [] 0s} 192.168.61.244 22 <nil> <nil>}
I0210 11:41:20.787449 166167 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0210 11:41:20.896966 166167 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0210 11:41:20.897036 166167 main.go:141] libmachine: found compatible host: buildroot
I0210 11:41:20.897044 166167 main.go:141] libmachine: Provisioning with buildroot...
I0210 11:41:20.897054 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetMachineName
I0210 11:41:20.897320 166167 buildroot.go:166] provisioning hostname "old-k8s-version-510006"
I0210 11:41:20.897346 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetMachineName
I0210 11:41:20.897564 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetSSHHostname
I0210 11:41:20.900602 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has defined MAC address 52:54:00:57:cc:39 in network mk-old-k8s-version-510006
I0210 11:41:20.901020 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:57:cc:39", ip: ""} in network mk-old-k8s-version-510006: {Iface:virbr3 ExpiryTime:2025-02-10 12:41:10 +0000 UTC Type:0 Mac:52:54:00:57:cc:39 Iaid: IPaddr:192.168.61.244 Prefix:24 Hostname:old-k8s-version-510006 Clientid:01:52:54:00:57:cc:39}
I0210 11:41:20.901056 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has defined IP address 192.168.61.244 and MAC address 52:54:00:57:cc:39 in network mk-old-k8s-version-510006
I0210 11:41:20.901210 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetSSHPort
I0210 11:41:20.901403 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetSSHKeyPath
I0210 11:41:20.901592 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetSSHKeyPath
I0210 11:41:20.901739 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetSSHUsername
I0210 11:41:20.901951 166167 main.go:141] libmachine: Using SSH client type: native
I0210 11:41:20.902137 166167 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x865a00] 0x8686e0 <nil> [] 0s} 192.168.61.244 22 <nil> <nil>}
I0210 11:41:20.902157 166167 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-510006 && echo "old-k8s-version-510006" | sudo tee /etc/hostname
I0210 11:41:21.030779 166167 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-510006
I0210 11:41:21.030810 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetSSHHostname
I0210 11:41:21.033575 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has defined MAC address 52:54:00:57:cc:39 in network mk-old-k8s-version-510006
I0210 11:41:21.034021 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:57:cc:39", ip: ""} in network mk-old-k8s-version-510006: {Iface:virbr3 ExpiryTime:2025-02-10 12:41:10 +0000 UTC Type:0 Mac:52:54:00:57:cc:39 Iaid: IPaddr:192.168.61.244 Prefix:24 Hostname:old-k8s-version-510006 Clientid:01:52:54:00:57:cc:39}
I0210 11:41:21.034055 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has defined IP address 192.168.61.244 and MAC address 52:54:00:57:cc:39 in network mk-old-k8s-version-510006
I0210 11:41:21.034262 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetSSHPort
I0210 11:41:21.034480 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetSSHKeyPath
I0210 11:41:21.034667 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetSSHKeyPath
I0210 11:41:21.034819 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetSSHUsername
I0210 11:41:21.035010 166167 main.go:141] libmachine: Using SSH client type: native
I0210 11:41:21.035242 166167 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x865a00] 0x8686e0 <nil> [] 0s} 192.168.61.244 22 <nil> <nil>}
I0210 11:41:21.035270 166167 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-510006' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-510006/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-510006' | sudo tee -a /etc/hosts;
fi
fi
I0210 11:41:21.148566 166167 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0210 11:41:21.148625 166167 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/20385-109271/.minikube CaCertPath:/home/jenkins/minikube-integration/20385-109271/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20385-109271/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20385-109271/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20385-109271/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20385-109271/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20385-109271/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20385-109271/.minikube}
I0210 11:41:21.148697 166167 buildroot.go:174] setting up certificates
I0210 11:41:21.148711 166167 provision.go:84] configureAuth start
I0210 11:41:21.148731 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetMachineName
I0210 11:41:21.149018 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetIP
I0210 11:41:21.152154 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has defined MAC address 52:54:00:57:cc:39 in network mk-old-k8s-version-510006
I0210 11:41:21.152505 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:57:cc:39", ip: ""} in network mk-old-k8s-version-510006: {Iface:virbr3 ExpiryTime:2025-02-10 12:41:10 +0000 UTC Type:0 Mac:52:54:00:57:cc:39 Iaid: IPaddr:192.168.61.244 Prefix:24 Hostname:old-k8s-version-510006 Clientid:01:52:54:00:57:cc:39}
I0210 11:41:21.152536 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has defined IP address 192.168.61.244 and MAC address 52:54:00:57:cc:39 in network mk-old-k8s-version-510006
I0210 11:41:21.152704 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetSSHHostname
I0210 11:41:21.155661 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has defined MAC address 52:54:00:57:cc:39 in network mk-old-k8s-version-510006
I0210 11:41:21.156027 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:57:cc:39", ip: ""} in network mk-old-k8s-version-510006: {Iface:virbr3 ExpiryTime:2025-02-10 12:41:10 +0000 UTC Type:0 Mac:52:54:00:57:cc:39 Iaid: IPaddr:192.168.61.244 Prefix:24 Hostname:old-k8s-version-510006 Clientid:01:52:54:00:57:cc:39}
I0210 11:41:21.156054 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has defined IP address 192.168.61.244 and MAC address 52:54:00:57:cc:39 in network mk-old-k8s-version-510006
I0210 11:41:21.156289 166167 provision.go:143] copyHostCerts
I0210 11:41:21.156370 166167 exec_runner.go:144] found /home/jenkins/minikube-integration/20385-109271/.minikube/ca.pem, removing ...
I0210 11:41:21.156390 166167 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20385-109271/.minikube/ca.pem
I0210 11:41:21.156480 166167 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20385-109271/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20385-109271/.minikube/ca.pem (1078 bytes)
I0210 11:41:21.156642 166167 exec_runner.go:144] found /home/jenkins/minikube-integration/20385-109271/.minikube/cert.pem, removing ...
I0210 11:41:21.156657 166167 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20385-109271/.minikube/cert.pem
I0210 11:41:21.156708 166167 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20385-109271/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20385-109271/.minikube/cert.pem (1123 bytes)
I0210 11:41:21.156810 166167 exec_runner.go:144] found /home/jenkins/minikube-integration/20385-109271/.minikube/key.pem, removing ...
I0210 11:41:21.156821 166167 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20385-109271/.minikube/key.pem
I0210 11:41:21.156863 166167 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20385-109271/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20385-109271/.minikube/key.pem (1679 bytes)
I0210 11:41:21.156981 166167 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20385-109271/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20385-109271/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20385-109271/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-510006 san=[127.0.0.1 192.168.61.244 localhost minikube old-k8s-version-510006]
I0210 11:41:21.372334 166167 provision.go:177] copyRemoteCerts
I0210 11:41:21.372406 166167 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0210 11:41:21.372433 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetSSHHostname
I0210 11:41:21.375595 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has defined MAC address 52:54:00:57:cc:39 in network mk-old-k8s-version-510006
I0210 11:41:21.376129 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:57:cc:39", ip: ""} in network mk-old-k8s-version-510006: {Iface:virbr3 ExpiryTime:2025-02-10 12:41:10 +0000 UTC Type:0 Mac:52:54:00:57:cc:39 Iaid: IPaddr:192.168.61.244 Prefix:24 Hostname:old-k8s-version-510006 Clientid:01:52:54:00:57:cc:39}
I0210 11:41:21.376162 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has defined IP address 192.168.61.244 and MAC address 52:54:00:57:cc:39 in network mk-old-k8s-version-510006
I0210 11:41:21.376380 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetSSHPort
I0210 11:41:21.376590 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetSSHKeyPath
I0210 11:41:21.376820 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetSSHUsername
I0210 11:41:21.376992 166167 sshutil.go:53] new ssh client: &{IP:192.168.61.244 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20385-109271/.minikube/machines/old-k8s-version-510006/id_rsa Username:docker}
I0210 11:41:21.460886 166167 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20385-109271/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0210 11:41:21.493843 166167 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20385-109271/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0210 11:41:21.526703 166167 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20385-109271/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0210 11:41:21.553480 166167 provision.go:87] duration metric: took 404.751859ms to configureAuth
I0210 11:41:21.553511 166167 buildroot.go:189] setting minikube options for container-runtime
I0210 11:41:21.553713 166167 config.go:182] Loaded profile config "old-k8s-version-510006": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0210 11:41:21.553820 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetSSHHostname
I0210 11:41:21.556584 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has defined MAC address 52:54:00:57:cc:39 in network mk-old-k8s-version-510006
I0210 11:41:21.556910 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:57:cc:39", ip: ""} in network mk-old-k8s-version-510006: {Iface:virbr3 ExpiryTime:2025-02-10 12:41:10 +0000 UTC Type:0 Mac:52:54:00:57:cc:39 Iaid: IPaddr:192.168.61.244 Prefix:24 Hostname:old-k8s-version-510006 Clientid:01:52:54:00:57:cc:39}
I0210 11:41:21.556947 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has defined IP address 192.168.61.244 and MAC address 52:54:00:57:cc:39 in network mk-old-k8s-version-510006
I0210 11:41:21.557237 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetSSHPort
I0210 11:41:21.557419 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetSSHKeyPath
I0210 11:41:21.557564 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetSSHKeyPath
I0210 11:41:21.557691 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetSSHUsername
I0210 11:41:21.557860 166167 main.go:141] libmachine: Using SSH client type: native
I0210 11:41:21.558071 166167 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x865a00] 0x8686e0 <nil> [] 0s} 192.168.61.244 22 <nil> <nil>}
I0210 11:41:21.558096 166167 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0210 11:41:21.802607 166167 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0210 11:41:21.802643 166167 main.go:141] libmachine: Checking connection to Docker...
I0210 11:41:21.802653 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetURL
I0210 11:41:21.803994 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | using libvirt version 6000000
I0210 11:41:21.806514 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has defined MAC address 52:54:00:57:cc:39 in network mk-old-k8s-version-510006
I0210 11:41:21.806930 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:57:cc:39", ip: ""} in network mk-old-k8s-version-510006: {Iface:virbr3 ExpiryTime:2025-02-10 12:41:10 +0000 UTC Type:0 Mac:52:54:00:57:cc:39 Iaid: IPaddr:192.168.61.244 Prefix:24 Hostname:old-k8s-version-510006 Clientid:01:52:54:00:57:cc:39}
I0210 11:41:21.806963 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has defined IP address 192.168.61.244 and MAC address 52:54:00:57:cc:39 in network mk-old-k8s-version-510006
I0210 11:41:21.807174 166167 main.go:141] libmachine: Docker is up and running!
I0210 11:41:21.807209 166167 main.go:141] libmachine: Reticulating splines...
I0210 11:41:21.807218 166167 client.go:171] duration metric: took 27.042385041s to LocalClient.Create
I0210 11:41:21.807245 166167 start.go:167] duration metric: took 27.042468472s to libmachine.API.Create "old-k8s-version-510006"
I0210 11:41:21.807259 166167 start.go:293] postStartSetup for "old-k8s-version-510006" (driver="kvm2")
I0210 11:41:21.807270 166167 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0210 11:41:21.807290 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .DriverName
I0210 11:41:21.807552 166167 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0210 11:41:21.807578 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetSSHHostname
I0210 11:41:21.809944 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has defined MAC address 52:54:00:57:cc:39 in network mk-old-k8s-version-510006
I0210 11:41:21.810257 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:57:cc:39", ip: ""} in network mk-old-k8s-version-510006: {Iface:virbr3 ExpiryTime:2025-02-10 12:41:10 +0000 UTC Type:0 Mac:52:54:00:57:cc:39 Iaid: IPaddr:192.168.61.244 Prefix:24 Hostname:old-k8s-version-510006 Clientid:01:52:54:00:57:cc:39}
I0210 11:41:21.810282 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has defined IP address 192.168.61.244 and MAC address 52:54:00:57:cc:39 in network mk-old-k8s-version-510006
I0210 11:41:21.810380 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetSSHPort
I0210 11:41:21.810564 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetSSHKeyPath
I0210 11:41:21.810730 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetSSHUsername
I0210 11:41:21.810885 166167 sshutil.go:53] new ssh client: &{IP:192.168.61.244 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20385-109271/.minikube/machines/old-k8s-version-510006/id_rsa Username:docker}
I0210 11:41:21.893646 166167 ssh_runner.go:195] Run: cat /etc/os-release
I0210 11:41:21.897965 166167 info.go:137] Remote host: Buildroot 2023.02.9
I0210 11:41:21.897996 166167 filesync.go:126] Scanning /home/jenkins/minikube-integration/20385-109271/.minikube/addons for local assets ...
I0210 11:41:21.898124 166167 filesync.go:126] Scanning /home/jenkins/minikube-integration/20385-109271/.minikube/files for local assets ...
I0210 11:41:21.898225 166167 filesync.go:149] local asset: /home/jenkins/minikube-integration/20385-109271/.minikube/files/etc/ssl/certs/1164702.pem -> 1164702.pem in /etc/ssl/certs
I0210 11:41:21.898339 166167 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0210 11:41:21.907439 166167 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20385-109271/.minikube/files/etc/ssl/certs/1164702.pem --> /etc/ssl/certs/1164702.pem (1708 bytes)
I0210 11:41:21.933187 166167 start.go:296] duration metric: took 125.916099ms for postStartSetup
I0210 11:41:21.933233 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetConfigRaw
I0210 11:41:21.933793 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetIP
I0210 11:41:21.936328 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has defined MAC address 52:54:00:57:cc:39 in network mk-old-k8s-version-510006
I0210 11:41:21.936643 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:57:cc:39", ip: ""} in network mk-old-k8s-version-510006: {Iface:virbr3 ExpiryTime:2025-02-10 12:41:10 +0000 UTC Type:0 Mac:52:54:00:57:cc:39 Iaid: IPaddr:192.168.61.244 Prefix:24 Hostname:old-k8s-version-510006 Clientid:01:52:54:00:57:cc:39}
I0210 11:41:21.936675 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has defined IP address 192.168.61.244 and MAC address 52:54:00:57:cc:39 in network mk-old-k8s-version-510006
I0210 11:41:21.936895 166167 profile.go:143] Saving config to /home/jenkins/minikube-integration/20385-109271/.minikube/profiles/old-k8s-version-510006/config.json ...
I0210 11:41:21.937088 166167 start.go:128] duration metric: took 27.193082062s to createHost
I0210 11:41:21.937177 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetSSHHostname
I0210 11:41:21.939771 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has defined MAC address 52:54:00:57:cc:39 in network mk-old-k8s-version-510006
I0210 11:41:21.940279 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:57:cc:39", ip: ""} in network mk-old-k8s-version-510006: {Iface:virbr3 ExpiryTime:2025-02-10 12:41:10 +0000 UTC Type:0 Mac:52:54:00:57:cc:39 Iaid: IPaddr:192.168.61.244 Prefix:24 Hostname:old-k8s-version-510006 Clientid:01:52:54:00:57:cc:39}
I0210 11:41:21.940310 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has defined IP address 192.168.61.244 and MAC address 52:54:00:57:cc:39 in network mk-old-k8s-version-510006
I0210 11:41:21.940578 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetSSHPort
I0210 11:41:21.940755 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetSSHKeyPath
I0210 11:41:21.940942 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetSSHKeyPath
I0210 11:41:21.941096 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetSSHUsername
I0210 11:41:21.941274 166167 main.go:141] libmachine: Using SSH client type: native
I0210 11:41:21.941511 166167 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x865a00] 0x8686e0 <nil> [] 0s} 192.168.61.244 22 <nil> <nil>}
I0210 11:41:21.941529 166167 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0210 11:41:22.051888 166167 main.go:141] libmachine: SSH cmd err, output: <nil>: 1739187682.007358004
I0210 11:41:22.051917 166167 fix.go:216] guest clock: 1739187682.007358004
I0210 11:41:22.051928 166167 fix.go:229] Guest: 2025-02-10 11:41:22.007358004 +0000 UTC Remote: 2025-02-10 11:41:21.937098841 +0000 UTC m=+48.142791451 (delta=70.259163ms)
I0210 11:41:22.051956 166167 fix.go:200] guest clock delta is within tolerance: 70.259163ms
I0210 11:41:22.051963 166167 start.go:83] releasing machines lock for "old-k8s-version-510006", held for 27.308148524s
I0210 11:41:22.051991 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .DriverName
I0210 11:41:22.052262 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetIP
I0210 11:41:22.055083 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has defined MAC address 52:54:00:57:cc:39 in network mk-old-k8s-version-510006
I0210 11:41:22.055414 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:57:cc:39", ip: ""} in network mk-old-k8s-version-510006: {Iface:virbr3 ExpiryTime:2025-02-10 12:41:10 +0000 UTC Type:0 Mac:52:54:00:57:cc:39 Iaid: IPaddr:192.168.61.244 Prefix:24 Hostname:old-k8s-version-510006 Clientid:01:52:54:00:57:cc:39}
I0210 11:41:22.055437 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has defined IP address 192.168.61.244 and MAC address 52:54:00:57:cc:39 in network mk-old-k8s-version-510006
I0210 11:41:22.055625 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .DriverName
I0210 11:41:22.056135 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .DriverName
I0210 11:41:22.056310 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .DriverName
I0210 11:41:22.056407 166167 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0210 11:41:22.056455 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetSSHHostname
I0210 11:41:22.056571 166167 ssh_runner.go:195] Run: cat /version.json
I0210 11:41:22.056596 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetSSHHostname
I0210 11:41:22.059385 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has defined MAC address 52:54:00:57:cc:39 in network mk-old-k8s-version-510006
I0210 11:41:22.059411 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has defined MAC address 52:54:00:57:cc:39 in network mk-old-k8s-version-510006
I0210 11:41:22.059774 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:57:cc:39", ip: ""} in network mk-old-k8s-version-510006: {Iface:virbr3 ExpiryTime:2025-02-10 12:41:10 +0000 UTC Type:0 Mac:52:54:00:57:cc:39 Iaid: IPaddr:192.168.61.244 Prefix:24 Hostname:old-k8s-version-510006 Clientid:01:52:54:00:57:cc:39}
I0210 11:41:22.059810 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has defined IP address 192.168.61.244 and MAC address 52:54:00:57:cc:39 in network mk-old-k8s-version-510006
I0210 11:41:22.059839 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:57:cc:39", ip: ""} in network mk-old-k8s-version-510006: {Iface:virbr3 ExpiryTime:2025-02-10 12:41:10 +0000 UTC Type:0 Mac:52:54:00:57:cc:39 Iaid: IPaddr:192.168.61.244 Prefix:24 Hostname:old-k8s-version-510006 Clientid:01:52:54:00:57:cc:39}
I0210 11:41:22.059880 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has defined IP address 192.168.61.244 and MAC address 52:54:00:57:cc:39 in network mk-old-k8s-version-510006
I0210 11:41:22.059968 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetSSHPort
I0210 11:41:22.060049 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetSSHPort
I0210 11:41:22.060117 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetSSHKeyPath
I0210 11:41:22.060212 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetSSHKeyPath
I0210 11:41:22.060258 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetSSHUsername
I0210 11:41:22.060366 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetSSHUsername
I0210 11:41:22.060443 166167 sshutil.go:53] new ssh client: &{IP:192.168.61.244 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20385-109271/.minikube/machines/old-k8s-version-510006/id_rsa Username:docker}
I0210 11:41:22.060491 166167 sshutil.go:53] new ssh client: &{IP:192.168.61.244 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20385-109271/.minikube/machines/old-k8s-version-510006/id_rsa Username:docker}
I0210 11:41:22.140396 166167 ssh_runner.go:195] Run: systemctl --version
I0210 11:41:22.176741 166167 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0210 11:41:22.337375 166167 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0210 11:41:22.343857 166167 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0210 11:41:22.343927 166167 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0210 11:41:22.358812 166167 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0210 11:41:22.358844 166167 start.go:495] detecting cgroup driver to use...
I0210 11:41:22.358923 166167 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0210 11:41:22.377476 166167 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0210 11:41:22.392699 166167 docker.go:217] disabling cri-docker service (if available) ...
I0210 11:41:22.392771 166167 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0210 11:41:22.406407 166167 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0210 11:41:22.419989 166167 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0210 11:41:22.564581 166167 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0210 11:41:22.767119 166167 docker.go:233] disabling docker service ...
I0210 11:41:22.767220 166167 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0210 11:41:22.784273 166167 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0210 11:41:22.798257 166167 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0210 11:41:22.928649 166167 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0210 11:41:23.068649 166167 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0210 11:41:23.087297 166167 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0210 11:41:23.113639 166167 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0210 11:41:23.113743 166167 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0210 11:41:23.129627 166167 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0210 11:41:23.129680 166167 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0210 11:41:23.145172 166167 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0210 11:41:23.161436 166167 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0210 11:41:23.176166 166167 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0210 11:41:23.194247 166167 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0210 11:41:23.207242 166167 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0210 11:41:23.207312 166167 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0210 11:41:23.224288 166167 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0210 11:41:23.236369 166167 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0210 11:41:23.397432 166167 ssh_runner.go:195] Run: sudo systemctl restart crio
I0210 11:41:23.509501 166167 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0210 11:41:23.509578 166167 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0210 11:41:23.516078 166167 start.go:563] Will wait 60s for crictl version
I0210 11:41:23.516149 166167 ssh_runner.go:195] Run: which crictl
I0210 11:41:23.521035 166167 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0210 11:41:23.586475 166167 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0210 11:41:23.586560 166167 ssh_runner.go:195] Run: crio --version
I0210 11:41:23.618745 166167 ssh_runner.go:195] Run: crio --version
I0210 11:41:23.650936 166167 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0210 11:41:23.652243 166167 main.go:141] libmachine: (old-k8s-version-510006) Calling .GetIP
I0210 11:41:23.654809 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has defined MAC address 52:54:00:57:cc:39 in network mk-old-k8s-version-510006
I0210 11:41:23.655257 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:57:cc:39", ip: ""} in network mk-old-k8s-version-510006: {Iface:virbr3 ExpiryTime:2025-02-10 12:41:10 +0000 UTC Type:0 Mac:52:54:00:57:cc:39 Iaid: IPaddr:192.168.61.244 Prefix:24 Hostname:old-k8s-version-510006 Clientid:01:52:54:00:57:cc:39}
I0210 11:41:23.655287 166167 main.go:141] libmachine: (old-k8s-version-510006) DBG | domain old-k8s-version-510006 has defined IP address 192.168.61.244 and MAC address 52:54:00:57:cc:39 in network mk-old-k8s-version-510006
I0210 11:41:23.655550 166167 ssh_runner.go:195] Run: grep 192.168.61.1 host.minikube.internal$ /etc/hosts
I0210 11:41:23.660372 166167 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.61.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0210 11:41:23.674906 166167 kubeadm.go:883] updating cluster {Name:old-k8s-version-510006 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-510006 Namespace
:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.244 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror:
DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0210 11:41:23.675073 166167 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0210 11:41:23.675139 166167 ssh_runner.go:195] Run: sudo crictl images --output json
I0210 11:41:23.715504 166167 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0210 11:41:23.715604 166167 ssh_runner.go:195] Run: which lz4
I0210 11:41:23.720728 166167 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0210 11:41:23.726826 166167 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0210 11:41:23.726861 166167 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20385-109271/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0210 11:41:25.428563 166167 crio.go:462] duration metric: took 1.707878482s to copy over tarball
I0210 11:41:25.428629 166167 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0210 11:41:28.580685 166167 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.15202319s)
I0210 11:41:28.580720 166167 crio.go:469] duration metric: took 3.152126881s to extract the tarball
I0210 11:41:28.580735 166167 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0210 11:41:28.641361 166167 ssh_runner.go:195] Run: sudo crictl images --output json
I0210 11:41:28.689084 166167 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0210 11:41:28.689109 166167 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0210 11:41:28.689174 166167 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0210 11:41:28.689218 166167 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0210 11:41:28.689285 166167 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0210 11:41:28.689464 166167 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0210 11:41:28.689483 166167 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0210 11:41:28.689550 166167 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0210 11:41:28.689553 166167 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0210 11:41:28.689469 166167 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0210 11:41:28.690931 166167 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0210 11:41:28.690941 166167 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0210 11:41:28.691000 166167 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0210 11:41:28.691246 166167 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0210 11:41:28.691345 166167 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0210 11:41:28.691379 166167 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0210 11:41:28.691353 166167 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0210 11:41:28.691515 166167 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0210 11:41:28.900965 166167 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0210 11:41:28.916463 166167 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0210 11:41:28.918643 166167 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0210 11:41:28.919662 166167 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0210 11:41:28.921643 166167 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0210 11:41:28.929912 166167 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0210 11:41:28.981699 166167 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0210 11:41:29.009280 166167 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0210 11:41:29.009348 166167 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0210 11:41:29.009413 166167 ssh_runner.go:195] Run: which crictl
I0210 11:41:29.057052 166167 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0210 11:41:29.057102 166167 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0210 11:41:29.057143 166167 ssh_runner.go:195] Run: which crictl
I0210 11:41:29.117117 166167 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0210 11:41:29.117150 166167 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0210 11:41:29.117162 166167 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0210 11:41:29.117182 166167 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0210 11:41:29.117207 166167 ssh_runner.go:195] Run: which crictl
I0210 11:41:29.117240 166167 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0210 11:41:29.117254 166167 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0210 11:41:29.117212 166167 ssh_runner.go:195] Run: which crictl
I0210 11:41:29.117272 166167 ssh_runner.go:195] Run: which crictl
I0210 11:41:29.117330 166167 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0210 11:41:29.117353 166167 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0210 11:41:29.117361 166167 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0210 11:41:29.117379 166167 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0210 11:41:29.117383 166167 ssh_runner.go:195] Run: which crictl
I0210 11:41:29.117410 166167 ssh_runner.go:195] Run: which crictl
I0210 11:41:29.117458 166167 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0210 11:41:29.117485 166167 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0210 11:41:29.192454 166167 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0210 11:41:29.192490 166167 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0210 11:41:29.192508 166167 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0210 11:41:29.192539 166167 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0210 11:41:29.192550 166167 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0210 11:41:29.192556 166167 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0210 11:41:29.192594 166167 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0210 11:41:29.356234 166167 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0210 11:41:29.356261 166167 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0210 11:41:29.356351 166167 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0210 11:41:29.356376 166167 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0210 11:41:29.356439 166167 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0210 11:41:29.356481 166167 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0210 11:41:29.356499 166167 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0210 11:41:29.527216 166167 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0210 11:41:29.527317 166167 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20385-109271/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0210 11:41:29.527393 166167 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0210 11:41:29.527466 166167 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0210 11:41:29.527541 166167 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0210 11:41:29.527601 166167 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20385-109271/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0210 11:41:29.527657 166167 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0210 11:41:29.661356 166167 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20385-109271/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0210 11:41:29.661404 166167 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20385-109271/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0210 11:41:29.661475 166167 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20385-109271/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0210 11:41:29.661540 166167 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20385-109271/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0210 11:41:29.661585 166167 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20385-109271/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0210 11:41:29.841628 166167 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0210 11:41:29.996911 166167 cache_images.go:92] duration metric: took 1.307781905s to LoadCachedImages
W0210 11:41:29.997022 166167 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20385-109271/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20385-109271/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0: no such file or directory
I0210 11:41:29.997041 166167 kubeadm.go:934] updating node { 192.168.61.244 8443 v1.20.0 crio true true} ...
I0210 11:41:29.997174 166167 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-510006 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.61.244
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-510006 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0210 11:41:29.997296 166167 ssh_runner.go:195] Run: crio config
I0210 11:41:30.068175 166167 cni.go:84] Creating CNI manager for ""
I0210 11:41:30.068201 166167 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0210 11:41:30.068216 166167 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0210 11:41:30.068241 166167 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.61.244 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-510006 NodeName:old-k8s-version-510006 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.61.244"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.61.244 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0210 11:41:30.068416 166167 kubeadm.go:195] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.61.244
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-510006"
kubeletExtraArgs:
node-ip: 192.168.61.244
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.61.244"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0210 11:41:30.068488 166167 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0210 11:41:30.081966 166167 binaries.go:44] Found k8s binaries, skipping transfer
I0210 11:41:30.082034 166167 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0210 11:41:30.093997 166167 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0210 11:41:30.114238 166167 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0210 11:41:30.131615 166167 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0210 11:41:30.152786 166167 ssh_runner.go:195] Run: grep 192.168.61.244 control-plane.minikube.internal$ /etc/hosts
I0210 11:41:30.157198 166167 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.61.244 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0210 11:41:30.170748 166167 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0210 11:41:30.308720 166167 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0210 11:41:30.331874 166167 certs.go:68] Setting up /home/jenkins/minikube-integration/20385-109271/.minikube/profiles/old-k8s-version-510006 for IP: 192.168.61.244
I0210 11:41:30.331898 166167 certs.go:194] generating shared ca certs ...
I0210 11:41:30.331918 166167 certs.go:226] acquiring lock for ca certs: {Name:mk41def3593b0ff6effd099cf80de2e0c576c931 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0210 11:41:30.332105 166167 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20385-109271/.minikube/ca.key
I0210 11:41:30.332150 166167 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20385-109271/.minikube/proxy-client-ca.key
I0210 11:41:30.332170 166167 certs.go:256] generating profile certs ...
I0210 11:41:30.332245 166167 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/20385-109271/.minikube/profiles/old-k8s-version-510006/client.key
I0210 11:41:30.332263 166167 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20385-109271/.minikube/profiles/old-k8s-version-510006/client.crt with IP's: []
I0210 11:41:30.668089 166167 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20385-109271/.minikube/profiles/old-k8s-version-510006/client.crt ...
I0210 11:41:30.668128 166167 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20385-109271/.minikube/profiles/old-k8s-version-510006/client.crt: {Name:mk8347aea9ae155ce801a2e71d499b500b341d73 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0210 11:41:30.668316 166167 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20385-109271/.minikube/profiles/old-k8s-version-510006/client.key ...
I0210 11:41:30.668336 166167 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20385-109271/.minikube/profiles/old-k8s-version-510006/client.key: {Name:mk1d5190f81a74442c1ea6589a6d48f9e0770235 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0210 11:41:30.668453 166167 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20385-109271/.minikube/profiles/old-k8s-version-510006/apiserver.key.25437697
I0210 11:41:30.668476 166167 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20385-109271/.minikube/profiles/old-k8s-version-510006/apiserver.crt.25437697 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.61.244]
I0210 11:41:30.717183 166167 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20385-109271/.minikube/profiles/old-k8s-version-510006/apiserver.crt.25437697 ...
I0210 11:41:30.717215 166167 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20385-109271/.minikube/profiles/old-k8s-version-510006/apiserver.crt.25437697: {Name:mk989c3c29aa495f78e6ed948a34f98da35fb993 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0210 11:41:30.717382 166167 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20385-109271/.minikube/profiles/old-k8s-version-510006/apiserver.key.25437697 ...
I0210 11:41:30.717401 166167 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20385-109271/.minikube/profiles/old-k8s-version-510006/apiserver.key.25437697: {Name:mk435213c3dae38f2938dc1ecba07a2e3248b984 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0210 11:41:30.717493 166167 certs.go:381] copying /home/jenkins/minikube-integration/20385-109271/.minikube/profiles/old-k8s-version-510006/apiserver.crt.25437697 -> /home/jenkins/minikube-integration/20385-109271/.minikube/profiles/old-k8s-version-510006/apiserver.crt
I0210 11:41:30.717583 166167 certs.go:385] copying /home/jenkins/minikube-integration/20385-109271/.minikube/profiles/old-k8s-version-510006/apiserver.key.25437697 -> /home/jenkins/minikube-integration/20385-109271/.minikube/profiles/old-k8s-version-510006/apiserver.key
I0210 11:41:30.717665 166167 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/20385-109271/.minikube/profiles/old-k8s-version-510006/proxy-client.key
I0210 11:41:30.717686 166167 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20385-109271/.minikube/profiles/old-k8s-version-510006/proxy-client.crt with IP's: []
I0210 11:41:30.783571 166167 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20385-109271/.minikube/profiles/old-k8s-version-510006/proxy-client.crt ...
I0210 11:41:30.783605 166167 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20385-109271/.minikube/profiles/old-k8s-version-510006/proxy-client.crt: {Name:mk6a0fecfe025c211fba745a1d973eef00d23493 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0210 11:41:30.783794 166167 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20385-109271/.minikube/profiles/old-k8s-version-510006/proxy-client.key ...
I0210 11:41:30.783820 166167 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20385-109271/.minikube/profiles/old-k8s-version-510006/proxy-client.key: {Name:mk7c96a88f077e6b78193c9d152747aff367736b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0210 11:41:30.784039 166167 certs.go:484] found cert: /home/jenkins/minikube-integration/20385-109271/.minikube/certs/116470.pem (1338 bytes)
W0210 11:41:30.784082 166167 certs.go:480] ignoring /home/jenkins/minikube-integration/20385-109271/.minikube/certs/116470_empty.pem, impossibly tiny 0 bytes
I0210 11:41:30.784096 166167 certs.go:484] found cert: /home/jenkins/minikube-integration/20385-109271/.minikube/certs/ca-key.pem (1679 bytes)
I0210 11:41:30.784128 166167 certs.go:484] found cert: /home/jenkins/minikube-integration/20385-109271/.minikube/certs/ca.pem (1078 bytes)
I0210 11:41:30.784162 166167 certs.go:484] found cert: /home/jenkins/minikube-integration/20385-109271/.minikube/certs/cert.pem (1123 bytes)
I0210 11:41:30.784197 166167 certs.go:484] found cert: /home/jenkins/minikube-integration/20385-109271/.minikube/certs/key.pem (1679 bytes)
I0210 11:41:30.784252 166167 certs.go:484] found cert: /home/jenkins/minikube-integration/20385-109271/.minikube/files/etc/ssl/certs/1164702.pem (1708 bytes)
I0210 11:41:30.784918 166167 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20385-109271/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0210 11:41:30.814479 166167 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20385-109271/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0210 11:41:30.841908 166167 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20385-109271/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0210 11:41:30.871132 166167 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20385-109271/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0210 11:41:30.901058 166167 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20385-109271/.minikube/profiles/old-k8s-version-510006/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0210 11:41:30.932004 166167 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20385-109271/.minikube/profiles/old-k8s-version-510006/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0210 11:41:31.001491 166167 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20385-109271/.minikube/profiles/old-k8s-version-510006/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0210 11:41:31.033436 166167 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20385-109271/.minikube/profiles/old-k8s-version-510006/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0210 11:41:31.060567 166167 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20385-109271/.minikube/files/etc/ssl/certs/1164702.pem --> /usr/share/ca-certificates/1164702.pem (1708 bytes)
I0210 11:41:31.087940 166167 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20385-109271/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0210 11:41:31.116420 166167 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20385-109271/.minikube/certs/116470.pem --> /usr/share/ca-certificates/116470.pem (1338 bytes)
I0210 11:41:31.146415 166167 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0210 11:41:31.166908 166167 ssh_runner.go:195] Run: openssl version
I0210 11:41:31.173401 166167 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1164702.pem && ln -fs /usr/share/ca-certificates/1164702.pem /etc/ssl/certs/1164702.pem"
I0210 11:41:31.186597 166167 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1164702.pem
I0210 11:41:31.191377 166167 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Feb 10 10:41 /usr/share/ca-certificates/1164702.pem
I0210 11:41:31.191422 166167 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1164702.pem
I0210 11:41:31.198032 166167 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/1164702.pem /etc/ssl/certs/3ec20f2e.0"
I0210 11:41:31.215852 166167 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0210 11:41:31.233082 166167 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0210 11:41:31.240693 166167 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Feb 10 10:34 /usr/share/ca-certificates/minikubeCA.pem
I0210 11:41:31.240744 166167 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0210 11:41:31.247547 166167 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0210 11:41:31.269063 166167 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/116470.pem && ln -fs /usr/share/ca-certificates/116470.pem /etc/ssl/certs/116470.pem"
I0210 11:41:31.283441 166167 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/116470.pem
I0210 11:41:31.289206 166167 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Feb 10 10:41 /usr/share/ca-certificates/116470.pem
I0210 11:41:31.289266 166167 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/116470.pem
I0210 11:41:31.301445 166167 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/116470.pem /etc/ssl/certs/51391683.0"
I0210 11:41:31.331158 166167 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0210 11:41:31.337010 166167 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0210 11:41:31.337081 166167 kubeadm.go:392] StartCluster: {Name:old-k8s-version-510006 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-510006 Namespace:de
fault APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.244 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Dis
ableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0210 11:41:31.337190 166167 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0210 11:41:31.337256 166167 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0210 11:41:31.388680 166167 cri.go:89] found id: ""
I0210 11:41:31.388759 166167 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0210 11:41:31.401955 166167 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0210 11:41:31.412189 166167 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0210 11:41:31.423829 166167 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0210 11:41:31.423852 166167 kubeadm.go:157] found existing configuration files:
I0210 11:41:31.423897 166167 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0210 11:41:31.436267 166167 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0210 11:41:31.436322 166167 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0210 11:41:31.446716 166167 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0210 11:41:31.456378 166167 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0210 11:41:31.456441 166167 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0210 11:41:31.466204 166167 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0210 11:41:31.476983 166167 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0210 11:41:31.477044 166167 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0210 11:41:31.487892 166167 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0210 11:41:31.498825 166167 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0210 11:41:31.498883 166167 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0210 11:41:31.510924 166167 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0210 11:41:31.710585 166167 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0210 11:41:31.710712 166167 kubeadm.go:310] [preflight] Running pre-flight checks
I0210 11:41:31.892514 166167 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0210 11:41:31.892677 166167 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0210 11:41:31.892800 166167 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0210 11:41:32.120984 166167 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0210 11:41:32.123010 166167 out.go:235] - Generating certificates and keys ...
I0210 11:41:32.123127 166167 kubeadm.go:310] [certs] Using existing ca certificate authority
I0210 11:41:32.123264 166167 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0210 11:41:32.529256 166167 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0210 11:41:32.689055 166167 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0210 11:41:32.862020 166167 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0210 11:41:32.961919 166167 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0210 11:41:33.207046 166167 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0210 11:41:33.207316 166167 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-510006] and IPs [192.168.61.244 127.0.0.1 ::1]
I0210 11:41:33.395407 166167 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0210 11:41:33.395687 166167 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-510006] and IPs [192.168.61.244 127.0.0.1 ::1]
I0210 11:41:33.638853 166167 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0210 11:41:34.004754 166167 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0210 11:41:34.403016 166167 kubeadm.go:310] [certs] Generating "sa" key and public key
I0210 11:41:34.403315 166167 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0210 11:41:34.695300 166167 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0210 11:41:35.521785 166167 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0210 11:41:35.654167 166167 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0210 11:41:35.729522 166167 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0210 11:41:35.748263 166167 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0210 11:41:35.748894 166167 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0210 11:41:35.748960 166167 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0210 11:41:35.945886 166167 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0210 11:41:35.947592 166167 out.go:235] - Booting up control plane ...
I0210 11:41:35.947722 166167 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0210 11:41:35.959963 166167 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0210 11:41:35.961536 166167 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0210 11:41:35.962759 166167 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0210 11:41:35.968665 166167 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0210 11:42:15.932370 166167 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0210 11:42:15.933231 166167 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0210 11:42:15.933440 166167 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0210 11:42:20.932672 166167 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0210 11:42:20.932982 166167 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0210 11:42:30.932137 166167 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0210 11:42:30.932430 166167 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0210 11:42:50.932113 166167 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0210 11:42:50.932404 166167 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0210 11:43:30.932238 166167 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0210 11:43:30.932898 166167 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0210 11:43:30.932927 166167 kubeadm.go:310]
I0210 11:43:30.933062 166167 kubeadm.go:310] Unfortunately, an error has occurred:
I0210 11:43:30.933164 166167 kubeadm.go:310] timed out waiting for the condition
I0210 11:43:30.933174 166167 kubeadm.go:310]
I0210 11:43:30.933224 166167 kubeadm.go:310] This error is likely caused by:
I0210 11:43:30.933309 166167 kubeadm.go:310] - The kubelet is not running
I0210 11:43:30.933579 166167 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0210 11:43:30.933605 166167 kubeadm.go:310]
I0210 11:43:30.933910 166167 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0210 11:43:30.934019 166167 kubeadm.go:310] - 'systemctl status kubelet'
I0210 11:43:30.934108 166167 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0210 11:43:30.934126 166167 kubeadm.go:310]
I0210 11:43:30.934397 166167 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0210 11:43:30.934592 166167 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0210 11:43:30.934609 166167 kubeadm.go:310]
I0210 11:43:30.935009 166167 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0210 11:43:30.935272 166167 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0210 11:43:30.935560 166167 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0210 11:43:30.935868 166167 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0210 11:43:30.935910 166167 kubeadm.go:310]
I0210 11:43:30.936040 166167 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0210 11:43:30.936154 166167 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0210 11:43:30.936252 166167 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
W0210 11:43:30.936377 166167 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-510006] and IPs [192.168.61.244 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-510006] and IPs [192.168.61.244 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-510006] and IPs [192.168.61.244 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-510006] and IPs [192.168.61.244 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0210 11:43:30.936427 166167 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0210 11:43:31.523534 166167 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0210 11:43:31.536969 166167 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0210 11:43:31.545900 166167 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0210 11:43:31.545928 166167 kubeadm.go:157] found existing configuration files:
I0210 11:43:31.545985 166167 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0210 11:43:31.554442 166167 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0210 11:43:31.554505 166167 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0210 11:43:31.562900 166167 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0210 11:43:31.570891 166167 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0210 11:43:31.570938 166167 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0210 11:43:31.579238 166167 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0210 11:43:31.587138 166167 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0210 11:43:31.587201 166167 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0210 11:43:31.595628 166167 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0210 11:43:31.603606 166167 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0210 11:43:31.603658 166167 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0210 11:43:31.611841 166167 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0210 11:43:31.681510 166167 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0210 11:43:31.681624 166167 kubeadm.go:310] [preflight] Running pre-flight checks
I0210 11:43:31.820815 166167 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0210 11:43:31.820994 166167 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0210 11:43:31.821146 166167 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0210 11:43:32.001479 166167 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0210 11:43:32.003845 166167 out.go:235] - Generating certificates and keys ...
I0210 11:43:32.003979 166167 kubeadm.go:310] [certs] Using existing ca certificate authority
I0210 11:43:32.004098 166167 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0210 11:43:32.004222 166167 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0210 11:43:32.004320 166167 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0210 11:43:32.004427 166167 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0210 11:43:32.004508 166167 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0210 11:43:32.004598 166167 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0210 11:43:32.004685 166167 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0210 11:43:32.004784 166167 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0210 11:43:32.004880 166167 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0210 11:43:32.004955 166167 kubeadm.go:310] [certs] Using the existing "sa" key
I0210 11:43:32.005051 166167 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0210 11:43:32.065682 166167 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0210 11:43:32.186424 166167 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0210 11:43:32.384004 166167 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0210 11:43:32.497794 166167 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0210 11:43:32.513056 166167 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0210 11:43:32.513571 166167 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0210 11:43:32.513623 166167 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0210 11:43:32.663213 166167 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0210 11:43:32.665088 166167 out.go:235] - Booting up control plane ...
I0210 11:43:32.665197 166167 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0210 11:43:32.672861 166167 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0210 11:43:32.674219 166167 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0210 11:43:32.678811 166167 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0210 11:43:32.689421 166167 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0210 11:44:12.691392 166167 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0210 11:44:12.691482 166167 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0210 11:44:12.691773 166167 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0210 11:44:17.692446 166167 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0210 11:44:17.692644 166167 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0210 11:44:27.693325 166167 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0210 11:44:27.693611 166167 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0210 11:44:47.694710 166167 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0210 11:44:47.694958 166167 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0210 11:45:27.693634 166167 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0210 11:45:27.693885 166167 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0210 11:45:27.693920 166167 kubeadm.go:310]
I0210 11:45:27.693973 166167 kubeadm.go:310] Unfortunately, an error has occurred:
I0210 11:45:27.694031 166167 kubeadm.go:310] timed out waiting for the condition
I0210 11:45:27.694038 166167 kubeadm.go:310]
I0210 11:45:27.694086 166167 kubeadm.go:310] This error is likely caused by:
I0210 11:45:27.694114 166167 kubeadm.go:310] - The kubelet is not running
I0210 11:45:27.694205 166167 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0210 11:45:27.694210 166167 kubeadm.go:310]
I0210 11:45:27.694339 166167 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0210 11:45:27.694384 166167 kubeadm.go:310] - 'systemctl status kubelet'
I0210 11:45:27.694421 166167 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0210 11:45:27.694428 166167 kubeadm.go:310]
I0210 11:45:27.694564 166167 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0210 11:45:27.694668 166167 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0210 11:45:27.694679 166167 kubeadm.go:310]
I0210 11:45:27.694823 166167 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0210 11:45:27.694939 166167 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0210 11:45:27.695037 166167 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0210 11:45:27.695139 166167 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0210 11:45:27.695146 166167 kubeadm.go:310]
I0210 11:45:27.696322 166167 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0210 11:45:27.696436 166167 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0210 11:45:27.696521 166167 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0210 11:45:27.696595 166167 kubeadm.go:394] duration metric: took 3m56.359524974s to StartCluster
I0210 11:45:27.696649 166167 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0210 11:45:27.696723 166167 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0210 11:45:27.742235 166167 cri.go:89] found id: ""
I0210 11:45:27.742266 166167 logs.go:282] 0 containers: []
W0210 11:45:27.742278 166167 logs.go:284] No container was found matching "kube-apiserver"
I0210 11:45:27.742286 166167 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0210 11:45:27.742361 166167 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0210 11:45:27.777880 166167 cri.go:89] found id: ""
I0210 11:45:27.777907 166167 logs.go:282] 0 containers: []
W0210 11:45:27.777917 166167 logs.go:284] No container was found matching "etcd"
I0210 11:45:27.777924 166167 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0210 11:45:27.777983 166167 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0210 11:45:27.811664 166167 cri.go:89] found id: ""
I0210 11:45:27.811699 166167 logs.go:282] 0 containers: []
W0210 11:45:27.811710 166167 logs.go:284] No container was found matching "coredns"
I0210 11:45:27.811719 166167 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0210 11:45:27.811793 166167 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0210 11:45:27.845755 166167 cri.go:89] found id: ""
I0210 11:45:27.845785 166167 logs.go:282] 0 containers: []
W0210 11:45:27.845796 166167 logs.go:284] No container was found matching "kube-scheduler"
I0210 11:45:27.845805 166167 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0210 11:45:27.845871 166167 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0210 11:45:27.880368 166167 cri.go:89] found id: ""
I0210 11:45:27.880398 166167 logs.go:282] 0 containers: []
W0210 11:45:27.880408 166167 logs.go:284] No container was found matching "kube-proxy"
I0210 11:45:27.880416 166167 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0210 11:45:27.880480 166167 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0210 11:45:27.914577 166167 cri.go:89] found id: ""
I0210 11:45:27.914610 166167 logs.go:282] 0 containers: []
W0210 11:45:27.914619 166167 logs.go:284] No container was found matching "kube-controller-manager"
I0210 11:45:27.914626 166167 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0210 11:45:27.914688 166167 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0210 11:45:27.950823 166167 cri.go:89] found id: ""
I0210 11:45:27.950850 166167 logs.go:282] 0 containers: []
W0210 11:45:27.950860 166167 logs.go:284] No container was found matching "kindnet"
I0210 11:45:27.950874 166167 logs.go:123] Gathering logs for CRI-O ...
I0210 11:45:27.950892 166167 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0210 11:45:28.080317 166167 logs.go:123] Gathering logs for container status ...
I0210 11:45:28.080353 166167 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0210 11:45:28.129199 166167 logs.go:123] Gathering logs for kubelet ...
I0210 11:45:28.129230 166167 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0210 11:45:28.204138 166167 logs.go:123] Gathering logs for dmesg ...
I0210 11:45:28.204187 166167 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0210 11:45:28.220293 166167 logs.go:123] Gathering logs for describe nodes ...
I0210 11:45:28.220335 166167 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0210 11:45:28.410579 166167 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
W0210 11:45:28.410614 166167 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0210 11:45:28.410668 166167 out.go:270] *
*
W0210 11:45:28.410734 166167 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0210 11:45:28.410749 166167 out.go:270] *
*
W0210 11:45:28.411667 166167 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0210 11:45:28.415260 166167 out.go:201]
W0210 11:45:28.417191 166167 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0210 11:45:28.417257 166167 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0210 11:45:28.417284 166167 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0210 11:45:28.418762 166167 out.go:201]
** /stderr **
start_stop_delete_test.go:186: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-510006 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-510006 -n old-k8s-version-510006
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-510006 -n old-k8s-version-510006: exit status 6 (375.139677ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0210 11:45:28.851163 172131 status.go:458] kubeconfig endpoint: get endpoint: "old-k8s-version-510006" does not appear in /home/jenkins/minikube-integration/20385-109271/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-510006" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (295.09s)