=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:184: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-542356 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:184: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-542356 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m46.424341931s)
-- stdout --
* [old-k8s-version-542356] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=20316
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/20316-897624/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/20316-897624/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-542356" primary control-plane node in "old-k8s-version-542356" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0127 02:53:20.591117 945208 out.go:345] Setting OutFile to fd 1 ...
I0127 02:53:20.591233 945208 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0127 02:53:20.591244 945208 out.go:358] Setting ErrFile to fd 2...
I0127 02:53:20.591250 945208 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0127 02:53:20.591415 945208 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20316-897624/.minikube/bin
I0127 02:53:20.592123 945208 out.go:352] Setting JSON to false
I0127 02:53:20.593281 945208 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":12944,"bootTime":1737933457,"procs":209,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1074-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0127 02:53:20.593390 945208 start.go:139] virtualization: kvm guest
I0127 02:53:20.595501 945208 out.go:177] * [old-k8s-version-542356] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
I0127 02:53:20.596736 945208 out.go:177] - MINIKUBE_LOCATION=20316
I0127 02:53:20.596737 945208 notify.go:220] Checking for updates...
I0127 02:53:20.597929 945208 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0127 02:53:20.598991 945208 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/20316-897624/kubeconfig
I0127 02:53:20.600042 945208 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/20316-897624/.minikube
I0127 02:53:20.601146 945208 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0127 02:53:20.602226 945208 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0127 02:53:20.603636 945208 config.go:182] Loaded profile config "cert-expiration-591242": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.1
I0127 02:53:20.603733 945208 config.go:182] Loaded profile config "cert-options-919407": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.1
I0127 02:53:20.603816 945208 config.go:182] Loaded profile config "kubernetes-upgrade-080871": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0127 02:53:20.603914 945208 driver.go:394] Setting default libvirt URI to qemu:///system
I0127 02:53:20.640096 945208 out.go:177] * Using the kvm2 driver based on user configuration
I0127 02:53:20.641299 945208 start.go:297] selected driver: kvm2
I0127 02:53:20.641314 945208 start.go:901] validating driver "kvm2" against <nil>
I0127 02:53:20.641326 945208 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0127 02:53:20.642043 945208 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0127 02:53:20.642117 945208 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/20316-897624/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0127 02:53:20.658799 945208 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.35.0
I0127 02:53:20.658867 945208 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0127 02:53:20.659105 945208 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0127 02:53:20.659137 945208 cni.go:84] Creating CNI manager for ""
I0127 02:53:20.659180 945208 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0127 02:53:20.659191 945208 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0127 02:53:20.659249 945208 start.go:340] cluster config:
{Name:old-k8s-version-542356 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-542356 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRI
Socket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:
0 GPUs: AutoPauseInterval:1m0s}
I0127 02:53:20.659347 945208 iso.go:125] acquiring lock: {Name:mkbbe08fa3daa2372045069667a0a52e0e34abd9 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0127 02:53:20.660941 945208 out.go:177] * Starting "old-k8s-version-542356" primary control-plane node in "old-k8s-version-542356" cluster
I0127 02:53:20.661866 945208 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0127 02:53:20.661897 945208 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20316-897624/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0127 02:53:20.661911 945208 cache.go:56] Caching tarball of preloaded images
I0127 02:53:20.661990 945208 preload.go:172] Found /home/jenkins/minikube-integration/20316-897624/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0127 02:53:20.662000 945208 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0127 02:53:20.662101 945208 profile.go:143] Saving config to /home/jenkins/minikube-integration/20316-897624/.minikube/profiles/old-k8s-version-542356/config.json ...
I0127 02:53:20.662119 945208 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20316-897624/.minikube/profiles/old-k8s-version-542356/config.json: {Name:mk3f5775f38647571fb96d56da7302e4c862ca91 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 02:53:20.662238 945208 start.go:360] acquireMachinesLock for old-k8s-version-542356: {Name:mke71211974c740845fb9b00041df14f4e3ecd74 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0127 02:53:29.881489 945208 start.go:364] duration metric: took 9.219191664s to acquireMachinesLock for "old-k8s-version-542356"
I0127 02:53:29.881575 945208 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-542356 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-versi
on-542356 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMir
ror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0127 02:53:29.881718 945208 start.go:125] createHost starting for "" (driver="kvm2")
I0127 02:53:29.884361 945208 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0127 02:53:29.884618 945208 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0127 02:53:29.884677 945208 main.go:141] libmachine: Launching plugin server for driver kvm2
I0127 02:53:29.905727 945208 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44321
I0127 02:53:29.906225 945208 main.go:141] libmachine: () Calling .GetVersion
I0127 02:53:29.906826 945208 main.go:141] libmachine: Using API Version 1
I0127 02:53:29.906854 945208 main.go:141] libmachine: () Calling .SetConfigRaw
I0127 02:53:29.907304 945208 main.go:141] libmachine: () Calling .GetMachineName
I0127 02:53:29.907595 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetMachineName
I0127 02:53:29.907834 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .DriverName
I0127 02:53:29.908013 945208 start.go:159] libmachine.API.Create for "old-k8s-version-542356" (driver="kvm2")
I0127 02:53:29.908042 945208 client.go:168] LocalClient.Create starting
I0127 02:53:29.908077 945208 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20316-897624/.minikube/certs/ca.pem
I0127 02:53:29.908119 945208 main.go:141] libmachine: Decoding PEM data...
I0127 02:53:29.908140 945208 main.go:141] libmachine: Parsing certificate...
I0127 02:53:29.908228 945208 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20316-897624/.minikube/certs/cert.pem
I0127 02:53:29.908260 945208 main.go:141] libmachine: Decoding PEM data...
I0127 02:53:29.908279 945208 main.go:141] libmachine: Parsing certificate...
I0127 02:53:29.908311 945208 main.go:141] libmachine: Running pre-create checks...
I0127 02:53:29.908326 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .PreCreateCheck
I0127 02:53:29.908690 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetConfigRaw
I0127 02:53:29.909232 945208 main.go:141] libmachine: Creating machine...
I0127 02:53:29.909256 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .Create
I0127 02:53:29.909397 945208 main.go:141] libmachine: (old-k8s-version-542356) creating KVM machine...
I0127 02:53:29.909427 945208 main.go:141] libmachine: (old-k8s-version-542356) creating network...
I0127 02:53:29.910732 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | found existing default KVM network
I0127 02:53:29.912386 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | I0127 02:53:29.912264 945293 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00027c040}
I0127 02:53:29.912448 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | created network xml:
I0127 02:53:29.912468 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | <network>
I0127 02:53:29.912482 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | <name>mk-old-k8s-version-542356</name>
I0127 02:53:29.912501 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | <dns enable='no'/>
I0127 02:53:29.912509 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG |
I0127 02:53:29.912516 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | <ip address='192.168.39.1' netmask='255.255.255.0'>
I0127 02:53:29.912524 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | <dhcp>
I0127 02:53:29.912530 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | <range start='192.168.39.2' end='192.168.39.253'/>
I0127 02:53:29.912538 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | </dhcp>
I0127 02:53:29.912542 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | </ip>
I0127 02:53:29.912557 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG |
I0127 02:53:29.912564 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | </network>
I0127 02:53:29.912585 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG |
I0127 02:53:29.918063 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | trying to create private KVM network mk-old-k8s-version-542356 192.168.39.0/24...
I0127 02:53:29.991420 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | private KVM network mk-old-k8s-version-542356 192.168.39.0/24 created
I0127 02:53:29.991452 945208 main.go:141] libmachine: (old-k8s-version-542356) setting up store path in /home/jenkins/minikube-integration/20316-897624/.minikube/machines/old-k8s-version-542356 ...
I0127 02:53:29.991481 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | I0127 02:53:29.991394 945293 common.go:144] Making disk image using store path: /home/jenkins/minikube-integration/20316-897624/.minikube
I0127 02:53:29.991501 945208 main.go:141] libmachine: (old-k8s-version-542356) building disk image from file:///home/jenkins/minikube-integration/20316-897624/.minikube/cache/iso/amd64/minikube-v1.35.0-amd64.iso
I0127 02:53:29.991563 945208 main.go:141] libmachine: (old-k8s-version-542356) Downloading /home/jenkins/minikube-integration/20316-897624/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/20316-897624/.minikube/cache/iso/amd64/minikube-v1.35.0-amd64.iso...
I0127 02:53:30.283304 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | I0127 02:53:30.283160 945293 common.go:151] Creating ssh key: /home/jenkins/minikube-integration/20316-897624/.minikube/machines/old-k8s-version-542356/id_rsa...
I0127 02:53:30.340435 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | I0127 02:53:30.340298 945293 common.go:157] Creating raw disk image: /home/jenkins/minikube-integration/20316-897624/.minikube/machines/old-k8s-version-542356/old-k8s-version-542356.rawdisk...
I0127 02:53:30.340471 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | Writing magic tar header
I0127 02:53:30.340486 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | Writing SSH key tar header
I0127 02:53:30.340516 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | I0127 02:53:30.340414 945293 common.go:171] Fixing permissions on /home/jenkins/minikube-integration/20316-897624/.minikube/machines/old-k8s-version-542356 ...
I0127 02:53:30.340537 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20316-897624/.minikube/machines/old-k8s-version-542356
I0127 02:53:30.340555 945208 main.go:141] libmachine: (old-k8s-version-542356) setting executable bit set on /home/jenkins/minikube-integration/20316-897624/.minikube/machines/old-k8s-version-542356 (perms=drwx------)
I0127 02:53:30.340570 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20316-897624/.minikube/machines
I0127 02:53:30.340585 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20316-897624/.minikube
I0127 02:53:30.340597 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20316-897624
I0127 02:53:30.340612 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | checking permissions on dir: /home/jenkins/minikube-integration
I0127 02:53:30.340622 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | checking permissions on dir: /home/jenkins
I0127 02:53:30.340632 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | checking permissions on dir: /home
I0127 02:53:30.340653 945208 main.go:141] libmachine: (old-k8s-version-542356) setting executable bit set on /home/jenkins/minikube-integration/20316-897624/.minikube/machines (perms=drwxr-xr-x)
I0127 02:53:30.340665 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | skipping /home - not owner
I0127 02:53:30.340708 945208 main.go:141] libmachine: (old-k8s-version-542356) setting executable bit set on /home/jenkins/minikube-integration/20316-897624/.minikube (perms=drwxr-xr-x)
I0127 02:53:30.340744 945208 main.go:141] libmachine: (old-k8s-version-542356) setting executable bit set on /home/jenkins/minikube-integration/20316-897624 (perms=drwxrwxr-x)
I0127 02:53:30.340756 945208 main.go:141] libmachine: (old-k8s-version-542356) setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0127 02:53:30.340770 945208 main.go:141] libmachine: (old-k8s-version-542356) setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0127 02:53:30.340784 945208 main.go:141] libmachine: (old-k8s-version-542356) creating domain...
I0127 02:53:30.341832 945208 main.go:141] libmachine: (old-k8s-version-542356) define libvirt domain using xml:
I0127 02:53:30.341863 945208 main.go:141] libmachine: (old-k8s-version-542356) <domain type='kvm'>
I0127 02:53:30.341889 945208 main.go:141] libmachine: (old-k8s-version-542356) <name>old-k8s-version-542356</name>
I0127 02:53:30.341901 945208 main.go:141] libmachine: (old-k8s-version-542356) <memory unit='MiB'>2200</memory>
I0127 02:53:30.341908 945208 main.go:141] libmachine: (old-k8s-version-542356) <vcpu>2</vcpu>
I0127 02:53:30.341918 945208 main.go:141] libmachine: (old-k8s-version-542356) <features>
I0127 02:53:30.341927 945208 main.go:141] libmachine: (old-k8s-version-542356) <acpi/>
I0127 02:53:30.341937 945208 main.go:141] libmachine: (old-k8s-version-542356) <apic/>
I0127 02:53:30.341956 945208 main.go:141] libmachine: (old-k8s-version-542356) <pae/>
I0127 02:53:30.341967 945208 main.go:141] libmachine: (old-k8s-version-542356)
I0127 02:53:30.341997 945208 main.go:141] libmachine: (old-k8s-version-542356) </features>
I0127 02:53:30.342022 945208 main.go:141] libmachine: (old-k8s-version-542356) <cpu mode='host-passthrough'>
I0127 02:53:30.342050 945208 main.go:141] libmachine: (old-k8s-version-542356)
I0127 02:53:30.342073 945208 main.go:141] libmachine: (old-k8s-version-542356) </cpu>
I0127 02:53:30.342086 945208 main.go:141] libmachine: (old-k8s-version-542356) <os>
I0127 02:53:30.342097 945208 main.go:141] libmachine: (old-k8s-version-542356) <type>hvm</type>
I0127 02:53:30.342109 945208 main.go:141] libmachine: (old-k8s-version-542356) <boot dev='cdrom'/>
I0127 02:53:30.342119 945208 main.go:141] libmachine: (old-k8s-version-542356) <boot dev='hd'/>
I0127 02:53:30.342129 945208 main.go:141] libmachine: (old-k8s-version-542356) <bootmenu enable='no'/>
I0127 02:53:30.342139 945208 main.go:141] libmachine: (old-k8s-version-542356) </os>
I0127 02:53:30.342149 945208 main.go:141] libmachine: (old-k8s-version-542356) <devices>
I0127 02:53:30.342165 945208 main.go:141] libmachine: (old-k8s-version-542356) <disk type='file' device='cdrom'>
I0127 02:53:30.342184 945208 main.go:141] libmachine: (old-k8s-version-542356) <source file='/home/jenkins/minikube-integration/20316-897624/.minikube/machines/old-k8s-version-542356/boot2docker.iso'/>
I0127 02:53:30.342208 945208 main.go:141] libmachine: (old-k8s-version-542356) <target dev='hdc' bus='scsi'/>
I0127 02:53:30.342221 945208 main.go:141] libmachine: (old-k8s-version-542356) <readonly/>
I0127 02:53:30.342228 945208 main.go:141] libmachine: (old-k8s-version-542356) </disk>
I0127 02:53:30.342248 945208 main.go:141] libmachine: (old-k8s-version-542356) <disk type='file' device='disk'>
I0127 02:53:30.342268 945208 main.go:141] libmachine: (old-k8s-version-542356) <driver name='qemu' type='raw' cache='default' io='threads' />
I0127 02:53:30.342287 945208 main.go:141] libmachine: (old-k8s-version-542356) <source file='/home/jenkins/minikube-integration/20316-897624/.minikube/machines/old-k8s-version-542356/old-k8s-version-542356.rawdisk'/>
I0127 02:53:30.342295 945208 main.go:141] libmachine: (old-k8s-version-542356) <target dev='hda' bus='virtio'/>
I0127 02:53:30.342319 945208 main.go:141] libmachine: (old-k8s-version-542356) </disk>
I0127 02:53:30.342330 945208 main.go:141] libmachine: (old-k8s-version-542356) <interface type='network'>
I0127 02:53:30.342352 945208 main.go:141] libmachine: (old-k8s-version-542356) <source network='mk-old-k8s-version-542356'/>
I0127 02:53:30.342372 945208 main.go:141] libmachine: (old-k8s-version-542356) <model type='virtio'/>
I0127 02:53:30.342390 945208 main.go:141] libmachine: (old-k8s-version-542356) </interface>
I0127 02:53:30.342407 945208 main.go:141] libmachine: (old-k8s-version-542356) <interface type='network'>
I0127 02:53:30.342421 945208 main.go:141] libmachine: (old-k8s-version-542356) <source network='default'/>
I0127 02:53:30.342431 945208 main.go:141] libmachine: (old-k8s-version-542356) <model type='virtio'/>
I0127 02:53:30.342441 945208 main.go:141] libmachine: (old-k8s-version-542356) </interface>
I0127 02:53:30.342452 945208 main.go:141] libmachine: (old-k8s-version-542356) <serial type='pty'>
I0127 02:53:30.342463 945208 main.go:141] libmachine: (old-k8s-version-542356) <target port='0'/>
I0127 02:53:30.342470 945208 main.go:141] libmachine: (old-k8s-version-542356) </serial>
I0127 02:53:30.342482 945208 main.go:141] libmachine: (old-k8s-version-542356) <console type='pty'>
I0127 02:53:30.342503 945208 main.go:141] libmachine: (old-k8s-version-542356) <target type='serial' port='0'/>
I0127 02:53:30.342514 945208 main.go:141] libmachine: (old-k8s-version-542356) </console>
I0127 02:53:30.342526 945208 main.go:141] libmachine: (old-k8s-version-542356) <rng model='virtio'>
I0127 02:53:30.342540 945208 main.go:141] libmachine: (old-k8s-version-542356) <backend model='random'>/dev/random</backend>
I0127 02:53:30.342549 945208 main.go:141] libmachine: (old-k8s-version-542356) </rng>
I0127 02:53:30.342560 945208 main.go:141] libmachine: (old-k8s-version-542356)
I0127 02:53:30.342598 945208 main.go:141] libmachine: (old-k8s-version-542356)
I0127 02:53:30.342619 945208 main.go:141] libmachine: (old-k8s-version-542356) </devices>
I0127 02:53:30.342639 945208 main.go:141] libmachine: (old-k8s-version-542356) </domain>
I0127 02:53:30.342658 945208 main.go:141] libmachine: (old-k8s-version-542356)
I0127 02:53:30.346354 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has defined MAC address 52:54:00:47:08:f3 in network default
I0127 02:53:30.347034 945208 main.go:141] libmachine: (old-k8s-version-542356) starting domain...
I0127 02:53:30.347057 945208 main.go:141] libmachine: (old-k8s-version-542356) ensuring networks are active...
I0127 02:53:30.347070 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has defined MAC address 52:54:00:12:05:b8 in network mk-old-k8s-version-542356
I0127 02:53:30.347827 945208 main.go:141] libmachine: (old-k8s-version-542356) Ensuring network default is active
I0127 02:53:30.348238 945208 main.go:141] libmachine: (old-k8s-version-542356) Ensuring network mk-old-k8s-version-542356 is active
I0127 02:53:30.348846 945208 main.go:141] libmachine: (old-k8s-version-542356) getting domain XML...
I0127 02:53:30.349600 945208 main.go:141] libmachine: (old-k8s-version-542356) creating domain...
I0127 02:53:31.727273 945208 main.go:141] libmachine: (old-k8s-version-542356) waiting for IP...
I0127 02:53:31.728390 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has defined MAC address 52:54:00:12:05:b8 in network mk-old-k8s-version-542356
I0127 02:53:31.729050 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | unable to find current IP address of domain old-k8s-version-542356 in network mk-old-k8s-version-542356
I0127 02:53:31.729157 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | I0127 02:53:31.729045 945293 retry.go:31] will retry after 275.135754ms: waiting for domain to come up
I0127 02:53:32.005706 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has defined MAC address 52:54:00:12:05:b8 in network mk-old-k8s-version-542356
I0127 02:53:32.006437 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | unable to find current IP address of domain old-k8s-version-542356 in network mk-old-k8s-version-542356
I0127 02:53:32.006469 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | I0127 02:53:32.006414 945293 retry.go:31] will retry after 355.59506ms: waiting for domain to come up
I0127 02:53:32.363997 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has defined MAC address 52:54:00:12:05:b8 in network mk-old-k8s-version-542356
I0127 02:53:32.364627 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | unable to find current IP address of domain old-k8s-version-542356 in network mk-old-k8s-version-542356
I0127 02:53:32.364660 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | I0127 02:53:32.364544 945293 retry.go:31] will retry after 393.566113ms: waiting for domain to come up
I0127 02:53:32.760448 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has defined MAC address 52:54:00:12:05:b8 in network mk-old-k8s-version-542356
I0127 02:53:32.761216 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | unable to find current IP address of domain old-k8s-version-542356 in network mk-old-k8s-version-542356
I0127 02:53:32.761241 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | I0127 02:53:32.761121 945293 retry.go:31] will retry after 584.426041ms: waiting for domain to come up
I0127 02:53:33.346879 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has defined MAC address 52:54:00:12:05:b8 in network mk-old-k8s-version-542356
I0127 02:53:33.347715 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | unable to find current IP address of domain old-k8s-version-542356 in network mk-old-k8s-version-542356
I0127 02:53:33.347738 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | I0127 02:53:33.347623 945293 retry.go:31] will retry after 520.895585ms: waiting for domain to come up
I0127 02:53:33.870315 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has defined MAC address 52:54:00:12:05:b8 in network mk-old-k8s-version-542356
I0127 02:53:33.870835 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | unable to find current IP address of domain old-k8s-version-542356 in network mk-old-k8s-version-542356
I0127 02:53:33.870904 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | I0127 02:53:33.870803 945293 retry.go:31] will retry after 576.924877ms: waiting for domain to come up
I0127 02:53:34.450049 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has defined MAC address 52:54:00:12:05:b8 in network mk-old-k8s-version-542356
I0127 02:53:34.450629 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | unable to find current IP address of domain old-k8s-version-542356 in network mk-old-k8s-version-542356
I0127 02:53:34.450659 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | I0127 02:53:34.450603 945293 retry.go:31] will retry after 1.183336679s: waiting for domain to come up
I0127 02:53:35.635244 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has defined MAC address 52:54:00:12:05:b8 in network mk-old-k8s-version-542356
I0127 02:53:35.635731 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | unable to find current IP address of domain old-k8s-version-542356 in network mk-old-k8s-version-542356
I0127 02:53:35.635757 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | I0127 02:53:35.635697 945293 retry.go:31] will retry after 1.476025852s: waiting for domain to come up
I0127 02:53:37.114033 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has defined MAC address 52:54:00:12:05:b8 in network mk-old-k8s-version-542356
I0127 02:53:37.114631 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | unable to find current IP address of domain old-k8s-version-542356 in network mk-old-k8s-version-542356
I0127 02:53:37.114664 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | I0127 02:53:37.114593 945293 retry.go:31] will retry after 1.40651394s: waiting for domain to come up
I0127 02:53:38.523211 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has defined MAC address 52:54:00:12:05:b8 in network mk-old-k8s-version-542356
I0127 02:53:38.523788 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | unable to find current IP address of domain old-k8s-version-542356 in network mk-old-k8s-version-542356
I0127 02:53:38.523810 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | I0127 02:53:38.523753 945293 retry.go:31] will retry after 1.787814568s: waiting for domain to come up
I0127 02:53:40.312989 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has defined MAC address 52:54:00:12:05:b8 in network mk-old-k8s-version-542356
I0127 02:53:40.313445 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | unable to find current IP address of domain old-k8s-version-542356 in network mk-old-k8s-version-542356
I0127 02:53:40.313519 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | I0127 02:53:40.313428 945293 retry.go:31] will retry after 2.760070418s: waiting for domain to come up
I0127 02:53:43.075239 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has defined MAC address 52:54:00:12:05:b8 in network mk-old-k8s-version-542356
I0127 02:53:43.075847 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | unable to find current IP address of domain old-k8s-version-542356 in network mk-old-k8s-version-542356
I0127 02:53:43.075876 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | I0127 02:53:43.075806 945293 retry.go:31] will retry after 3.233218224s: waiting for domain to come up
I0127 02:53:46.310775 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has defined MAC address 52:54:00:12:05:b8 in network mk-old-k8s-version-542356
I0127 02:53:46.311227 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | unable to find current IP address of domain old-k8s-version-542356 in network mk-old-k8s-version-542356
I0127 02:53:46.311254 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | I0127 02:53:46.311195 945293 retry.go:31] will retry after 3.961475695s: waiting for domain to come up
I0127 02:53:50.274680 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has defined MAC address 52:54:00:12:05:b8 in network mk-old-k8s-version-542356
I0127 02:53:50.275146 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | unable to find current IP address of domain old-k8s-version-542356 in network mk-old-k8s-version-542356
I0127 02:53:50.275187 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | I0127 02:53:50.275118 945293 retry.go:31] will retry after 5.672063581s: waiting for domain to come up
I0127 02:53:55.948559 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has defined MAC address 52:54:00:12:05:b8 in network mk-old-k8s-version-542356
I0127 02:53:55.949178 945208 main.go:141] libmachine: (old-k8s-version-542356) found domain IP: 192.168.39.85
I0127 02:53:55.949211 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has current primary IP address 192.168.39.85 and MAC address 52:54:00:12:05:b8 in network mk-old-k8s-version-542356
I0127 02:53:55.949221 945208 main.go:141] libmachine: (old-k8s-version-542356) reserving static IP address...
I0127 02:53:55.949572 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-542356", mac: "52:54:00:12:05:b8", ip: "192.168.39.85"} in network mk-old-k8s-version-542356
I0127 02:53:56.024835 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | Getting to WaitForSSH function...
I0127 02:53:56.024869 945208 main.go:141] libmachine: (old-k8s-version-542356) reserved static IP address 192.168.39.85 for domain old-k8s-version-542356
I0127 02:53:56.024883 945208 main.go:141] libmachine: (old-k8s-version-542356) waiting for SSH...
I0127 02:53:56.027983 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has defined MAC address 52:54:00:12:05:b8 in network mk-old-k8s-version-542356
I0127 02:53:56.028441 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:12:05:b8", ip: ""} in network mk-old-k8s-version-542356: {Iface:virbr1 ExpiryTime:2025-01-27 03:53:45 +0000 UTC Type:0 Mac:52:54:00:12:05:b8 Iaid: IPaddr:192.168.39.85 Prefix:24 Hostname:minikube Clientid:01:52:54:00:12:05:b8}
I0127 02:53:56.028470 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has defined IP address 192.168.39.85 and MAC address 52:54:00:12:05:b8 in network mk-old-k8s-version-542356
I0127 02:53:56.028648 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | Using SSH client type: external
I0127 02:53:56.028677 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | Using SSH private key: /home/jenkins/minikube-integration/20316-897624/.minikube/machines/old-k8s-version-542356/id_rsa (-rw-------)
I0127 02:53:56.028728 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.85 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/20316-897624/.minikube/machines/old-k8s-version-542356/id_rsa -p 22] /usr/bin/ssh <nil>}
I0127 02:53:56.028741 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | About to run SSH command:
I0127 02:53:56.028758 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | exit 0
I0127 02:53:56.152888 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | SSH cmd err, output: <nil>:
I0127 02:53:56.153196 945208 main.go:141] libmachine: (old-k8s-version-542356) KVM machine creation complete
I0127 02:53:56.153557 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetConfigRaw
I0127 02:53:56.154154 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .DriverName
I0127 02:53:56.154363 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .DriverName
I0127 02:53:56.154530 945208 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0127 02:53:56.154545 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetState
I0127 02:53:56.155760 945208 main.go:141] libmachine: Detecting operating system of created instance...
I0127 02:53:56.155773 945208 main.go:141] libmachine: Waiting for SSH to be available...
I0127 02:53:56.155778 945208 main.go:141] libmachine: Getting to WaitForSSH function...
I0127 02:53:56.155783 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetSSHHostname
I0127 02:53:56.158256 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has defined MAC address 52:54:00:12:05:b8 in network mk-old-k8s-version-542356
I0127 02:53:56.158675 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:12:05:b8", ip: ""} in network mk-old-k8s-version-542356: {Iface:virbr1 ExpiryTime:2025-01-27 03:53:45 +0000 UTC Type:0 Mac:52:54:00:12:05:b8 Iaid: IPaddr:192.168.39.85 Prefix:24 Hostname:old-k8s-version-542356 Clientid:01:52:54:00:12:05:b8}
I0127 02:53:56.158703 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has defined IP address 192.168.39.85 and MAC address 52:54:00:12:05:b8 in network mk-old-k8s-version-542356
I0127 02:53:56.158866 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetSSHPort
I0127 02:53:56.159046 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetSSHKeyPath
I0127 02:53:56.159248 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetSSHKeyPath
I0127 02:53:56.159412 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetSSHUsername
I0127 02:53:56.159601 945208 main.go:141] libmachine: Using SSH client type: native
I0127 02:53:56.159842 945208 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.39.85 22 <nil> <nil>}
I0127 02:53:56.159855 945208 main.go:141] libmachine: About to run SSH command:
exit 0
I0127 02:53:56.260011 945208 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0127 02:53:56.260038 945208 main.go:141] libmachine: Detecting the provisioner...
I0127 02:53:56.260048 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetSSHHostname
I0127 02:53:56.262881 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has defined MAC address 52:54:00:12:05:b8 in network mk-old-k8s-version-542356
I0127 02:53:56.263229 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:12:05:b8", ip: ""} in network mk-old-k8s-version-542356: {Iface:virbr1 ExpiryTime:2025-01-27 03:53:45 +0000 UTC Type:0 Mac:52:54:00:12:05:b8 Iaid: IPaddr:192.168.39.85 Prefix:24 Hostname:old-k8s-version-542356 Clientid:01:52:54:00:12:05:b8}
I0127 02:53:56.263271 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has defined IP address 192.168.39.85 and MAC address 52:54:00:12:05:b8 in network mk-old-k8s-version-542356
I0127 02:53:56.263460 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetSSHPort
I0127 02:53:56.263666 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetSSHKeyPath
I0127 02:53:56.263841 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetSSHKeyPath
I0127 02:53:56.263989 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetSSHUsername
I0127 02:53:56.264149 945208 main.go:141] libmachine: Using SSH client type: native
I0127 02:53:56.264377 945208 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.39.85 22 <nil> <nil>}
I0127 02:53:56.264391 945208 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0127 02:53:56.365368 945208 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0127 02:53:56.365447 945208 main.go:141] libmachine: found compatible host: buildroot
I0127 02:53:56.365457 945208 main.go:141] libmachine: Provisioning with buildroot...
I0127 02:53:56.365464 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetMachineName
I0127 02:53:56.365728 945208 buildroot.go:166] provisioning hostname "old-k8s-version-542356"
I0127 02:53:56.365793 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetMachineName
I0127 02:53:56.365966 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetSSHHostname
I0127 02:53:56.369816 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has defined MAC address 52:54:00:12:05:b8 in network mk-old-k8s-version-542356
I0127 02:53:56.370214 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:12:05:b8", ip: ""} in network mk-old-k8s-version-542356: {Iface:virbr1 ExpiryTime:2025-01-27 03:53:45 +0000 UTC Type:0 Mac:52:54:00:12:05:b8 Iaid: IPaddr:192.168.39.85 Prefix:24 Hostname:old-k8s-version-542356 Clientid:01:52:54:00:12:05:b8}
I0127 02:53:56.370237 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has defined IP address 192.168.39.85 and MAC address 52:54:00:12:05:b8 in network mk-old-k8s-version-542356
I0127 02:53:56.370432 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetSSHPort
I0127 02:53:56.370646 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetSSHKeyPath
I0127 02:53:56.370790 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetSSHKeyPath
I0127 02:53:56.370908 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetSSHUsername
I0127 02:53:56.371035 945208 main.go:141] libmachine: Using SSH client type: native
I0127 02:53:56.371221 945208 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.39.85 22 <nil> <nil>}
I0127 02:53:56.371240 945208 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-542356 && echo "old-k8s-version-542356" | sudo tee /etc/hostname
I0127 02:53:56.490225 945208 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-542356
I0127 02:53:56.490266 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetSSHHostname
I0127 02:53:56.493340 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has defined MAC address 52:54:00:12:05:b8 in network mk-old-k8s-version-542356
I0127 02:53:56.493699 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:12:05:b8", ip: ""} in network mk-old-k8s-version-542356: {Iface:virbr1 ExpiryTime:2025-01-27 03:53:45 +0000 UTC Type:0 Mac:52:54:00:12:05:b8 Iaid: IPaddr:192.168.39.85 Prefix:24 Hostname:old-k8s-version-542356 Clientid:01:52:54:00:12:05:b8}
I0127 02:53:56.493740 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has defined IP address 192.168.39.85 and MAC address 52:54:00:12:05:b8 in network mk-old-k8s-version-542356
I0127 02:53:56.493932 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetSSHPort
I0127 02:53:56.494141 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetSSHKeyPath
I0127 02:53:56.494310 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetSSHKeyPath
I0127 02:53:56.494491 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetSSHUsername
I0127 02:53:56.494632 945208 main.go:141] libmachine: Using SSH client type: native
I0127 02:53:56.494806 945208 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.39.85 22 <nil> <nil>}
I0127 02:53:56.494822 945208 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-542356' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-542356/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-542356' | sudo tee -a /etc/hosts;
fi
fi
I0127 02:53:56.605701 945208 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0127 02:53:56.605750 945208 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/20316-897624/.minikube CaCertPath:/home/jenkins/minikube-integration/20316-897624/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20316-897624/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20316-897624/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20316-897624/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20316-897624/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20316-897624/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20316-897624/.minikube}
I0127 02:53:56.605789 945208 buildroot.go:174] setting up certificates
I0127 02:53:56.605800 945208 provision.go:84] configureAuth start
I0127 02:53:56.605814 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetMachineName
I0127 02:53:56.606138 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetIP
I0127 02:53:56.608980 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has defined MAC address 52:54:00:12:05:b8 in network mk-old-k8s-version-542356
I0127 02:53:56.609351 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:12:05:b8", ip: ""} in network mk-old-k8s-version-542356: {Iface:virbr1 ExpiryTime:2025-01-27 03:53:45 +0000 UTC Type:0 Mac:52:54:00:12:05:b8 Iaid: IPaddr:192.168.39.85 Prefix:24 Hostname:old-k8s-version-542356 Clientid:01:52:54:00:12:05:b8}
I0127 02:53:56.609375 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has defined IP address 192.168.39.85 and MAC address 52:54:00:12:05:b8 in network mk-old-k8s-version-542356
I0127 02:53:56.609504 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetSSHHostname
I0127 02:53:56.611629 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has defined MAC address 52:54:00:12:05:b8 in network mk-old-k8s-version-542356
I0127 02:53:56.612060 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:12:05:b8", ip: ""} in network mk-old-k8s-version-542356: {Iface:virbr1 ExpiryTime:2025-01-27 03:53:45 +0000 UTC Type:0 Mac:52:54:00:12:05:b8 Iaid: IPaddr:192.168.39.85 Prefix:24 Hostname:old-k8s-version-542356 Clientid:01:52:54:00:12:05:b8}
I0127 02:53:56.612134 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has defined IP address 192.168.39.85 and MAC address 52:54:00:12:05:b8 in network mk-old-k8s-version-542356
I0127 02:53:56.612211 945208 provision.go:143] copyHostCerts
I0127 02:53:56.612273 945208 exec_runner.go:144] found /home/jenkins/minikube-integration/20316-897624/.minikube/ca.pem, removing ...
I0127 02:53:56.612293 945208 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20316-897624/.minikube/ca.pem
I0127 02:53:56.612350 945208 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20316-897624/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20316-897624/.minikube/ca.pem (1078 bytes)
I0127 02:53:56.612488 945208 exec_runner.go:144] found /home/jenkins/minikube-integration/20316-897624/.minikube/cert.pem, removing ...
I0127 02:53:56.612506 945208 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20316-897624/.minikube/cert.pem
I0127 02:53:56.612531 945208 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20316-897624/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20316-897624/.minikube/cert.pem (1123 bytes)
I0127 02:53:56.612596 945208 exec_runner.go:144] found /home/jenkins/minikube-integration/20316-897624/.minikube/key.pem, removing ...
I0127 02:53:56.612603 945208 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20316-897624/.minikube/key.pem
I0127 02:53:56.612621 945208 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20316-897624/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20316-897624/.minikube/key.pem (1679 bytes)
I0127 02:53:56.612691 945208 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20316-897624/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20316-897624/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20316-897624/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-542356 san=[127.0.0.1 192.168.39.85 localhost minikube old-k8s-version-542356]
I0127 02:53:56.675497 945208 provision.go:177] copyRemoteCerts
I0127 02:53:56.675569 945208 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0127 02:53:56.675596 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetSSHHostname
I0127 02:53:56.678431 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has defined MAC address 52:54:00:12:05:b8 in network mk-old-k8s-version-542356
I0127 02:53:56.678778 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:12:05:b8", ip: ""} in network mk-old-k8s-version-542356: {Iface:virbr1 ExpiryTime:2025-01-27 03:53:45 +0000 UTC Type:0 Mac:52:54:00:12:05:b8 Iaid: IPaddr:192.168.39.85 Prefix:24 Hostname:old-k8s-version-542356 Clientid:01:52:54:00:12:05:b8}
I0127 02:53:56.678811 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has defined IP address 192.168.39.85 and MAC address 52:54:00:12:05:b8 in network mk-old-k8s-version-542356
I0127 02:53:56.678972 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetSSHPort
I0127 02:53:56.679163 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetSSHKeyPath
I0127 02:53:56.679303 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetSSHUsername
I0127 02:53:56.679455 945208 sshutil.go:53] new ssh client: &{IP:192.168.39.85 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20316-897624/.minikube/machines/old-k8s-version-542356/id_rsa Username:docker}
I0127 02:53:56.758628 945208 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20316-897624/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0127 02:53:56.782919 945208 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20316-897624/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0127 02:53:56.806768 945208 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20316-897624/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0127 02:53:56.830644 945208 provision.go:87] duration metric: took 224.826497ms to configureAuth
I0127 02:53:56.830680 945208 buildroot.go:189] setting minikube options for container-runtime
I0127 02:53:56.830901 945208 config.go:182] Loaded profile config "old-k8s-version-542356": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0127 02:53:56.830996 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetSSHHostname
I0127 02:53:56.833909 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has defined MAC address 52:54:00:12:05:b8 in network mk-old-k8s-version-542356
I0127 02:53:56.834221 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:12:05:b8", ip: ""} in network mk-old-k8s-version-542356: {Iface:virbr1 ExpiryTime:2025-01-27 03:53:45 +0000 UTC Type:0 Mac:52:54:00:12:05:b8 Iaid: IPaddr:192.168.39.85 Prefix:24 Hostname:old-k8s-version-542356 Clientid:01:52:54:00:12:05:b8}
I0127 02:53:56.834248 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has defined IP address 192.168.39.85 and MAC address 52:54:00:12:05:b8 in network mk-old-k8s-version-542356
I0127 02:53:56.834435 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetSSHPort
I0127 02:53:56.834660 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetSSHKeyPath
I0127 02:53:56.834812 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetSSHKeyPath
I0127 02:53:56.834945 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetSSHUsername
I0127 02:53:56.835099 945208 main.go:141] libmachine: Using SSH client type: native
I0127 02:53:56.835292 945208 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.39.85 22 <nil> <nil>}
I0127 02:53:56.835310 945208 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0127 02:53:57.055115 945208 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0127 02:53:57.055149 945208 main.go:141] libmachine: Checking connection to Docker...
I0127 02:53:57.055158 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetURL
I0127 02:53:57.056510 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | using libvirt version 6000000
I0127 02:53:57.059078 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has defined MAC address 52:54:00:12:05:b8 in network mk-old-k8s-version-542356
I0127 02:53:57.059428 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:12:05:b8", ip: ""} in network mk-old-k8s-version-542356: {Iface:virbr1 ExpiryTime:2025-01-27 03:53:45 +0000 UTC Type:0 Mac:52:54:00:12:05:b8 Iaid: IPaddr:192.168.39.85 Prefix:24 Hostname:old-k8s-version-542356 Clientid:01:52:54:00:12:05:b8}
I0127 02:53:57.059461 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has defined IP address 192.168.39.85 and MAC address 52:54:00:12:05:b8 in network mk-old-k8s-version-542356
I0127 02:53:57.059600 945208 main.go:141] libmachine: Docker is up and running!
I0127 02:53:57.059615 945208 main.go:141] libmachine: Reticulating splines...
I0127 02:53:57.059623 945208 client.go:171] duration metric: took 27.151572592s to LocalClient.Create
I0127 02:53:57.059647 945208 start.go:167] duration metric: took 27.151636437s to libmachine.API.Create "old-k8s-version-542356"
I0127 02:53:57.059657 945208 start.go:293] postStartSetup for "old-k8s-version-542356" (driver="kvm2")
I0127 02:53:57.059668 945208 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0127 02:53:57.059685 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .DriverName
I0127 02:53:57.059951 945208 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0127 02:53:57.059981 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetSSHHostname
I0127 02:53:57.062263 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has defined MAC address 52:54:00:12:05:b8 in network mk-old-k8s-version-542356
I0127 02:53:57.062628 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:12:05:b8", ip: ""} in network mk-old-k8s-version-542356: {Iface:virbr1 ExpiryTime:2025-01-27 03:53:45 +0000 UTC Type:0 Mac:52:54:00:12:05:b8 Iaid: IPaddr:192.168.39.85 Prefix:24 Hostname:old-k8s-version-542356 Clientid:01:52:54:00:12:05:b8}
I0127 02:53:57.062674 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has defined IP address 192.168.39.85 and MAC address 52:54:00:12:05:b8 in network mk-old-k8s-version-542356
I0127 02:53:57.062815 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetSSHPort
I0127 02:53:57.062988 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetSSHKeyPath
I0127 02:53:57.063159 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetSSHUsername
I0127 02:53:57.063302 945208 sshutil.go:53] new ssh client: &{IP:192.168.39.85 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20316-897624/.minikube/machines/old-k8s-version-542356/id_rsa Username:docker}
I0127 02:53:57.143136 945208 ssh_runner.go:195] Run: cat /etc/os-release
I0127 02:53:57.147078 945208 info.go:137] Remote host: Buildroot 2023.02.9
I0127 02:53:57.147110 945208 filesync.go:126] Scanning /home/jenkins/minikube-integration/20316-897624/.minikube/addons for local assets ...
I0127 02:53:57.147181 945208 filesync.go:126] Scanning /home/jenkins/minikube-integration/20316-897624/.minikube/files for local assets ...
I0127 02:53:57.147291 945208 filesync.go:149] local asset: /home/jenkins/minikube-integration/20316-897624/.minikube/files/etc/ssl/certs/9048892.pem -> 9048892.pem in /etc/ssl/certs
I0127 02:53:57.147394 945208 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0127 02:53:57.156298 945208 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20316-897624/.minikube/files/etc/ssl/certs/9048892.pem --> /etc/ssl/certs/9048892.pem (1708 bytes)
I0127 02:53:57.178014 945208 start.go:296] duration metric: took 118.341349ms for postStartSetup
I0127 02:53:57.178084 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetConfigRaw
I0127 02:53:57.178737 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetIP
I0127 02:53:57.181300 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has defined MAC address 52:54:00:12:05:b8 in network mk-old-k8s-version-542356
I0127 02:53:57.181648 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:12:05:b8", ip: ""} in network mk-old-k8s-version-542356: {Iface:virbr1 ExpiryTime:2025-01-27 03:53:45 +0000 UTC Type:0 Mac:52:54:00:12:05:b8 Iaid: IPaddr:192.168.39.85 Prefix:24 Hostname:old-k8s-version-542356 Clientid:01:52:54:00:12:05:b8}
I0127 02:53:57.181675 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has defined IP address 192.168.39.85 and MAC address 52:54:00:12:05:b8 in network mk-old-k8s-version-542356
I0127 02:53:57.181950 945208 profile.go:143] Saving config to /home/jenkins/minikube-integration/20316-897624/.minikube/profiles/old-k8s-version-542356/config.json ...
I0127 02:53:57.182187 945208 start.go:128] duration metric: took 27.30045196s to createHost
I0127 02:53:57.182214 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetSSHHostname
I0127 02:53:57.184690 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has defined MAC address 52:54:00:12:05:b8 in network mk-old-k8s-version-542356
I0127 02:53:57.185039 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:12:05:b8", ip: ""} in network mk-old-k8s-version-542356: {Iface:virbr1 ExpiryTime:2025-01-27 03:53:45 +0000 UTC Type:0 Mac:52:54:00:12:05:b8 Iaid: IPaddr:192.168.39.85 Prefix:24 Hostname:old-k8s-version-542356 Clientid:01:52:54:00:12:05:b8}
I0127 02:53:57.185098 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has defined IP address 192.168.39.85 and MAC address 52:54:00:12:05:b8 in network mk-old-k8s-version-542356
I0127 02:53:57.185171 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetSSHPort
I0127 02:53:57.185362 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetSSHKeyPath
I0127 02:53:57.185511 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetSSHKeyPath
I0127 02:53:57.185633 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetSSHUsername
I0127 02:53:57.185796 945208 main.go:141] libmachine: Using SSH client type: native
I0127 02:53:57.185958 945208 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.39.85 22 <nil> <nil>}
I0127 02:53:57.185971 945208 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0127 02:53:57.285802 945208 main.go:141] libmachine: SSH cmd err, output: <nil>: 1737946437.263856841
I0127 02:53:57.285836 945208 fix.go:216] guest clock: 1737946437.263856841
I0127 02:53:57.285847 945208 fix.go:229] Guest: 2025-01-27 02:53:57.263856841 +0000 UTC Remote: 2025-01-27 02:53:57.182200571 +0000 UTC m=+36.631035117 (delta=81.65627ms)
I0127 02:53:57.285876 945208 fix.go:200] guest clock delta is within tolerance: 81.65627ms
I0127 02:53:57.285882 945208 start.go:83] releasing machines lock for "old-k8s-version-542356", held for 27.404350423s
I0127 02:53:57.285910 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .DriverName
I0127 02:53:57.286250 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetIP
I0127 02:53:57.289294 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has defined MAC address 52:54:00:12:05:b8 in network mk-old-k8s-version-542356
I0127 02:53:57.289703 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:12:05:b8", ip: ""} in network mk-old-k8s-version-542356: {Iface:virbr1 ExpiryTime:2025-01-27 03:53:45 +0000 UTC Type:0 Mac:52:54:00:12:05:b8 Iaid: IPaddr:192.168.39.85 Prefix:24 Hostname:old-k8s-version-542356 Clientid:01:52:54:00:12:05:b8}
I0127 02:53:57.289735 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has defined IP address 192.168.39.85 and MAC address 52:54:00:12:05:b8 in network mk-old-k8s-version-542356
I0127 02:53:57.289905 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .DriverName
I0127 02:53:57.290429 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .DriverName
I0127 02:53:57.290617 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .DriverName
I0127 02:53:57.290728 945208 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0127 02:53:57.290770 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetSSHHostname
I0127 02:53:57.290824 945208 ssh_runner.go:195] Run: cat /version.json
I0127 02:53:57.290840 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetSSHHostname
I0127 02:53:57.293664 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has defined MAC address 52:54:00:12:05:b8 in network mk-old-k8s-version-542356
I0127 02:53:57.293694 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has defined MAC address 52:54:00:12:05:b8 in network mk-old-k8s-version-542356
I0127 02:53:57.294089 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:12:05:b8", ip: ""} in network mk-old-k8s-version-542356: {Iface:virbr1 ExpiryTime:2025-01-27 03:53:45 +0000 UTC Type:0 Mac:52:54:00:12:05:b8 Iaid: IPaddr:192.168.39.85 Prefix:24 Hostname:old-k8s-version-542356 Clientid:01:52:54:00:12:05:b8}
I0127 02:53:57.294123 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has defined IP address 192.168.39.85 and MAC address 52:54:00:12:05:b8 in network mk-old-k8s-version-542356
I0127 02:53:57.294160 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:12:05:b8", ip: ""} in network mk-old-k8s-version-542356: {Iface:virbr1 ExpiryTime:2025-01-27 03:53:45 +0000 UTC Type:0 Mac:52:54:00:12:05:b8 Iaid: IPaddr:192.168.39.85 Prefix:24 Hostname:old-k8s-version-542356 Clientid:01:52:54:00:12:05:b8}
I0127 02:53:57.294182 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has defined IP address 192.168.39.85 and MAC address 52:54:00:12:05:b8 in network mk-old-k8s-version-542356
I0127 02:53:57.294284 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetSSHPort
I0127 02:53:57.294460 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetSSHPort
I0127 02:53:57.294498 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetSSHKeyPath
I0127 02:53:57.294609 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetSSHKeyPath
I0127 02:53:57.294692 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetSSHUsername
I0127 02:53:57.294750 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetSSHUsername
I0127 02:53:57.294840 945208 sshutil.go:53] new ssh client: &{IP:192.168.39.85 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20316-897624/.minikube/machines/old-k8s-version-542356/id_rsa Username:docker}
I0127 02:53:57.294875 945208 sshutil.go:53] new ssh client: &{IP:192.168.39.85 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20316-897624/.minikube/machines/old-k8s-version-542356/id_rsa Username:docker}
I0127 02:53:57.406388 945208 ssh_runner.go:195] Run: systemctl --version
I0127 02:53:57.413210 945208 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0127 02:53:57.572016 945208 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0127 02:53:57.578530 945208 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0127 02:53:57.578613 945208 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0127 02:53:57.597012 945208 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0127 02:53:57.597039 945208 start.go:495] detecting cgroup driver to use...
I0127 02:53:57.597119 945208 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0127 02:53:57.615700 945208 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0127 02:53:57.629822 945208 docker.go:217] disabling cri-docker service (if available) ...
I0127 02:53:57.629891 945208 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0127 02:53:57.643486 945208 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0127 02:53:57.658945 945208 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0127 02:53:57.797921 945208 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0127 02:53:57.936490 945208 docker.go:233] disabling docker service ...
I0127 02:53:57.936588 945208 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0127 02:53:57.950623 945208 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0127 02:53:57.967715 945208 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0127 02:53:58.100741 945208 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0127 02:53:58.216171 945208 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0127 02:53:58.229532 945208 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0127 02:53:58.248307 945208 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0127 02:53:58.248368 945208 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0127 02:53:58.259097 945208 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0127 02:53:58.259188 945208 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0127 02:53:58.270402 945208 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0127 02:53:58.285283 945208 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0127 02:53:58.299131 945208 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0127 02:53:58.313667 945208 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0127 02:53:58.324951 945208 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0127 02:53:58.325019 945208 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0127 02:53:58.343328 945208 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0127 02:53:58.353630 945208 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0127 02:53:58.488694 945208 ssh_runner.go:195] Run: sudo systemctl restart crio
I0127 02:53:58.582033 945208 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0127 02:53:58.582117 945208 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0127 02:53:58.587774 945208 start.go:563] Will wait 60s for crictl version
I0127 02:53:58.587883 945208 ssh_runner.go:195] Run: which crictl
I0127 02:53:58.591804 945208 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0127 02:53:58.633889 945208 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0127 02:53:58.633981 945208 ssh_runner.go:195] Run: crio --version
I0127 02:53:58.661257 945208 ssh_runner.go:195] Run: crio --version
I0127 02:53:58.702046 945208 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0127 02:53:58.703422 945208 main.go:141] libmachine: (old-k8s-version-542356) Calling .GetIP
I0127 02:53:58.706858 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has defined MAC address 52:54:00:12:05:b8 in network mk-old-k8s-version-542356
I0127 02:53:58.707291 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:12:05:b8", ip: ""} in network mk-old-k8s-version-542356: {Iface:virbr1 ExpiryTime:2025-01-27 03:53:45 +0000 UTC Type:0 Mac:52:54:00:12:05:b8 Iaid: IPaddr:192.168.39.85 Prefix:24 Hostname:old-k8s-version-542356 Clientid:01:52:54:00:12:05:b8}
I0127 02:53:58.707331 945208 main.go:141] libmachine: (old-k8s-version-542356) DBG | domain old-k8s-version-542356 has defined IP address 192.168.39.85 and MAC address 52:54:00:12:05:b8 in network mk-old-k8s-version-542356
I0127 02:53:58.707599 945208 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I0127 02:53:58.711650 945208 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0127 02:53:58.723701 945208 kubeadm.go:883] updating cluster {Name:old-k8s-version-542356 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-542356 Namespace
:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.85 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: D
isableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0127 02:53:58.723823 945208 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0127 02:53:58.723871 945208 ssh_runner.go:195] Run: sudo crictl images --output json
I0127 02:53:58.754877 945208 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0127 02:53:58.754954 945208 ssh_runner.go:195] Run: which lz4
I0127 02:53:58.759753 945208 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0127 02:53:58.764022 945208 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0127 02:53:58.764073 945208 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20316-897624/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0127 02:54:00.294475 945208 crio.go:462] duration metric: took 1.534757409s to copy over tarball
I0127 02:54:00.294575 945208 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0127 02:54:02.897105 945208 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.602496544s)
I0127 02:54:02.897145 945208 crio.go:469] duration metric: took 2.602633432s to extract the tarball
I0127 02:54:02.897156 945208 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0127 02:54:02.940069 945208 ssh_runner.go:195] Run: sudo crictl images --output json
I0127 02:54:02.985760 945208 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0127 02:54:02.985796 945208 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0127 02:54:02.985879 945208 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0127 02:54:02.985908 945208 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0127 02:54:02.985943 945208 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0127 02:54:02.985965 945208 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0127 02:54:02.985943 945208 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0127 02:54:02.985974 945208 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0127 02:54:02.986118 945208 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0127 02:54:02.986133 945208 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0127 02:54:02.987487 945208 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0127 02:54:02.987500 945208 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0127 02:54:02.987515 945208 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0127 02:54:02.987487 945208 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0127 02:54:02.987495 945208 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0127 02:54:02.987559 945208 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0127 02:54:02.987562 945208 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0127 02:54:02.987570 945208 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0127 02:54:03.177970 945208 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0127 02:54:03.187465 945208 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0127 02:54:03.207305 945208 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0127 02:54:03.216140 945208 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0127 02:54:03.218342 945208 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0127 02:54:03.239522 945208 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0127 02:54:03.245536 945208 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0127 02:54:03.257648 945208 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0127 02:54:03.257738 945208 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0127 02:54:03.257838 945208 ssh_runner.go:195] Run: which crictl
I0127 02:54:03.308597 945208 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0127 02:54:03.308651 945208 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0127 02:54:03.308713 945208 ssh_runner.go:195] Run: which crictl
I0127 02:54:03.321468 945208 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0127 02:54:03.321526 945208 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0127 02:54:03.321585 945208 ssh_runner.go:195] Run: which crictl
I0127 02:54:03.367877 945208 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0127 02:54:03.367932 945208 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0127 02:54:03.367956 945208 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0127 02:54:03.368005 945208 ssh_runner.go:195] Run: which crictl
I0127 02:54:03.367935 945208 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0127 02:54:03.368066 945208 ssh_runner.go:195] Run: which crictl
I0127 02:54:03.367898 945208 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0127 02:54:03.368153 945208 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0127 02:54:03.368185 945208 ssh_runner.go:195] Run: which crictl
I0127 02:54:03.376813 945208 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0127 02:54:03.376852 945208 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0127 02:54:03.376857 945208 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0127 02:54:03.376867 945208 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0127 02:54:03.376888 945208 ssh_runner.go:195] Run: which crictl
I0127 02:54:03.376824 945208 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0127 02:54:03.376954 945208 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0127 02:54:03.376982 945208 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0127 02:54:03.376955 945208 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0127 02:54:03.513464 945208 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0127 02:54:03.513496 945208 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0127 02:54:03.513496 945208 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0127 02:54:03.513561 945208 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0127 02:54:03.513593 945208 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0127 02:54:03.513633 945208 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0127 02:54:03.513648 945208 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0127 02:54:03.665764 945208 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0127 02:54:03.665824 945208 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0127 02:54:03.665779 945208 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0127 02:54:03.665881 945208 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0127 02:54:03.665903 945208 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0127 02:54:03.665982 945208 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0127 02:54:03.666023 945208 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0127 02:54:03.814889 945208 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20316-897624/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0127 02:54:03.814937 945208 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20316-897624/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0127 02:54:03.814995 945208 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20316-897624/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0127 02:54:03.815015 945208 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20316-897624/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0127 02:54:03.815107 945208 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20316-897624/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0127 02:54:03.815153 945208 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20316-897624/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0127 02:54:03.815223 945208 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0127 02:54:03.847321 945208 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20316-897624/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0127 02:54:04.275936 945208 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0127 02:54:04.424490 945208 cache_images.go:92] duration metric: took 1.438672925s to LoadCachedImages
W0127 02:54:04.424592 945208 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20316-897624/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20316-897624/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2: no such file or directory
I0127 02:54:04.424610 945208 kubeadm.go:934] updating node { 192.168.39.85 8443 v1.20.0 crio true true} ...
I0127 02:54:04.424742 945208 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-542356 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.39.85
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-542356 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0127 02:54:04.424841 945208 ssh_runner.go:195] Run: crio config
I0127 02:54:04.487145 945208 cni.go:84] Creating CNI manager for ""
I0127 02:54:04.487171 945208 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0127 02:54:04.487186 945208 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0127 02:54:04.487211 945208 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.85 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-542356 NodeName:old-k8s-version-542356 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.85"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.85 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Stati
cPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0127 02:54:04.487396 945208 kubeadm.go:195] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.39.85
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-542356"
kubeletExtraArgs:
node-ip: 192.168.39.85
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.39.85"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0127 02:54:04.487474 945208 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0127 02:54:04.497394 945208 binaries.go:44] Found k8s binaries, skipping transfer
I0127 02:54:04.497482 945208 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0127 02:54:04.506926 945208 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (429 bytes)
I0127 02:54:04.524895 945208 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0127 02:54:04.541155 945208 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2120 bytes)
I0127 02:54:04.559364 945208 ssh_runner.go:195] Run: grep 192.168.39.85 control-plane.minikube.internal$ /etc/hosts
I0127 02:54:04.564162 945208 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.85 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0127 02:54:04.577404 945208 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0127 02:54:04.703062 945208 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0127 02:54:04.719381 945208 certs.go:68] Setting up /home/jenkins/minikube-integration/20316-897624/.minikube/profiles/old-k8s-version-542356 for IP: 192.168.39.85
I0127 02:54:04.719412 945208 certs.go:194] generating shared ca certs ...
I0127 02:54:04.719437 945208 certs.go:226] acquiring lock for ca certs: {Name:mk2a0a86c4d196cb3cdcd1c836209954479044e3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 02:54:04.719628 945208 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20316-897624/.minikube/ca.key
I0127 02:54:04.719687 945208 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20316-897624/.minikube/proxy-client-ca.key
I0127 02:54:04.719702 945208 certs.go:256] generating profile certs ...
I0127 02:54:04.719775 945208 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/20316-897624/.minikube/profiles/old-k8s-version-542356/client.key
I0127 02:54:04.719796 945208 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20316-897624/.minikube/profiles/old-k8s-version-542356/client.crt with IP's: []
I0127 02:54:04.940153 945208 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20316-897624/.minikube/profiles/old-k8s-version-542356/client.crt ...
I0127 02:54:04.940185 945208 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20316-897624/.minikube/profiles/old-k8s-version-542356/client.crt: {Name:mk91f9f6c4890b70f204f4fd2166fa2bdcc4743d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 02:54:04.940365 945208 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20316-897624/.minikube/profiles/old-k8s-version-542356/client.key ...
I0127 02:54:04.940377 945208 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20316-897624/.minikube/profiles/old-k8s-version-542356/client.key: {Name:mk29192696aaf59b433b10bf5848ec37f46b68ea Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 02:54:04.940452 945208 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20316-897624/.minikube/profiles/old-k8s-version-542356/apiserver.key.4fcae880
I0127 02:54:04.940468 945208 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20316-897624/.minikube/profiles/old-k8s-version-542356/apiserver.crt.4fcae880 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.85]
I0127 02:54:05.063300 945208 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20316-897624/.minikube/profiles/old-k8s-version-542356/apiserver.crt.4fcae880 ...
I0127 02:54:05.063337 945208 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20316-897624/.minikube/profiles/old-k8s-version-542356/apiserver.crt.4fcae880: {Name:mkbd7ef4f80585fef7d77d14dd13bba21a6be5ff Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 02:54:05.063522 945208 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20316-897624/.minikube/profiles/old-k8s-version-542356/apiserver.key.4fcae880 ...
I0127 02:54:05.063542 945208 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20316-897624/.minikube/profiles/old-k8s-version-542356/apiserver.key.4fcae880: {Name:mkc1f0ae18825e2ba0a6ce052f6270c5e4883ba9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 02:54:05.063642 945208 certs.go:381] copying /home/jenkins/minikube-integration/20316-897624/.minikube/profiles/old-k8s-version-542356/apiserver.crt.4fcae880 -> /home/jenkins/minikube-integration/20316-897624/.minikube/profiles/old-k8s-version-542356/apiserver.crt
I0127 02:54:05.063758 945208 certs.go:385] copying /home/jenkins/minikube-integration/20316-897624/.minikube/profiles/old-k8s-version-542356/apiserver.key.4fcae880 -> /home/jenkins/minikube-integration/20316-897624/.minikube/profiles/old-k8s-version-542356/apiserver.key
I0127 02:54:05.063873 945208 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/20316-897624/.minikube/profiles/old-k8s-version-542356/proxy-client.key
I0127 02:54:05.063910 945208 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20316-897624/.minikube/profiles/old-k8s-version-542356/proxy-client.crt with IP's: []
I0127 02:54:05.220246 945208 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20316-897624/.minikube/profiles/old-k8s-version-542356/proxy-client.crt ...
I0127 02:54:05.220281 945208 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20316-897624/.minikube/profiles/old-k8s-version-542356/proxy-client.crt: {Name:mk01cf1a85c9d0b24dada3be6ccd3bb04e7a4468 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 02:54:05.220446 945208 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20316-897624/.minikube/profiles/old-k8s-version-542356/proxy-client.key ...
I0127 02:54:05.220462 945208 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20316-897624/.minikube/profiles/old-k8s-version-542356/proxy-client.key: {Name:mk3ea28d69b7039ca85b274bd23b6a232a84e6cc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 02:54:05.220630 945208 certs.go:484] found cert: /home/jenkins/minikube-integration/20316-897624/.minikube/certs/904889.pem (1338 bytes)
W0127 02:54:05.220666 945208 certs.go:480] ignoring /home/jenkins/minikube-integration/20316-897624/.minikube/certs/904889_empty.pem, impossibly tiny 0 bytes
I0127 02:54:05.220675 945208 certs.go:484] found cert: /home/jenkins/minikube-integration/20316-897624/.minikube/certs/ca-key.pem (1679 bytes)
I0127 02:54:05.220699 945208 certs.go:484] found cert: /home/jenkins/minikube-integration/20316-897624/.minikube/certs/ca.pem (1078 bytes)
I0127 02:54:05.220721 945208 certs.go:484] found cert: /home/jenkins/minikube-integration/20316-897624/.minikube/certs/cert.pem (1123 bytes)
I0127 02:54:05.220743 945208 certs.go:484] found cert: /home/jenkins/minikube-integration/20316-897624/.minikube/certs/key.pem (1679 bytes)
I0127 02:54:05.220781 945208 certs.go:484] found cert: /home/jenkins/minikube-integration/20316-897624/.minikube/files/etc/ssl/certs/9048892.pem (1708 bytes)
I0127 02:54:05.221496 945208 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20316-897624/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0127 02:54:05.252510 945208 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20316-897624/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0127 02:54:05.276893 945208 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20316-897624/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0127 02:54:05.299849 945208 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20316-897624/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0127 02:54:05.323366 945208 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20316-897624/.minikube/profiles/old-k8s-version-542356/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0127 02:54:05.347180 945208 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20316-897624/.minikube/profiles/old-k8s-version-542356/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0127 02:54:05.370140 945208 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20316-897624/.minikube/profiles/old-k8s-version-542356/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0127 02:54:05.393566 945208 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20316-897624/.minikube/profiles/old-k8s-version-542356/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0127 02:54:05.416877 945208 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20316-897624/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0127 02:54:05.445852 945208 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20316-897624/.minikube/certs/904889.pem --> /usr/share/ca-certificates/904889.pem (1338 bytes)
I0127 02:54:05.469467 945208 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20316-897624/.minikube/files/etc/ssl/certs/9048892.pem --> /usr/share/ca-certificates/9048892.pem (1708 bytes)
I0127 02:54:05.498512 945208 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0127 02:54:05.517876 945208 ssh_runner.go:195] Run: openssl version
I0127 02:54:05.523562 945208 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/904889.pem && ln -fs /usr/share/ca-certificates/904889.pem /etc/ssl/certs/904889.pem"
I0127 02:54:05.537444 945208 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/904889.pem
I0127 02:54:05.550649 945208 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jan 27 01:57 /usr/share/ca-certificates/904889.pem
I0127 02:54:05.550727 945208 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/904889.pem
I0127 02:54:05.558711 945208 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/904889.pem /etc/ssl/certs/51391683.0"
I0127 02:54:05.573535 945208 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/9048892.pem && ln -fs /usr/share/ca-certificates/9048892.pem /etc/ssl/certs/9048892.pem"
I0127 02:54:05.594678 945208 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/9048892.pem
I0127 02:54:05.600052 945208 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jan 27 01:57 /usr/share/ca-certificates/9048892.pem
I0127 02:54:05.600123 945208 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/9048892.pem
I0127 02:54:05.609181 945208 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/9048892.pem /etc/ssl/certs/3ec20f2e.0"
I0127 02:54:05.626249 945208 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0127 02:54:05.638064 945208 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0127 02:54:05.642442 945208 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jan 27 01:48 /usr/share/ca-certificates/minikubeCA.pem
I0127 02:54:05.642512 945208 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0127 02:54:05.648247 945208 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0127 02:54:05.659554 945208 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0127 02:54:05.663556 945208 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0127 02:54:05.663625 945208 kubeadm.go:392] StartCluster: {Name:old-k8s-version-542356 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-542356 Namespace:de
fault APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.85 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Disa
bleOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0127 02:54:05.663750 945208 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0127 02:54:05.663823 945208 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0127 02:54:05.702831 945208 cri.go:89] found id: ""
I0127 02:54:05.702917 945208 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0127 02:54:05.712917 945208 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0127 02:54:05.722975 945208 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0127 02:54:05.733012 945208 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0127 02:54:05.733040 945208 kubeadm.go:157] found existing configuration files:
I0127 02:54:05.733107 945208 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0127 02:54:05.743541 945208 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0127 02:54:05.743622 945208 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0127 02:54:05.753712 945208 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0127 02:54:05.762733 945208 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0127 02:54:05.762818 945208 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0127 02:54:05.772096 945208 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0127 02:54:05.782258 945208 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0127 02:54:05.783218 945208 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0127 02:54:05.795710 945208 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0127 02:54:05.805731 945208 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0127 02:54:05.805813 945208 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0127 02:54:05.817249 945208 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0127 02:54:05.940146 945208 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0127 02:54:05.940254 945208 kubeadm.go:310] [preflight] Running pre-flight checks
I0127 02:54:06.082799 945208 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0127 02:54:06.082956 945208 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0127 02:54:06.083097 945208 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0127 02:54:06.274159 945208 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0127 02:54:06.353021 945208 out.go:235] - Generating certificates and keys ...
I0127 02:54:06.353168 945208 kubeadm.go:310] [certs] Using existing ca certificate authority
I0127 02:54:06.353293 945208 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0127 02:54:06.445756 945208 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0127 02:54:06.701078 945208 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0127 02:54:06.935111 945208 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0127 02:54:06.984901 945208 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0127 02:54:07.174667 945208 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0127 02:54:07.174957 945208 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-542356] and IPs [192.168.39.85 127.0.0.1 ::1]
I0127 02:54:07.302492 945208 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0127 02:54:07.302660 945208 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-542356] and IPs [192.168.39.85 127.0.0.1 ::1]
I0127 02:54:07.580152 945208 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0127 02:54:07.774005 945208 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0127 02:54:08.141704 945208 kubeadm.go:310] [certs] Generating "sa" key and public key
I0127 02:54:08.142054 945208 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0127 02:54:08.202151 945208 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0127 02:54:08.397538 945208 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0127 02:54:08.619630 945208 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0127 02:54:08.799409 945208 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0127 02:54:08.817204 945208 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0127 02:54:08.817351 945208 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0127 02:54:08.817409 945208 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0127 02:54:08.961403 945208 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0127 02:54:08.963668 945208 out.go:235] - Booting up control plane ...
I0127 02:54:08.963859 945208 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0127 02:54:08.981904 945208 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0127 02:54:08.985580 945208 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0127 02:54:08.985744 945208 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0127 02:54:08.992291 945208 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0127 02:54:48.987845 945208 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0127 02:54:48.987963 945208 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 02:54:48.988184 945208 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 02:54:53.987978 945208 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 02:54:53.988185 945208 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 02:55:03.987625 945208 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 02:55:03.987912 945208 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 02:55:23.987912 945208 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 02:55:23.988137 945208 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 02:56:03.989391 945208 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 02:56:03.989686 945208 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 02:56:03.989708 945208 kubeadm.go:310]
I0127 02:56:03.989742 945208 kubeadm.go:310] Unfortunately, an error has occurred:
I0127 02:56:03.989775 945208 kubeadm.go:310] timed out waiting for the condition
I0127 02:56:03.989783 945208 kubeadm.go:310]
I0127 02:56:03.989812 945208 kubeadm.go:310] This error is likely caused by:
I0127 02:56:03.989841 945208 kubeadm.go:310] - The kubelet is not running
I0127 02:56:03.990004 945208 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0127 02:56:03.990022 945208 kubeadm.go:310]
I0127 02:56:03.990152 945208 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0127 02:56:03.990217 945208 kubeadm.go:310] - 'systemctl status kubelet'
I0127 02:56:03.990265 945208 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0127 02:56:03.990275 945208 kubeadm.go:310]
I0127 02:56:03.990390 945208 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0127 02:56:03.990497 945208 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0127 02:56:03.990507 945208 kubeadm.go:310]
I0127 02:56:03.990669 945208 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0127 02:56:03.990794 945208 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0127 02:56:03.990901 945208 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0127 02:56:03.991001 945208 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0127 02:56:03.991018 945208 kubeadm.go:310]
I0127 02:56:03.991966 945208 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0127 02:56:03.992095 945208 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0127 02:56:03.992185 945208 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
W0127 02:56:03.992348 945208 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-542356] and IPs [192.168.39.85 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-542356] and IPs [192.168.39.85 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-542356] and IPs [192.168.39.85 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-542356] and IPs [192.168.39.85 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0127 02:56:03.992403 945208 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0127 02:56:09.494462 945208 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (5.502017377s)
I0127 02:56:09.494568 945208 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0127 02:56:09.510202 945208 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0127 02:56:09.523224 945208 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0127 02:56:09.523255 945208 kubeadm.go:157] found existing configuration files:
I0127 02:56:09.523325 945208 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0127 02:56:09.533864 945208 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0127 02:56:09.533955 945208 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0127 02:56:09.544465 945208 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0127 02:56:09.554530 945208 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0127 02:56:09.554611 945208 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0127 02:56:09.564642 945208 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0127 02:56:09.574100 945208 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0127 02:56:09.574172 945208 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0127 02:56:09.583657 945208 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0127 02:56:09.592716 945208 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0127 02:56:09.592787 945208 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0127 02:56:09.602414 945208 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0127 02:56:09.677305 945208 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0127 02:56:09.677412 945208 kubeadm.go:310] [preflight] Running pre-flight checks
I0127 02:56:09.847516 945208 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0127 02:56:09.847663 945208 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0127 02:56:09.847781 945208 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0127 02:56:10.115467 945208 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0127 02:56:10.118150 945208 out.go:235] - Generating certificates and keys ...
I0127 02:56:10.118294 945208 kubeadm.go:310] [certs] Using existing ca certificate authority
I0127 02:56:10.118381 945208 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0127 02:56:10.118523 945208 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0127 02:56:10.118647 945208 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0127 02:56:10.118777 945208 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0127 02:56:10.118876 945208 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0127 02:56:10.118987 945208 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0127 02:56:10.119105 945208 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0127 02:56:10.119242 945208 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0127 02:56:10.119361 945208 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0127 02:56:10.119412 945208 kubeadm.go:310] [certs] Using the existing "sa" key
I0127 02:56:10.119491 945208 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0127 02:56:10.268230 945208 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0127 02:56:10.410766 945208 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0127 02:56:10.628572 945208 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0127 02:56:10.805134 945208 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0127 02:56:10.824936 945208 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0127 02:56:10.826617 945208 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0127 02:56:10.826774 945208 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0127 02:56:11.035170 945208 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0127 02:56:11.037074 945208 out.go:235] - Booting up control plane ...
I0127 02:56:11.037217 945208 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0127 02:56:11.048652 945208 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0127 02:56:11.054731 945208 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0127 02:56:11.056793 945208 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0127 02:56:11.062183 945208 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0127 02:56:51.064669 945208 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0127 02:56:51.065350 945208 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 02:56:51.065586 945208 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 02:56:56.065887 945208 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 02:56:56.066195 945208 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 02:57:06.065762 945208 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 02:57:06.066052 945208 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 02:57:26.065278 945208 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 02:57:26.065523 945208 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 02:58:06.065093 945208 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 02:58:06.065418 945208 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 02:58:06.065448 945208 kubeadm.go:310]
I0127 02:58:06.065506 945208 kubeadm.go:310] Unfortunately, an error has occurred:
I0127 02:58:06.065565 945208 kubeadm.go:310] timed out waiting for the condition
I0127 02:58:06.065580 945208 kubeadm.go:310]
I0127 02:58:06.065630 945208 kubeadm.go:310] This error is likely caused by:
I0127 02:58:06.065689 945208 kubeadm.go:310] - The kubelet is not running
I0127 02:58:06.065812 945208 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0127 02:58:06.065838 945208 kubeadm.go:310]
I0127 02:58:06.065977 945208 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0127 02:58:06.066029 945208 kubeadm.go:310] - 'systemctl status kubelet'
I0127 02:58:06.066069 945208 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0127 02:58:06.066076 945208 kubeadm.go:310]
I0127 02:58:06.066200 945208 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0127 02:58:06.066341 945208 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0127 02:58:06.066365 945208 kubeadm.go:310]
I0127 02:58:06.066535 945208 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0127 02:58:06.066648 945208 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0127 02:58:06.066744 945208 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0127 02:58:06.066838 945208 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0127 02:58:06.066845 945208 kubeadm.go:310]
I0127 02:58:06.069232 945208 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0127 02:58:06.069342 945208 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0127 02:58:06.069416 945208 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0127 02:58:06.069509 945208 kubeadm.go:394] duration metric: took 4m0.405892675s to StartCluster
I0127 02:58:06.069589 945208 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0127 02:58:06.069661 945208 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0127 02:58:06.133405 945208 cri.go:89] found id: ""
I0127 02:58:06.133439 945208 logs.go:282] 0 containers: []
W0127 02:58:06.133454 945208 logs.go:284] No container was found matching "kube-apiserver"
I0127 02:58:06.133464 945208 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0127 02:58:06.133534 945208 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0127 02:58:06.195887 945208 cri.go:89] found id: ""
I0127 02:58:06.195918 945208 logs.go:282] 0 containers: []
W0127 02:58:06.195930 945208 logs.go:284] No container was found matching "etcd"
I0127 02:58:06.195939 945208 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0127 02:58:06.196008 945208 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0127 02:58:06.246173 945208 cri.go:89] found id: ""
I0127 02:58:06.246202 945208 logs.go:282] 0 containers: []
W0127 02:58:06.246211 945208 logs.go:284] No container was found matching "coredns"
I0127 02:58:06.246219 945208 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0127 02:58:06.246279 945208 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0127 02:58:06.299049 945208 cri.go:89] found id: ""
I0127 02:58:06.299090 945208 logs.go:282] 0 containers: []
W0127 02:58:06.299102 945208 logs.go:284] No container was found matching "kube-scheduler"
I0127 02:58:06.299110 945208 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0127 02:58:06.299194 945208 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0127 02:58:06.346668 945208 cri.go:89] found id: ""
I0127 02:58:06.346701 945208 logs.go:282] 0 containers: []
W0127 02:58:06.346712 945208 logs.go:284] No container was found matching "kube-proxy"
I0127 02:58:06.346721 945208 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0127 02:58:06.346787 945208 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0127 02:58:06.398653 945208 cri.go:89] found id: ""
I0127 02:58:06.398689 945208 logs.go:282] 0 containers: []
W0127 02:58:06.398701 945208 logs.go:284] No container was found matching "kube-controller-manager"
I0127 02:58:06.398709 945208 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0127 02:58:06.398780 945208 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0127 02:58:06.446386 945208 cri.go:89] found id: ""
I0127 02:58:06.446417 945208 logs.go:282] 0 containers: []
W0127 02:58:06.446429 945208 logs.go:284] No container was found matching "kindnet"
I0127 02:58:06.446445 945208 logs.go:123] Gathering logs for kubelet ...
I0127 02:58:06.446460 945208 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0127 02:58:06.533445 945208 logs.go:123] Gathering logs for dmesg ...
I0127 02:58:06.533497 945208 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0127 02:58:06.553857 945208 logs.go:123] Gathering logs for describe nodes ...
I0127 02:58:06.553915 945208 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0127 02:58:06.725767 945208 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0127 02:58:06.725797 945208 logs.go:123] Gathering logs for CRI-O ...
I0127 02:58:06.725813 945208 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0127 02:58:06.882237 945208 logs.go:123] Gathering logs for container status ...
I0127 02:58:06.882292 945208 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0127 02:58:06.955915 945208 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0127 02:58:06.955987 945208 out.go:270] *
*
W0127 02:58:06.956059 945208 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0127 02:58:06.956082 945208 out.go:270] *
*
W0127 02:58:06.957358 945208 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0127 02:58:06.961146 945208 out.go:201]
W0127 02:58:06.962236 945208 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0127 02:58:06.962526 945208 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0127 02:58:06.962595 945208 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0127 02:58:06.963975 945208 out.go:201]
** /stderr **
start_stop_delete_test.go:186: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-542356 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-542356 -n old-k8s-version-542356
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-542356 -n old-k8s-version-542356: exit status 6 (267.195899ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0127 02:58:07.283205 947779 status.go:458] kubeconfig endpoint: get endpoint: "old-k8s-version-542356" does not appear in /home/jenkins/minikube-integration/20316-897624/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-542356" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (286.76s)