=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:184: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-650280 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:184: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-650280 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m29.474514892s)
-- stdout --
* [old-k8s-version-650280] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=20446
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/20446-171825/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/20446-171825/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-650280" primary control-plane node in "old-k8s-version-650280" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0414 12:40:39.618009 219128 out.go:345] Setting OutFile to fd 1 ...
I0414 12:40:39.618323 219128 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0414 12:40:39.618335 219128 out.go:358] Setting ErrFile to fd 2...
I0414 12:40:39.618342 219128 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0414 12:40:39.618632 219128 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20446-171825/.minikube/bin
I0414 12:40:39.619462 219128 out.go:352] Setting JSON to false
I0414 12:40:39.620769 219128 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-3","uptime":15789,"bootTime":1744618651,"procs":226,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1078-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0414 12:40:39.620858 219128 start.go:139] virtualization: kvm guest
I0414 12:40:39.622699 219128 out.go:177] * [old-k8s-version-650280] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
I0414 12:40:39.624649 219128 out.go:177] - MINIKUBE_LOCATION=20446
I0414 12:40:39.624659 219128 notify.go:220] Checking for updates...
I0414 12:40:39.627479 219128 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0414 12:40:39.629084 219128 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/20446-171825/kubeconfig
I0414 12:40:39.630771 219128 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/20446-171825/.minikube
I0414 12:40:39.632322 219128 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0414 12:40:39.633521 219128 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0414 12:40:39.635369 219128 config.go:182] Loaded profile config "cert-expiration-258256": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.2
I0414 12:40:39.635522 219128 config.go:182] Loaded profile config "kubernetes-upgrade-813495": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0414 12:40:39.635622 219128 config.go:182] Loaded profile config "stopped-upgrade-203221": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.24.1
I0414 12:40:39.635735 219128 driver.go:394] Setting default libvirt URI to qemu:///system
I0414 12:40:39.676336 219128 out.go:177] * Using the kvm2 driver based on user configuration
I0414 12:40:39.677595 219128 start.go:297] selected driver: kvm2
I0414 12:40:39.677609 219128 start.go:901] validating driver "kvm2" against <nil>
I0414 12:40:39.677620 219128 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0414 12:40:39.678596 219128 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0414 12:40:39.678683 219128 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/20446-171825/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0414 12:40:39.698082 219128 install.go:137] /home/jenkins/minikube-integration/20446-171825/.minikube/bin/docker-machine-driver-kvm2 version is 1.35.0
I0414 12:40:39.698156 219128 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0414 12:40:39.698467 219128 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0414 12:40:39.698510 219128 cni.go:84] Creating CNI manager for ""
I0414 12:40:39.698576 219128 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0414 12:40:39.698589 219128 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0414 12:40:39.698665 219128 start.go:340] cluster config:
{Name:old-k8s-version-650280 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-650280 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0414 12:40:39.698808 219128 iso.go:125] acquiring lock: {Name:mk4a027ef886b94b68bd63c5926d8ff80da45667 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0414 12:40:39.701426 219128 out.go:177] * Starting "old-k8s-version-650280" primary control-plane node in "old-k8s-version-650280" cluster
I0414 12:40:39.702661 219128 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0414 12:40:39.702709 219128 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20446-171825/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0414 12:40:39.702723 219128 cache.go:56] Caching tarball of preloaded images
I0414 12:40:39.702842 219128 preload.go:172] Found /home/jenkins/minikube-integration/20446-171825/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0414 12:40:39.702860 219128 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0414 12:40:39.703005 219128 profile.go:143] Saving config to /home/jenkins/minikube-integration/20446-171825/.minikube/profiles/old-k8s-version-650280/config.json ...
I0414 12:40:39.703034 219128 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20446-171825/.minikube/profiles/old-k8s-version-650280/config.json: {Name:mk89c79f32c56ae2de9a322eeb3b7fa640fb9b04 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0414 12:40:39.703251 219128 start.go:360] acquireMachinesLock for old-k8s-version-650280: {Name:mk808d1cd673dbde8790609e468edd82ea8e9373 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0414 12:40:39.703297 219128 start.go:364] duration metric: took 24.901µs to acquireMachinesLock for "old-k8s-version-650280"
I0414 12:40:39.703318 219128 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-650280 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 C
lusterName:old-k8s-version-650280 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p M
ountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0414 12:40:39.703404 219128 start.go:125] createHost starting for "" (driver="kvm2")
I0414 12:40:39.705974 219128 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0414 12:40:39.706119 219128 main.go:141] libmachine: Found binary path at /home/jenkins/minikube-integration/20446-171825/.minikube/bin/docker-machine-driver-kvm2
I0414 12:40:39.706174 219128 main.go:141] libmachine: Launching plugin server for driver kvm2
I0414 12:40:39.723048 219128 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42981
I0414 12:40:39.723524 219128 main.go:141] libmachine: () Calling .GetVersion
I0414 12:40:39.724072 219128 main.go:141] libmachine: Using API Version 1
I0414 12:40:39.724087 219128 main.go:141] libmachine: () Calling .SetConfigRaw
I0414 12:40:39.724439 219128 main.go:141] libmachine: () Calling .GetMachineName
I0414 12:40:39.724673 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetMachineName
I0414 12:40:39.724829 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .DriverName
I0414 12:40:39.725011 219128 start.go:159] libmachine.API.Create for "old-k8s-version-650280" (driver="kvm2")
I0414 12:40:39.725041 219128 client.go:168] LocalClient.Create starting
I0414 12:40:39.725087 219128 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20446-171825/.minikube/certs/ca.pem
I0414 12:40:39.725126 219128 main.go:141] libmachine: Decoding PEM data...
I0414 12:40:39.725146 219128 main.go:141] libmachine: Parsing certificate...
I0414 12:40:39.725204 219128 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20446-171825/.minikube/certs/cert.pem
I0414 12:40:39.725225 219128 main.go:141] libmachine: Decoding PEM data...
I0414 12:40:39.725232 219128 main.go:141] libmachine: Parsing certificate...
I0414 12:40:39.725249 219128 main.go:141] libmachine: Running pre-create checks...
I0414 12:40:39.725258 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .PreCreateCheck
I0414 12:40:39.725610 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetConfigRaw
I0414 12:40:39.726022 219128 main.go:141] libmachine: Creating machine...
I0414 12:40:39.726035 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .Create
I0414 12:40:39.726166 219128 main.go:141] libmachine: (old-k8s-version-650280) creating KVM machine...
I0414 12:40:39.726181 219128 main.go:141] libmachine: (old-k8s-version-650280) creating network...
I0414 12:40:39.727514 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | found existing default KVM network
I0414 12:40:39.729344 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | I0414 12:40:39.728889 219151 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0002f6040}
I0414 12:40:39.729375 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | created network xml:
I0414 12:40:39.729388 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | <network>
I0414 12:40:39.729401 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | <name>mk-old-k8s-version-650280</name>
I0414 12:40:39.729407 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | <dns enable='no'/>
I0414 12:40:39.729414 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG |
I0414 12:40:39.729421 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | <ip address='192.168.39.1' netmask='255.255.255.0'>
I0414 12:40:39.729426 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | <dhcp>
I0414 12:40:39.729431 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | <range start='192.168.39.2' end='192.168.39.253'/>
I0414 12:40:39.729443 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | </dhcp>
I0414 12:40:39.729450 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | </ip>
I0414 12:40:39.729454 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG |
I0414 12:40:39.729459 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | </network>
I0414 12:40:39.729463 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG |
I0414 12:40:39.735176 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | trying to create private KVM network mk-old-k8s-version-650280 192.168.39.0/24...
I0414 12:40:39.820469 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | private KVM network mk-old-k8s-version-650280 192.168.39.0/24 created
I0414 12:40:39.820505 219128 main.go:141] libmachine: (old-k8s-version-650280) setting up store path in /home/jenkins/minikube-integration/20446-171825/.minikube/machines/old-k8s-version-650280 ...
I0414 12:40:39.820520 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | I0414 12:40:39.820446 219151 common.go:144] Making disk image using store path: /home/jenkins/minikube-integration/20446-171825/.minikube
I0414 12:40:39.820627 219128 main.go:141] libmachine: (old-k8s-version-650280) building disk image from file:///home/jenkins/minikube-integration/20446-171825/.minikube/cache/iso/amd64/minikube-v1.35.0-amd64.iso
I0414 12:40:39.820641 219128 main.go:141] libmachine: (old-k8s-version-650280) Downloading /home/jenkins/minikube-integration/20446-171825/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/20446-171825/.minikube/cache/iso/amd64/minikube-v1.35.0-amd64.iso...
I0414 12:40:40.153578 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | I0414 12:40:40.153447 219151 common.go:151] Creating ssh key: /home/jenkins/minikube-integration/20446-171825/.minikube/machines/old-k8s-version-650280/id_rsa...
I0414 12:40:40.312255 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | I0414 12:40:40.312094 219151 common.go:157] Creating raw disk image: /home/jenkins/minikube-integration/20446-171825/.minikube/machines/old-k8s-version-650280/old-k8s-version-650280.rawdisk...
I0414 12:40:40.312294 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | Writing magic tar header
I0414 12:40:40.312336 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | Writing SSH key tar header
I0414 12:40:40.312374 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | I0414 12:40:40.312273 219151 common.go:171] Fixing permissions on /home/jenkins/minikube-integration/20446-171825/.minikube/machines/old-k8s-version-650280 ...
I0414 12:40:40.312402 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20446-171825/.minikube/machines/old-k8s-version-650280
I0414 12:40:40.312468 219128 main.go:141] libmachine: (old-k8s-version-650280) setting executable bit set on /home/jenkins/minikube-integration/20446-171825/.minikube/machines/old-k8s-version-650280 (perms=drwx------)
I0414 12:40:40.312494 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20446-171825/.minikube/machines
I0414 12:40:40.312508 219128 main.go:141] libmachine: (old-k8s-version-650280) setting executable bit set on /home/jenkins/minikube-integration/20446-171825/.minikube/machines (perms=drwxr-xr-x)
I0414 12:40:40.312521 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20446-171825/.minikube
I0414 12:40:40.312535 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20446-171825
I0414 12:40:40.312547 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | checking permissions on dir: /home/jenkins/minikube-integration
I0414 12:40:40.312568 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | checking permissions on dir: /home/jenkins
I0414 12:40:40.312580 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | checking permissions on dir: /home
I0414 12:40:40.312591 219128 main.go:141] libmachine: (old-k8s-version-650280) setting executable bit set on /home/jenkins/minikube-integration/20446-171825/.minikube (perms=drwxr-xr-x)
I0414 12:40:40.312605 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | skipping /home - not owner
I0414 12:40:40.312615 219128 main.go:141] libmachine: (old-k8s-version-650280) setting executable bit set on /home/jenkins/minikube-integration/20446-171825 (perms=drwxrwxr-x)
I0414 12:40:40.312630 219128 main.go:141] libmachine: (old-k8s-version-650280) setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0414 12:40:40.312640 219128 main.go:141] libmachine: (old-k8s-version-650280) setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0414 12:40:40.312665 219128 main.go:141] libmachine: (old-k8s-version-650280) creating domain...
I0414 12:40:40.313985 219128 main.go:141] libmachine: (old-k8s-version-650280) define libvirt domain using xml:
I0414 12:40:40.314011 219128 main.go:141] libmachine: (old-k8s-version-650280) <domain type='kvm'>
I0414 12:40:40.314022 219128 main.go:141] libmachine: (old-k8s-version-650280) <name>old-k8s-version-650280</name>
I0414 12:40:40.314030 219128 main.go:141] libmachine: (old-k8s-version-650280) <memory unit='MiB'>2200</memory>
I0414 12:40:40.314052 219128 main.go:141] libmachine: (old-k8s-version-650280) <vcpu>2</vcpu>
I0414 12:40:40.314064 219128 main.go:141] libmachine: (old-k8s-version-650280) <features>
I0414 12:40:40.314074 219128 main.go:141] libmachine: (old-k8s-version-650280) <acpi/>
I0414 12:40:40.314086 219128 main.go:141] libmachine: (old-k8s-version-650280) <apic/>
I0414 12:40:40.314108 219128 main.go:141] libmachine: (old-k8s-version-650280) <pae/>
I0414 12:40:40.314117 219128 main.go:141] libmachine: (old-k8s-version-650280)
I0414 12:40:40.314123 219128 main.go:141] libmachine: (old-k8s-version-650280) </features>
I0414 12:40:40.314128 219128 main.go:141] libmachine: (old-k8s-version-650280) <cpu mode='host-passthrough'>
I0414 12:40:40.314133 219128 main.go:141] libmachine: (old-k8s-version-650280)
I0414 12:40:40.314147 219128 main.go:141] libmachine: (old-k8s-version-650280) </cpu>
I0414 12:40:40.314163 219128 main.go:141] libmachine: (old-k8s-version-650280) <os>
I0414 12:40:40.314172 219128 main.go:141] libmachine: (old-k8s-version-650280) <type>hvm</type>
I0414 12:40:40.314178 219128 main.go:141] libmachine: (old-k8s-version-650280) <boot dev='cdrom'/>
I0414 12:40:40.314185 219128 main.go:141] libmachine: (old-k8s-version-650280) <boot dev='hd'/>
I0414 12:40:40.314191 219128 main.go:141] libmachine: (old-k8s-version-650280) <bootmenu enable='no'/>
I0414 12:40:40.314198 219128 main.go:141] libmachine: (old-k8s-version-650280) </os>
I0414 12:40:40.314204 219128 main.go:141] libmachine: (old-k8s-version-650280) <devices>
I0414 12:40:40.314212 219128 main.go:141] libmachine: (old-k8s-version-650280) <disk type='file' device='cdrom'>
I0414 12:40:40.314221 219128 main.go:141] libmachine: (old-k8s-version-650280) <source file='/home/jenkins/minikube-integration/20446-171825/.minikube/machines/old-k8s-version-650280/boot2docker.iso'/>
I0414 12:40:40.314229 219128 main.go:141] libmachine: (old-k8s-version-650280) <target dev='hdc' bus='scsi'/>
I0414 12:40:40.314235 219128 main.go:141] libmachine: (old-k8s-version-650280) <readonly/>
I0414 12:40:40.314242 219128 main.go:141] libmachine: (old-k8s-version-650280) </disk>
I0414 12:40:40.314249 219128 main.go:141] libmachine: (old-k8s-version-650280) <disk type='file' device='disk'>
I0414 12:40:40.314258 219128 main.go:141] libmachine: (old-k8s-version-650280) <driver name='qemu' type='raw' cache='default' io='threads' />
I0414 12:40:40.314268 219128 main.go:141] libmachine: (old-k8s-version-650280) <source file='/home/jenkins/minikube-integration/20446-171825/.minikube/machines/old-k8s-version-650280/old-k8s-version-650280.rawdisk'/>
I0414 12:40:40.314275 219128 main.go:141] libmachine: (old-k8s-version-650280) <target dev='hda' bus='virtio'/>
I0414 12:40:40.314281 219128 main.go:141] libmachine: (old-k8s-version-650280) </disk>
I0414 12:40:40.314289 219128 main.go:141] libmachine: (old-k8s-version-650280) <interface type='network'>
I0414 12:40:40.314295 219128 main.go:141] libmachine: (old-k8s-version-650280) <source network='mk-old-k8s-version-650280'/>
I0414 12:40:40.314302 219128 main.go:141] libmachine: (old-k8s-version-650280) <model type='virtio'/>
I0414 12:40:40.314308 219128 main.go:141] libmachine: (old-k8s-version-650280) </interface>
I0414 12:40:40.314316 219128 main.go:141] libmachine: (old-k8s-version-650280) <interface type='network'>
I0414 12:40:40.314322 219128 main.go:141] libmachine: (old-k8s-version-650280) <source network='default'/>
I0414 12:40:40.314329 219128 main.go:141] libmachine: (old-k8s-version-650280) <model type='virtio'/>
I0414 12:40:40.314335 219128 main.go:141] libmachine: (old-k8s-version-650280) </interface>
I0414 12:40:40.314342 219128 main.go:141] libmachine: (old-k8s-version-650280) <serial type='pty'>
I0414 12:40:40.314347 219128 main.go:141] libmachine: (old-k8s-version-650280) <target port='0'/>
I0414 12:40:40.314354 219128 main.go:141] libmachine: (old-k8s-version-650280) </serial>
I0414 12:40:40.314360 219128 main.go:141] libmachine: (old-k8s-version-650280) <console type='pty'>
I0414 12:40:40.314367 219128 main.go:141] libmachine: (old-k8s-version-650280) <target type='serial' port='0'/>
I0414 12:40:40.314374 219128 main.go:141] libmachine: (old-k8s-version-650280) </console>
I0414 12:40:40.314381 219128 main.go:141] libmachine: (old-k8s-version-650280) <rng model='virtio'>
I0414 12:40:40.314388 219128 main.go:141] libmachine: (old-k8s-version-650280) <backend model='random'>/dev/random</backend>
I0414 12:40:40.314403 219128 main.go:141] libmachine: (old-k8s-version-650280) </rng>
I0414 12:40:40.314418 219128 main.go:141] libmachine: (old-k8s-version-650280)
I0414 12:40:40.314426 219128 main.go:141] libmachine: (old-k8s-version-650280)
I0414 12:40:40.314431 219128 main.go:141] libmachine: (old-k8s-version-650280) </devices>
I0414 12:40:40.314438 219128 main.go:141] libmachine: (old-k8s-version-650280) </domain>
I0414 12:40:40.314445 219128 main.go:141] libmachine: (old-k8s-version-650280)
I0414 12:40:40.319717 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has defined MAC address 52:54:00:e1:6b:d9 in network default
I0414 12:40:40.320580 219128 main.go:141] libmachine: (old-k8s-version-650280) starting domain...
I0414 12:40:40.320606 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has defined MAC address 52:54:00:fe:c3:ef in network mk-old-k8s-version-650280
I0414 12:40:40.320613 219128 main.go:141] libmachine: (old-k8s-version-650280) ensuring networks are active...
I0414 12:40:40.321463 219128 main.go:141] libmachine: (old-k8s-version-650280) Ensuring network default is active
I0414 12:40:40.321894 219128 main.go:141] libmachine: (old-k8s-version-650280) Ensuring network mk-old-k8s-version-650280 is active
I0414 12:40:40.322503 219128 main.go:141] libmachine: (old-k8s-version-650280) getting domain XML...
I0414 12:40:40.323330 219128 main.go:141] libmachine: (old-k8s-version-650280) creating domain...
I0414 12:40:41.645719 219128 main.go:141] libmachine: (old-k8s-version-650280) waiting for IP...
I0414 12:40:41.646901 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has defined MAC address 52:54:00:fe:c3:ef in network mk-old-k8s-version-650280
I0414 12:40:41.647447 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | unable to find current IP address of domain old-k8s-version-650280 in network mk-old-k8s-version-650280
I0414 12:40:41.647526 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | I0414 12:40:41.647439 219151 retry.go:31] will retry after 279.662387ms: waiting for domain to come up
I0414 12:40:41.929073 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has defined MAC address 52:54:00:fe:c3:ef in network mk-old-k8s-version-650280
I0414 12:40:41.929506 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | unable to find current IP address of domain old-k8s-version-650280 in network mk-old-k8s-version-650280
I0414 12:40:41.929561 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | I0414 12:40:41.929496 219151 retry.go:31] will retry after 285.830101ms: waiting for domain to come up
I0414 12:40:42.217157 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has defined MAC address 52:54:00:fe:c3:ef in network mk-old-k8s-version-650280
I0414 12:40:42.217723 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | unable to find current IP address of domain old-k8s-version-650280 in network mk-old-k8s-version-650280
I0414 12:40:42.217748 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | I0414 12:40:42.217692 219151 retry.go:31] will retry after 303.833894ms: waiting for domain to come up
I0414 12:40:42.523478 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has defined MAC address 52:54:00:fe:c3:ef in network mk-old-k8s-version-650280
I0414 12:40:42.524081 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | unable to find current IP address of domain old-k8s-version-650280 in network mk-old-k8s-version-650280
I0414 12:40:42.524117 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | I0414 12:40:42.524042 219151 retry.go:31] will retry after 474.533342ms: waiting for domain to come up
I0414 12:40:43.000597 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has defined MAC address 52:54:00:fe:c3:ef in network mk-old-k8s-version-650280
I0414 12:40:43.001214 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | unable to find current IP address of domain old-k8s-version-650280 in network mk-old-k8s-version-650280
I0414 12:40:43.001370 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | I0414 12:40:43.001327 219151 retry.go:31] will retry after 715.896319ms: waiting for domain to come up
I0414 12:40:43.719766 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has defined MAC address 52:54:00:fe:c3:ef in network mk-old-k8s-version-650280
I0414 12:40:43.720377 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | unable to find current IP address of domain old-k8s-version-650280 in network mk-old-k8s-version-650280
I0414 12:40:43.720401 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | I0414 12:40:43.720363 219151 retry.go:31] will retry after 845.344846ms: waiting for domain to come up
I0414 12:40:44.567367 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has defined MAC address 52:54:00:fe:c3:ef in network mk-old-k8s-version-650280
I0414 12:40:44.567881 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | unable to find current IP address of domain old-k8s-version-650280 in network mk-old-k8s-version-650280
I0414 12:40:44.568038 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | I0414 12:40:44.567996 219151 retry.go:31] will retry after 873.885888ms: waiting for domain to come up
I0414 12:40:45.444238 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has defined MAC address 52:54:00:fe:c3:ef in network mk-old-k8s-version-650280
I0414 12:40:45.444762 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | unable to find current IP address of domain old-k8s-version-650280 in network mk-old-k8s-version-650280
I0414 12:40:45.444792 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | I0414 12:40:45.444730 219151 retry.go:31] will retry after 1.323251906s: waiting for domain to come up
I0414 12:40:46.769748 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has defined MAC address 52:54:00:fe:c3:ef in network mk-old-k8s-version-650280
I0414 12:40:46.770404 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | unable to find current IP address of domain old-k8s-version-650280 in network mk-old-k8s-version-650280
I0414 12:40:46.770450 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | I0414 12:40:46.770361 219151 retry.go:31] will retry after 1.574229435s: waiting for domain to come up
I0414 12:40:48.346934 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has defined MAC address 52:54:00:fe:c3:ef in network mk-old-k8s-version-650280
I0414 12:40:48.347504 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | unable to find current IP address of domain old-k8s-version-650280 in network mk-old-k8s-version-650280
I0414 12:40:48.347534 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | I0414 12:40:48.347475 219151 retry.go:31] will retry after 1.506939607s: waiting for domain to come up
I0414 12:40:49.856296 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has defined MAC address 52:54:00:fe:c3:ef in network mk-old-k8s-version-650280
I0414 12:40:49.857080 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | unable to find current IP address of domain old-k8s-version-650280 in network mk-old-k8s-version-650280
I0414 12:40:49.857119 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | I0414 12:40:49.857078 219151 retry.go:31] will retry after 2.109309166s: waiting for domain to come up
I0414 12:40:51.968848 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has defined MAC address 52:54:00:fe:c3:ef in network mk-old-k8s-version-650280
I0414 12:40:51.969485 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | unable to find current IP address of domain old-k8s-version-650280 in network mk-old-k8s-version-650280
I0414 12:40:51.969508 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | I0414 12:40:51.969387 219151 retry.go:31] will retry after 2.455761731s: waiting for domain to come up
I0414 12:40:54.427087 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has defined MAC address 52:54:00:fe:c3:ef in network mk-old-k8s-version-650280
I0414 12:40:54.427664 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | unable to find current IP address of domain old-k8s-version-650280 in network mk-old-k8s-version-650280
I0414 12:40:54.427688 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | I0414 12:40:54.427612 219151 retry.go:31] will retry after 2.995251004s: waiting for domain to come up
I0414 12:40:57.424826 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has defined MAC address 52:54:00:fe:c3:ef in network mk-old-k8s-version-650280
I0414 12:40:57.425308 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | unable to find current IP address of domain old-k8s-version-650280 in network mk-old-k8s-version-650280
I0414 12:40:57.425330 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | I0414 12:40:57.425282 219151 retry.go:31] will retry after 4.117773194s: waiting for domain to come up
I0414 12:41:01.545560 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has defined MAC address 52:54:00:fe:c3:ef in network mk-old-k8s-version-650280
I0414 12:41:01.546082 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has current primary IP address 192.168.39.30 and MAC address 52:54:00:fe:c3:ef in network mk-old-k8s-version-650280
I0414 12:41:01.546106 219128 main.go:141] libmachine: (old-k8s-version-650280) found domain IP: 192.168.39.30
I0414 12:41:01.546118 219128 main.go:141] libmachine: (old-k8s-version-650280) reserving static IP address...
I0414 12:41:01.546513 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-650280", mac: "52:54:00:fe:c3:ef", ip: "192.168.39.30"} in network mk-old-k8s-version-650280
I0414 12:41:01.622154 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | Getting to WaitForSSH function...
I0414 12:41:01.622191 219128 main.go:141] libmachine: (old-k8s-version-650280) reserved static IP address 192.168.39.30 for domain old-k8s-version-650280
I0414 12:41:01.622205 219128 main.go:141] libmachine: (old-k8s-version-650280) waiting for SSH...
I0414 12:41:01.624563 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has defined MAC address 52:54:00:fe:c3:ef in network mk-old-k8s-version-650280
I0414 12:41:01.624979 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fe:c3:ef", ip: ""} in network mk-old-k8s-version-650280: {Iface:virbr3 ExpiryTime:2025-04-14 13:40:55 +0000 UTC Type:0 Mac:52:54:00:fe:c3:ef Iaid: IPaddr:192.168.39.30 Prefix:24 Hostname:minikube Clientid:01:52:54:00:fe:c3:ef}
I0414 12:41:01.625013 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has defined IP address 192.168.39.30 and MAC address 52:54:00:fe:c3:ef in network mk-old-k8s-version-650280
I0414 12:41:01.625172 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | Using SSH client type: external
I0414 12:41:01.625197 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | Using SSH private key: /home/jenkins/minikube-integration/20446-171825/.minikube/machines/old-k8s-version-650280/id_rsa (-rw-------)
I0414 12:41:01.625232 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.30 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/20446-171825/.minikube/machines/old-k8s-version-650280/id_rsa -p 22] /usr/bin/ssh <nil>}
I0414 12:41:01.625242 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | About to run SSH command:
I0414 12:41:01.625252 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | exit 0
I0414 12:41:01.746362 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | SSH cmd err, output: <nil>:
I0414 12:41:01.746627 219128 main.go:141] libmachine: (old-k8s-version-650280) KVM machine creation complete
I0414 12:41:01.746933 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetConfigRaw
I0414 12:41:01.747503 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .DriverName
I0414 12:41:01.747701 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .DriverName
I0414 12:41:01.747857 219128 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0414 12:41:01.747879 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetState
I0414 12:41:01.749250 219128 main.go:141] libmachine: Detecting operating system of created instance...
I0414 12:41:01.749263 219128 main.go:141] libmachine: Waiting for SSH to be available...
I0414 12:41:01.749268 219128 main.go:141] libmachine: Getting to WaitForSSH function...
I0414 12:41:01.749287 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetSSHHostname
I0414 12:41:01.751698 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has defined MAC address 52:54:00:fe:c3:ef in network mk-old-k8s-version-650280
I0414 12:41:01.752082 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fe:c3:ef", ip: ""} in network mk-old-k8s-version-650280: {Iface:virbr3 ExpiryTime:2025-04-14 13:40:55 +0000 UTC Type:0 Mac:52:54:00:fe:c3:ef Iaid: IPaddr:192.168.39.30 Prefix:24 Hostname:old-k8s-version-650280 Clientid:01:52:54:00:fe:c3:ef}
I0414 12:41:01.752131 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has defined IP address 192.168.39.30 and MAC address 52:54:00:fe:c3:ef in network mk-old-k8s-version-650280
I0414 12:41:01.752244 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetSSHPort
I0414 12:41:01.752394 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetSSHKeyPath
I0414 12:41:01.752532 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetSSHKeyPath
I0414 12:41:01.752690 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetSSHUsername
I0414 12:41:01.752899 219128 main.go:141] libmachine: Using SSH client type: native
I0414 12:41:01.753120 219128 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.39.30 22 <nil> <nil>}
I0414 12:41:01.753133 219128 main.go:141] libmachine: About to run SSH command:
exit 0
I0414 12:41:01.849238 219128 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0414 12:41:01.849260 219128 main.go:141] libmachine: Detecting the provisioner...
I0414 12:41:01.849268 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetSSHHostname
I0414 12:41:01.851786 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has defined MAC address 52:54:00:fe:c3:ef in network mk-old-k8s-version-650280
I0414 12:41:01.852141 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fe:c3:ef", ip: ""} in network mk-old-k8s-version-650280: {Iface:virbr3 ExpiryTime:2025-04-14 13:40:55 +0000 UTC Type:0 Mac:52:54:00:fe:c3:ef Iaid: IPaddr:192.168.39.30 Prefix:24 Hostname:old-k8s-version-650280 Clientid:01:52:54:00:fe:c3:ef}
I0414 12:41:01.852171 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has defined IP address 192.168.39.30 and MAC address 52:54:00:fe:c3:ef in network mk-old-k8s-version-650280
I0414 12:41:01.852311 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetSSHPort
I0414 12:41:01.852535 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetSSHKeyPath
I0414 12:41:01.852710 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetSSHKeyPath
I0414 12:41:01.852885 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetSSHUsername
I0414 12:41:01.853038 219128 main.go:141] libmachine: Using SSH client type: native
I0414 12:41:01.853238 219128 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.39.30 22 <nil> <nil>}
I0414 12:41:01.853248 219128 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0414 12:41:01.950625 219128 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0414 12:41:01.950744 219128 main.go:141] libmachine: found compatible host: buildroot
I0414 12:41:01.950755 219128 main.go:141] libmachine: Provisioning with buildroot...
I0414 12:41:01.950767 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetMachineName
I0414 12:41:01.951006 219128 buildroot.go:166] provisioning hostname "old-k8s-version-650280"
I0414 12:41:01.951031 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetMachineName
I0414 12:41:01.951181 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetSSHHostname
I0414 12:41:01.954323 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has defined MAC address 52:54:00:fe:c3:ef in network mk-old-k8s-version-650280
I0414 12:41:01.954738 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fe:c3:ef", ip: ""} in network mk-old-k8s-version-650280: {Iface:virbr3 ExpiryTime:2025-04-14 13:40:55 +0000 UTC Type:0 Mac:52:54:00:fe:c3:ef Iaid: IPaddr:192.168.39.30 Prefix:24 Hostname:old-k8s-version-650280 Clientid:01:52:54:00:fe:c3:ef}
I0414 12:41:01.954758 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has defined IP address 192.168.39.30 and MAC address 52:54:00:fe:c3:ef in network mk-old-k8s-version-650280
I0414 12:41:01.954922 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetSSHPort
I0414 12:41:01.955127 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetSSHKeyPath
I0414 12:41:01.955290 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetSSHKeyPath
I0414 12:41:01.955447 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetSSHUsername
I0414 12:41:01.955614 219128 main.go:141] libmachine: Using SSH client type: native
I0414 12:41:01.955820 219128 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.39.30 22 <nil> <nil>}
I0414 12:41:01.955831 219128 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-650280 && echo "old-k8s-version-650280" | sudo tee /etc/hostname
I0414 12:41:02.070853 219128 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-650280
I0414 12:41:02.070883 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetSSHHostname
I0414 12:41:02.073618 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has defined MAC address 52:54:00:fe:c3:ef in network mk-old-k8s-version-650280
I0414 12:41:02.073968 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fe:c3:ef", ip: ""} in network mk-old-k8s-version-650280: {Iface:virbr3 ExpiryTime:2025-04-14 13:40:55 +0000 UTC Type:0 Mac:52:54:00:fe:c3:ef Iaid: IPaddr:192.168.39.30 Prefix:24 Hostname:old-k8s-version-650280 Clientid:01:52:54:00:fe:c3:ef}
I0414 12:41:02.073996 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has defined IP address 192.168.39.30 and MAC address 52:54:00:fe:c3:ef in network mk-old-k8s-version-650280
I0414 12:41:02.074213 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetSSHPort
I0414 12:41:02.074404 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetSSHKeyPath
I0414 12:41:02.074554 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetSSHKeyPath
I0414 12:41:02.074690 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetSSHUsername
I0414 12:41:02.074839 219128 main.go:141] libmachine: Using SSH client type: native
I0414 12:41:02.075066 219128 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.39.30 22 <nil> <nil>}
I0414 12:41:02.075088 219128 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-650280' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-650280/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-650280' | sudo tee -a /etc/hosts;
fi
fi
I0414 12:41:02.179452 219128 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0414 12:41:02.179484 219128 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/20446-171825/.minikube CaCertPath:/home/jenkins/minikube-integration/20446-171825/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20446-171825/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20446-171825/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20446-171825/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20446-171825/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20446-171825/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20446-171825/.minikube}
I0414 12:41:02.179526 219128 buildroot.go:174] setting up certificates
I0414 12:41:02.179540 219128 provision.go:84] configureAuth start
I0414 12:41:02.179569 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetMachineName
I0414 12:41:02.179939 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetIP
I0414 12:41:02.182601 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has defined MAC address 52:54:00:fe:c3:ef in network mk-old-k8s-version-650280
I0414 12:41:02.182965 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fe:c3:ef", ip: ""} in network mk-old-k8s-version-650280: {Iface:virbr3 ExpiryTime:2025-04-14 13:40:55 +0000 UTC Type:0 Mac:52:54:00:fe:c3:ef Iaid: IPaddr:192.168.39.30 Prefix:24 Hostname:old-k8s-version-650280 Clientid:01:52:54:00:fe:c3:ef}
I0414 12:41:02.182999 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has defined IP address 192.168.39.30 and MAC address 52:54:00:fe:c3:ef in network mk-old-k8s-version-650280
I0414 12:41:02.183103 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetSSHHostname
I0414 12:41:02.185033 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has defined MAC address 52:54:00:fe:c3:ef in network mk-old-k8s-version-650280
I0414 12:41:02.185365 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fe:c3:ef", ip: ""} in network mk-old-k8s-version-650280: {Iface:virbr3 ExpiryTime:2025-04-14 13:40:55 +0000 UTC Type:0 Mac:52:54:00:fe:c3:ef Iaid: IPaddr:192.168.39.30 Prefix:24 Hostname:old-k8s-version-650280 Clientid:01:52:54:00:fe:c3:ef}
I0414 12:41:02.185392 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has defined IP address 192.168.39.30 and MAC address 52:54:00:fe:c3:ef in network mk-old-k8s-version-650280
I0414 12:41:02.185531 219128 provision.go:143] copyHostCerts
I0414 12:41:02.185603 219128 exec_runner.go:144] found /home/jenkins/minikube-integration/20446-171825/.minikube/key.pem, removing ...
I0414 12:41:02.185614 219128 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20446-171825/.minikube/key.pem
I0414 12:41:02.185677 219128 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20446-171825/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20446-171825/.minikube/key.pem (1675 bytes)
I0414 12:41:02.185789 219128 exec_runner.go:144] found /home/jenkins/minikube-integration/20446-171825/.minikube/ca.pem, removing ...
I0414 12:41:02.185797 219128 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20446-171825/.minikube/ca.pem
I0414 12:41:02.185820 219128 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20446-171825/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20446-171825/.minikube/ca.pem (1082 bytes)
I0414 12:41:02.185891 219128 exec_runner.go:144] found /home/jenkins/minikube-integration/20446-171825/.minikube/cert.pem, removing ...
I0414 12:41:02.185898 219128 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20446-171825/.minikube/cert.pem
I0414 12:41:02.185919 219128 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20446-171825/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20446-171825/.minikube/cert.pem (1123 bytes)
I0414 12:41:02.186017 219128 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20446-171825/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20446-171825/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20446-171825/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-650280 san=[127.0.0.1 192.168.39.30 localhost minikube old-k8s-version-650280]
I0414 12:41:02.710588 219128 provision.go:177] copyRemoteCerts
I0414 12:41:02.710655 219128 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0414 12:41:02.710698 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetSSHHostname
I0414 12:41:02.713452 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has defined MAC address 52:54:00:fe:c3:ef in network mk-old-k8s-version-650280
I0414 12:41:02.713775 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fe:c3:ef", ip: ""} in network mk-old-k8s-version-650280: {Iface:virbr3 ExpiryTime:2025-04-14 13:40:55 +0000 UTC Type:0 Mac:52:54:00:fe:c3:ef Iaid: IPaddr:192.168.39.30 Prefix:24 Hostname:old-k8s-version-650280 Clientid:01:52:54:00:fe:c3:ef}
I0414 12:41:02.713807 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has defined IP address 192.168.39.30 and MAC address 52:54:00:fe:c3:ef in network mk-old-k8s-version-650280
I0414 12:41:02.713984 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetSSHPort
I0414 12:41:02.714193 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetSSHKeyPath
I0414 12:41:02.714348 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetSSHUsername
I0414 12:41:02.714486 219128 sshutil.go:53] new ssh client: &{IP:192.168.39.30 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20446-171825/.minikube/machines/old-k8s-version-650280/id_rsa Username:docker}
I0414 12:41:02.791803 219128 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20446-171825/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0414 12:41:02.816744 219128 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20446-171825/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0414 12:41:02.840643 219128 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20446-171825/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0414 12:41:02.865420 219128 provision.go:87] duration metric: took 685.864133ms to configureAuth
I0414 12:41:02.865450 219128 buildroot.go:189] setting minikube options for container-runtime
I0414 12:41:02.865618 219128 config.go:182] Loaded profile config "old-k8s-version-650280": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0414 12:41:02.865690 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetSSHHostname
I0414 12:41:02.868226 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has defined MAC address 52:54:00:fe:c3:ef in network mk-old-k8s-version-650280
I0414 12:41:02.868547 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fe:c3:ef", ip: ""} in network mk-old-k8s-version-650280: {Iface:virbr3 ExpiryTime:2025-04-14 13:40:55 +0000 UTC Type:0 Mac:52:54:00:fe:c3:ef Iaid: IPaddr:192.168.39.30 Prefix:24 Hostname:old-k8s-version-650280 Clientid:01:52:54:00:fe:c3:ef}
I0414 12:41:02.868571 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has defined IP address 192.168.39.30 and MAC address 52:54:00:fe:c3:ef in network mk-old-k8s-version-650280
I0414 12:41:02.868747 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetSSHPort
I0414 12:41:02.868949 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetSSHKeyPath
I0414 12:41:02.869115 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetSSHKeyPath
I0414 12:41:02.869260 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetSSHUsername
I0414 12:41:02.869429 219128 main.go:141] libmachine: Using SSH client type: native
I0414 12:41:02.869631 219128 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.39.30 22 <nil> <nil>}
I0414 12:41:02.869651 219128 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0414 12:41:03.089982 219128 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0414 12:41:03.090008 219128 main.go:141] libmachine: Checking connection to Docker...
I0414 12:41:03.090017 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetURL
I0414 12:41:03.091401 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | using libvirt version 6000000
I0414 12:41:03.094028 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has defined MAC address 52:54:00:fe:c3:ef in network mk-old-k8s-version-650280
I0414 12:41:03.094350 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fe:c3:ef", ip: ""} in network mk-old-k8s-version-650280: {Iface:virbr3 ExpiryTime:2025-04-14 13:40:55 +0000 UTC Type:0 Mac:52:54:00:fe:c3:ef Iaid: IPaddr:192.168.39.30 Prefix:24 Hostname:old-k8s-version-650280 Clientid:01:52:54:00:fe:c3:ef}
I0414 12:41:03.094407 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has defined IP address 192.168.39.30 and MAC address 52:54:00:fe:c3:ef in network mk-old-k8s-version-650280
I0414 12:41:03.094564 219128 main.go:141] libmachine: Docker is up and running!
I0414 12:41:03.094582 219128 main.go:141] libmachine: Reticulating splines...
I0414 12:41:03.094591 219128 client.go:171] duration metric: took 23.369541222s to LocalClient.Create
I0414 12:41:03.094632 219128 start.go:167] duration metric: took 23.369614158s to libmachine.API.Create "old-k8s-version-650280"
I0414 12:41:03.094645 219128 start.go:293] postStartSetup for "old-k8s-version-650280" (driver="kvm2")
I0414 12:41:03.094656 219128 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0414 12:41:03.094676 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .DriverName
I0414 12:41:03.094920 219128 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0414 12:41:03.094962 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetSSHHostname
I0414 12:41:03.097282 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has defined MAC address 52:54:00:fe:c3:ef in network mk-old-k8s-version-650280
I0414 12:41:03.097632 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fe:c3:ef", ip: ""} in network mk-old-k8s-version-650280: {Iface:virbr3 ExpiryTime:2025-04-14 13:40:55 +0000 UTC Type:0 Mac:52:54:00:fe:c3:ef Iaid: IPaddr:192.168.39.30 Prefix:24 Hostname:old-k8s-version-650280 Clientid:01:52:54:00:fe:c3:ef}
I0414 12:41:03.097676 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has defined IP address 192.168.39.30 and MAC address 52:54:00:fe:c3:ef in network mk-old-k8s-version-650280
I0414 12:41:03.097795 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetSSHPort
I0414 12:41:03.097968 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetSSHKeyPath
I0414 12:41:03.098110 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetSSHUsername
I0414 12:41:03.098236 219128 sshutil.go:53] new ssh client: &{IP:192.168.39.30 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20446-171825/.minikube/machines/old-k8s-version-650280/id_rsa Username:docker}
I0414 12:41:03.176110 219128 ssh_runner.go:195] Run: cat /etc/os-release
I0414 12:41:03.180297 219128 info.go:137] Remote host: Buildroot 2023.02.9
I0414 12:41:03.180320 219128 filesync.go:126] Scanning /home/jenkins/minikube-integration/20446-171825/.minikube/addons for local assets ...
I0414 12:41:03.180373 219128 filesync.go:126] Scanning /home/jenkins/minikube-integration/20446-171825/.minikube/files for local assets ...
I0414 12:41:03.180460 219128 filesync.go:149] local asset: /home/jenkins/minikube-integration/20446-171825/.minikube/files/etc/ssl/certs/1789932.pem -> 1789932.pem in /etc/ssl/certs
I0414 12:41:03.180556 219128 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0414 12:41:03.189555 219128 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20446-171825/.minikube/files/etc/ssl/certs/1789932.pem --> /etc/ssl/certs/1789932.pem (1708 bytes)
I0414 12:41:03.212897 219128 start.go:296] duration metric: took 118.235315ms for postStartSetup
I0414 12:41:03.212945 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetConfigRaw
I0414 12:41:03.213525 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetIP
I0414 12:41:03.216230 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has defined MAC address 52:54:00:fe:c3:ef in network mk-old-k8s-version-650280
I0414 12:41:03.216583 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fe:c3:ef", ip: ""} in network mk-old-k8s-version-650280: {Iface:virbr3 ExpiryTime:2025-04-14 13:40:55 +0000 UTC Type:0 Mac:52:54:00:fe:c3:ef Iaid: IPaddr:192.168.39.30 Prefix:24 Hostname:old-k8s-version-650280 Clientid:01:52:54:00:fe:c3:ef}
I0414 12:41:03.216618 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has defined IP address 192.168.39.30 and MAC address 52:54:00:fe:c3:ef in network mk-old-k8s-version-650280
I0414 12:41:03.216804 219128 profile.go:143] Saving config to /home/jenkins/minikube-integration/20446-171825/.minikube/profiles/old-k8s-version-650280/config.json ...
I0414 12:41:03.216975 219128 start.go:128] duration metric: took 23.513562014s to createHost
I0414 12:41:03.216999 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetSSHHostname
I0414 12:41:03.219459 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has defined MAC address 52:54:00:fe:c3:ef in network mk-old-k8s-version-650280
I0414 12:41:03.219822 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fe:c3:ef", ip: ""} in network mk-old-k8s-version-650280: {Iface:virbr3 ExpiryTime:2025-04-14 13:40:55 +0000 UTC Type:0 Mac:52:54:00:fe:c3:ef Iaid: IPaddr:192.168.39.30 Prefix:24 Hostname:old-k8s-version-650280 Clientid:01:52:54:00:fe:c3:ef}
I0414 12:41:03.219843 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has defined IP address 192.168.39.30 and MAC address 52:54:00:fe:c3:ef in network mk-old-k8s-version-650280
I0414 12:41:03.220035 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetSSHPort
I0414 12:41:03.220217 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetSSHKeyPath
I0414 12:41:03.220366 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetSSHKeyPath
I0414 12:41:03.220511 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetSSHUsername
I0414 12:41:03.220667 219128 main.go:141] libmachine: Using SSH client type: native
I0414 12:41:03.220910 219128 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.39.30 22 <nil> <nil>}
I0414 12:41:03.220923 219128 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0414 12:41:03.318779 219128 main.go:141] libmachine: SSH cmd err, output: <nil>: 1744634463.291758465
I0414 12:41:03.318812 219128 fix.go:216] guest clock: 1744634463.291758465
I0414 12:41:03.318823 219128 fix.go:229] Guest: 2025-04-14 12:41:03.291758465 +0000 UTC Remote: 2025-04-14 12:41:03.216986524 +0000 UTC m=+23.645719043 (delta=74.771941ms)
I0414 12:41:03.318866 219128 fix.go:200] guest clock delta is within tolerance: 74.771941ms
I0414 12:41:03.318874 219128 start.go:83] releasing machines lock for "old-k8s-version-650280", held for 23.615568917s
I0414 12:41:03.318904 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .DriverName
I0414 12:41:03.319192 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetIP
I0414 12:41:03.321814 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has defined MAC address 52:54:00:fe:c3:ef in network mk-old-k8s-version-650280
I0414 12:41:03.322192 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fe:c3:ef", ip: ""} in network mk-old-k8s-version-650280: {Iface:virbr3 ExpiryTime:2025-04-14 13:40:55 +0000 UTC Type:0 Mac:52:54:00:fe:c3:ef Iaid: IPaddr:192.168.39.30 Prefix:24 Hostname:old-k8s-version-650280 Clientid:01:52:54:00:fe:c3:ef}
I0414 12:41:03.322223 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has defined IP address 192.168.39.30 and MAC address 52:54:00:fe:c3:ef in network mk-old-k8s-version-650280
I0414 12:41:03.322401 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .DriverName
I0414 12:41:03.322963 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .DriverName
I0414 12:41:03.323168 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .DriverName
I0414 12:41:03.323260 219128 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0414 12:41:03.323308 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetSSHHostname
I0414 12:41:03.323411 219128 ssh_runner.go:195] Run: cat /version.json
I0414 12:41:03.323429 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetSSHHostname
I0414 12:41:03.325972 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has defined MAC address 52:54:00:fe:c3:ef in network mk-old-k8s-version-650280
I0414 12:41:03.326355 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fe:c3:ef", ip: ""} in network mk-old-k8s-version-650280: {Iface:virbr3 ExpiryTime:2025-04-14 13:40:55 +0000 UTC Type:0 Mac:52:54:00:fe:c3:ef Iaid: IPaddr:192.168.39.30 Prefix:24 Hostname:old-k8s-version-650280 Clientid:01:52:54:00:fe:c3:ef}
I0414 12:41:03.326383 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has defined MAC address 52:54:00:fe:c3:ef in network mk-old-k8s-version-650280
I0414 12:41:03.326426 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has defined IP address 192.168.39.30 and MAC address 52:54:00:fe:c3:ef in network mk-old-k8s-version-650280
I0414 12:41:03.326646 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetSSHPort
I0414 12:41:03.326833 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fe:c3:ef", ip: ""} in network mk-old-k8s-version-650280: {Iface:virbr3 ExpiryTime:2025-04-14 13:40:55 +0000 UTC Type:0 Mac:52:54:00:fe:c3:ef Iaid: IPaddr:192.168.39.30 Prefix:24 Hostname:old-k8s-version-650280 Clientid:01:52:54:00:fe:c3:ef}
I0414 12:41:03.326836 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetSSHKeyPath
I0414 12:41:03.326861 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has defined IP address 192.168.39.30 and MAC address 52:54:00:fe:c3:ef in network mk-old-k8s-version-650280
I0414 12:41:03.326980 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetSSHPort
I0414 12:41:03.327074 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetSSHUsername
I0414 12:41:03.327155 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetSSHKeyPath
I0414 12:41:03.327220 219128 sshutil.go:53] new ssh client: &{IP:192.168.39.30 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20446-171825/.minikube/machines/old-k8s-version-650280/id_rsa Username:docker}
I0414 12:41:03.327286 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetSSHUsername
I0414 12:41:03.327401 219128 sshutil.go:53] new ssh client: &{IP:192.168.39.30 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20446-171825/.minikube/machines/old-k8s-version-650280/id_rsa Username:docker}
I0414 12:41:03.423321 219128 ssh_runner.go:195] Run: systemctl --version
I0414 12:41:03.431505 219128 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0414 12:41:03.599582 219128 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0414 12:41:03.606208 219128 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0414 12:41:03.606268 219128 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0414 12:41:03.622954 219128 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0414 12:41:03.622979 219128 start.go:495] detecting cgroup driver to use...
I0414 12:41:03.623067 219128 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0414 12:41:03.639091 219128 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0414 12:41:03.659066 219128 docker.go:217] disabling cri-docker service (if available) ...
I0414 12:41:03.659121 219128 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0414 12:41:03.675481 219128 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0414 12:41:03.689458 219128 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0414 12:41:03.801761 219128 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0414 12:41:03.974272 219128 docker.go:233] disabling docker service ...
I0414 12:41:03.974340 219128 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0414 12:41:03.990204 219128 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0414 12:41:04.003380 219128 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0414 12:41:04.123978 219128 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0414 12:41:04.255494 219128 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0414 12:41:04.269821 219128 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0414 12:41:04.288060 219128 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0414 12:41:04.288135 219128 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0414 12:41:04.299605 219128 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0414 12:41:04.299679 219128 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0414 12:41:04.310760 219128 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0414 12:41:04.321768 219128 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0414 12:41:04.332453 219128 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0414 12:41:04.343337 219128 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0414 12:41:04.352936 219128 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0414 12:41:04.352985 219128 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0414 12:41:04.366164 219128 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0414 12:41:04.376508 219128 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0414 12:41:04.512538 219128 ssh_runner.go:195] Run: sudo systemctl restart crio
I0414 12:41:04.607628 219128 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0414 12:41:04.607696 219128 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0414 12:41:04.612630 219128 start.go:563] Will wait 60s for crictl version
I0414 12:41:04.612693 219128 ssh_runner.go:195] Run: which crictl
I0414 12:41:04.616821 219128 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0414 12:41:04.658262 219128 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0414 12:41:04.658365 219128 ssh_runner.go:195] Run: crio --version
I0414 12:41:04.687045 219128 ssh_runner.go:195] Run: crio --version
I0414 12:41:04.716098 219128 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0414 12:41:04.717389 219128 main.go:141] libmachine: (old-k8s-version-650280) Calling .GetIP
I0414 12:41:04.720439 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has defined MAC address 52:54:00:fe:c3:ef in network mk-old-k8s-version-650280
I0414 12:41:04.720939 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:fe:c3:ef", ip: ""} in network mk-old-k8s-version-650280: {Iface:virbr3 ExpiryTime:2025-04-14 13:40:55 +0000 UTC Type:0 Mac:52:54:00:fe:c3:ef Iaid: IPaddr:192.168.39.30 Prefix:24 Hostname:old-k8s-version-650280 Clientid:01:52:54:00:fe:c3:ef}
I0414 12:41:04.720974 219128 main.go:141] libmachine: (old-k8s-version-650280) DBG | domain old-k8s-version-650280 has defined IP address 192.168.39.30 and MAC address 52:54:00:fe:c3:ef in network mk-old-k8s-version-650280
I0414 12:41:04.721214 219128 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I0414 12:41:04.725296 219128 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0414 12:41:04.738865 219128 kubeadm.go:883] updating cluster {Name:old-k8s-version-650280 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-
version-650280 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.30 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUI
D:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0414 12:41:04.738962 219128 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0414 12:41:04.739000 219128 ssh_runner.go:195] Run: sudo crictl images --output json
I0414 12:41:04.773460 219128 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0414 12:41:04.773550 219128 ssh_runner.go:195] Run: which lz4
I0414 12:41:04.777813 219128 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0414 12:41:04.782572 219128 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0414 12:41:04.782608 219128 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20446-171825/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0414 12:41:06.526382 219128 crio.go:462] duration metric: took 1.748594696s to copy over tarball
I0414 12:41:06.526472 219128 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0414 12:41:09.059175 219128 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.53266595s)
I0414 12:41:09.059209 219128 crio.go:469] duration metric: took 2.532793693s to extract the tarball
I0414 12:41:09.059217 219128 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0414 12:41:09.102130 219128 ssh_runner.go:195] Run: sudo crictl images --output json
I0414 12:41:09.147057 219128 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0414 12:41:09.147091 219128 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0414 12:41:09.147201 219128 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0414 12:41:09.147235 219128 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0414 12:41:09.147242 219128 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0414 12:41:09.147234 219128 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0414 12:41:09.147251 219128 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0414 12:41:09.147215 219128 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0414 12:41:09.147180 219128 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0414 12:41:09.147290 219128 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0414 12:41:09.149163 219128 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0414 12:41:09.149170 219128 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0414 12:41:09.149167 219128 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0414 12:41:09.149170 219128 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0414 12:41:09.149170 219128 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0414 12:41:09.149225 219128 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0414 12:41:09.149170 219128 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0414 12:41:09.149267 219128 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0414 12:41:09.294167 219128 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0414 12:41:09.298056 219128 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0414 12:41:09.299650 219128 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0414 12:41:09.303129 219128 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0414 12:41:09.303969 219128 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0414 12:41:09.305117 219128 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0414 12:41:09.308836 219128 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0414 12:41:09.407077 219128 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0414 12:41:09.407128 219128 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0414 12:41:09.407177 219128 ssh_runner.go:195] Run: which crictl
I0414 12:41:09.469847 219128 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0414 12:41:09.469903 219128 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0414 12:41:09.469932 219128 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0414 12:41:09.469970 219128 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0414 12:41:09.470012 219128 ssh_runner.go:195] Run: which crictl
I0414 12:41:09.469974 219128 ssh_runner.go:195] Run: which crictl
I0414 12:41:09.480170 219128 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0414 12:41:09.480212 219128 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0414 12:41:09.480261 219128 ssh_runner.go:195] Run: which crictl
I0414 12:41:09.484166 219128 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0414 12:41:09.484211 219128 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0414 12:41:09.484255 219128 ssh_runner.go:195] Run: which crictl
I0414 12:41:09.484329 219128 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0414 12:41:09.484365 219128 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0414 12:41:09.484371 219128 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0414 12:41:09.484394 219128 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0414 12:41:09.484420 219128 ssh_runner.go:195] Run: which crictl
I0414 12:41:09.484436 219128 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0414 12:41:09.484440 219128 ssh_runner.go:195] Run: which crictl
I0414 12:41:09.487887 219128 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0414 12:41:09.488036 219128 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0414 12:41:09.490874 219128 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0414 12:41:09.501332 219128 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0414 12:41:09.501377 219128 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0414 12:41:09.570720 219128 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0414 12:41:09.570826 219128 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0414 12:41:09.640465 219128 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0414 12:41:09.640568 219128 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0414 12:41:09.641966 219128 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0414 12:41:09.642096 219128 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0414 12:41:09.642099 219128 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0414 12:41:09.758489 219128 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0414 12:41:09.758647 219128 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0414 12:41:09.758681 219128 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0414 12:41:09.758728 219128 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0414 12:41:09.784637 219128 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0414 12:41:09.792621 219128 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0414 12:41:09.792817 219128 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0414 12:41:09.920866 219128 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20446-171825/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0414 12:41:09.933745 219128 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20446-171825/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0414 12:41:09.933798 219128 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20446-171825/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0414 12:41:09.933858 219128 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0414 12:41:09.947174 219128 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20446-171825/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0414 12:41:09.947237 219128 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20446-171825/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0414 12:41:09.947258 219128 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20446-171825/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0414 12:41:09.970543 219128 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20446-171825/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0414 12:41:10.852757 219128 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0414 12:41:10.993269 219128 cache_images.go:92] duration metric: took 1.846154041s to LoadCachedImages
W0414 12:41:10.993368 219128 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20446-171825/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20446-171825/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0: no such file or directory
I0414 12:41:10.993384 219128 kubeadm.go:934] updating node { 192.168.39.30 8443 v1.20.0 crio true true} ...
I0414 12:41:10.993527 219128 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-650280 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.39.30
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-650280 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0414 12:41:10.993616 219128 ssh_runner.go:195] Run: crio config
I0414 12:41:11.056775 219128 cni.go:84] Creating CNI manager for ""
I0414 12:41:11.056807 219128 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0414 12:41:11.056818 219128 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0414 12:41:11.056837 219128 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.30 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-650280 NodeName:old-k8s-version-650280 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.30"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.30 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Stati
cPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0414 12:41:11.056970 219128 kubeadm.go:195] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.39.30
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-650280"
kubeletExtraArgs:
node-ip: 192.168.39.30
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.39.30"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0414 12:41:11.057045 219128 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0414 12:41:11.067606 219128 binaries.go:44] Found k8s binaries, skipping transfer
I0414 12:41:11.067688 219128 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0414 12:41:11.077576 219128 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (429 bytes)
I0414 12:41:11.095632 219128 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0414 12:41:11.112642 219128 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2120 bytes)
I0414 12:41:11.129724 219128 ssh_runner.go:195] Run: grep 192.168.39.30 control-plane.minikube.internal$ /etc/hosts
I0414 12:41:11.133783 219128 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.30 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0414 12:41:11.147042 219128 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0414 12:41:11.286135 219128 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0414 12:41:11.304540 219128 certs.go:68] Setting up /home/jenkins/minikube-integration/20446-171825/.minikube/profiles/old-k8s-version-650280 for IP: 192.168.39.30
I0414 12:41:11.304570 219128 certs.go:194] generating shared ca certs ...
I0414 12:41:11.304594 219128 certs.go:226] acquiring lock for ca certs: {Name:mk23f15163c4a31b4f120ac1b0873f0d6ee94573 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0414 12:41:11.304778 219128 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20446-171825/.minikube/ca.key
I0414 12:41:11.304831 219128 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20446-171825/.minikube/proxy-client-ca.key
I0414 12:41:11.304852 219128 certs.go:256] generating profile certs ...
I0414 12:41:11.304926 219128 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/20446-171825/.minikube/profiles/old-k8s-version-650280/client.key
I0414 12:41:11.304956 219128 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20446-171825/.minikube/profiles/old-k8s-version-650280/client.crt with IP's: []
I0414 12:41:11.438800 219128 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20446-171825/.minikube/profiles/old-k8s-version-650280/client.crt ...
I0414 12:41:11.438836 219128 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20446-171825/.minikube/profiles/old-k8s-version-650280/client.crt: {Name:mk3d014dbe833a2fa323bc7730eb2a426f3a2aac Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0414 12:41:11.439044 219128 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20446-171825/.minikube/profiles/old-k8s-version-650280/client.key ...
I0414 12:41:11.439066 219128 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20446-171825/.minikube/profiles/old-k8s-version-650280/client.key: {Name:mk9dbc0a70565c3ef174ed0303788ad581b80ac0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0414 12:41:11.439177 219128 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20446-171825/.minikube/profiles/old-k8s-version-650280/apiserver.key.a6c88699
I0414 12:41:11.439206 219128 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20446-171825/.minikube/profiles/old-k8s-version-650280/apiserver.crt.a6c88699 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.30]
I0414 12:41:11.636314 219128 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20446-171825/.minikube/profiles/old-k8s-version-650280/apiserver.crt.a6c88699 ...
I0414 12:41:11.636347 219128 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20446-171825/.minikube/profiles/old-k8s-version-650280/apiserver.crt.a6c88699: {Name:mk0c62e997e457ded74b5b70b76ef38ced1e6fa0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0414 12:41:11.636503 219128 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20446-171825/.minikube/profiles/old-k8s-version-650280/apiserver.key.a6c88699 ...
I0414 12:41:11.636541 219128 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20446-171825/.minikube/profiles/old-k8s-version-650280/apiserver.key.a6c88699: {Name:mkd7dcea27ee713d7dd6cb4ddd6aa66b141664e8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0414 12:41:11.636630 219128 certs.go:381] copying /home/jenkins/minikube-integration/20446-171825/.minikube/profiles/old-k8s-version-650280/apiserver.crt.a6c88699 -> /home/jenkins/minikube-integration/20446-171825/.minikube/profiles/old-k8s-version-650280/apiserver.crt
I0414 12:41:11.636710 219128 certs.go:385] copying /home/jenkins/minikube-integration/20446-171825/.minikube/profiles/old-k8s-version-650280/apiserver.key.a6c88699 -> /home/jenkins/minikube-integration/20446-171825/.minikube/profiles/old-k8s-version-650280/apiserver.key
I0414 12:41:11.636765 219128 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/20446-171825/.minikube/profiles/old-k8s-version-650280/proxy-client.key
I0414 12:41:11.636780 219128 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20446-171825/.minikube/profiles/old-k8s-version-650280/proxy-client.crt with IP's: []
I0414 12:41:11.978204 219128 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20446-171825/.minikube/profiles/old-k8s-version-650280/proxy-client.crt ...
I0414 12:41:11.978237 219128 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20446-171825/.minikube/profiles/old-k8s-version-650280/proxy-client.crt: {Name:mk386307fba8c5152b3acb1de308fe2d5b248d49 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0414 12:41:11.978398 219128 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20446-171825/.minikube/profiles/old-k8s-version-650280/proxy-client.key ...
I0414 12:41:11.978411 219128 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20446-171825/.minikube/profiles/old-k8s-version-650280/proxy-client.key: {Name:mk66df3a990e2995013cd4495b6207e5c0575a2d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0414 12:41:11.978587 219128 certs.go:484] found cert: /home/jenkins/minikube-integration/20446-171825/.minikube/certs/178993.pem (1338 bytes)
W0414 12:41:11.978622 219128 certs.go:480] ignoring /home/jenkins/minikube-integration/20446-171825/.minikube/certs/178993_empty.pem, impossibly tiny 0 bytes
I0414 12:41:11.978659 219128 certs.go:484] found cert: /home/jenkins/minikube-integration/20446-171825/.minikube/certs/ca-key.pem (1679 bytes)
I0414 12:41:11.978689 219128 certs.go:484] found cert: /home/jenkins/minikube-integration/20446-171825/.minikube/certs/ca.pem (1082 bytes)
I0414 12:41:11.978713 219128 certs.go:484] found cert: /home/jenkins/minikube-integration/20446-171825/.minikube/certs/cert.pem (1123 bytes)
I0414 12:41:11.978734 219128 certs.go:484] found cert: /home/jenkins/minikube-integration/20446-171825/.minikube/certs/key.pem (1675 bytes)
I0414 12:41:11.978771 219128 certs.go:484] found cert: /home/jenkins/minikube-integration/20446-171825/.minikube/files/etc/ssl/certs/1789932.pem (1708 bytes)
I0414 12:41:11.979332 219128 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20446-171825/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0414 12:41:12.006153 219128 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20446-171825/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0414 12:41:12.036499 219128 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20446-171825/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0414 12:41:12.067172 219128 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20446-171825/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0414 12:41:12.092485 219128 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20446-171825/.minikube/profiles/old-k8s-version-650280/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0414 12:41:12.122180 219128 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20446-171825/.minikube/profiles/old-k8s-version-650280/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0414 12:41:12.160091 219128 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20446-171825/.minikube/profiles/old-k8s-version-650280/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0414 12:41:12.195107 219128 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20446-171825/.minikube/profiles/old-k8s-version-650280/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0414 12:41:12.222631 219128 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20446-171825/.minikube/files/etc/ssl/certs/1789932.pem --> /usr/share/ca-certificates/1789932.pem (1708 bytes)
I0414 12:41:12.248512 219128 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20446-171825/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0414 12:41:12.272755 219128 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20446-171825/.minikube/certs/178993.pem --> /usr/share/ca-certificates/178993.pem (1338 bytes)
I0414 12:41:12.296514 219128 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0414 12:41:12.314661 219128 ssh_runner.go:195] Run: openssl version
I0414 12:41:12.320652 219128 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0414 12:41:12.332315 219128 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0414 12:41:12.337045 219128 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Apr 14 11:36 /usr/share/ca-certificates/minikubeCA.pem
I0414 12:41:12.337122 219128 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0414 12:41:12.343371 219128 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0414 12:41:12.355282 219128 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/178993.pem && ln -fs /usr/share/ca-certificates/178993.pem /etc/ssl/certs/178993.pem"
I0414 12:41:12.366558 219128 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/178993.pem
I0414 12:41:12.371383 219128 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Apr 14 11:43 /usr/share/ca-certificates/178993.pem
I0414 12:41:12.371439 219128 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/178993.pem
I0414 12:41:12.378046 219128 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/178993.pem /etc/ssl/certs/51391683.0"
I0414 12:41:12.389786 219128 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1789932.pem && ln -fs /usr/share/ca-certificates/1789932.pem /etc/ssl/certs/1789932.pem"
I0414 12:41:12.401815 219128 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1789932.pem
I0414 12:41:12.407805 219128 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Apr 14 11:43 /usr/share/ca-certificates/1789932.pem
I0414 12:41:12.407868 219128 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1789932.pem
I0414 12:41:12.415522 219128 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/1789932.pem /etc/ssl/certs/3ec20f2e.0"
I0414 12:41:12.426700 219128 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0414 12:41:12.430971 219128 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0414 12:41:12.431031 219128 kubeadm.go:392] StartCluster: {Name:old-k8s-version-650280 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-ver
sion-650280 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.30 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:d
ocker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0414 12:41:12.431121 219128 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0414 12:41:12.431174 219128 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0414 12:41:12.469866 219128 cri.go:89] found id: ""
I0414 12:41:12.469974 219128 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0414 12:41:12.481559 219128 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0414 12:41:12.492083 219128 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0414 12:41:12.502676 219128 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0414 12:41:12.502696 219128 kubeadm.go:157] found existing configuration files:
I0414 12:41:12.502748 219128 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0414 12:41:12.512307 219128 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0414 12:41:12.512364 219128 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0414 12:41:12.522334 219128 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0414 12:41:12.533336 219128 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0414 12:41:12.533406 219128 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0414 12:41:12.543886 219128 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0414 12:41:12.553448 219128 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0414 12:41:12.553495 219128 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0414 12:41:12.563516 219128 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0414 12:41:12.573077 219128 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0414 12:41:12.573145 219128 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0414 12:41:12.582877 219128 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0414 12:41:12.697097 219128 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0414 12:41:12.697231 219128 kubeadm.go:310] [preflight] Running pre-flight checks
I0414 12:41:12.844541 219128 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0414 12:41:12.844704 219128 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0414 12:41:12.844888 219128 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0414 12:41:13.084837 219128 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0414 12:41:13.141408 219128 out.go:235] - Generating certificates and keys ...
I0414 12:41:13.141531 219128 kubeadm.go:310] [certs] Using existing ca certificate authority
I0414 12:41:13.141609 219128 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0414 12:41:13.257229 219128 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0414 12:41:13.471991 219128 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0414 12:41:13.938597 219128 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0414 12:41:14.028636 219128 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0414 12:41:14.277210 219128 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0414 12:41:14.277461 219128 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-650280] and IPs [192.168.39.30 127.0.0.1 ::1]
I0414 12:41:14.458078 219128 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0414 12:41:14.459889 219128 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-650280] and IPs [192.168.39.30 127.0.0.1 ::1]
I0414 12:41:14.884164 219128 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0414 12:41:15.065413 219128 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0414 12:41:15.165404 219128 kubeadm.go:310] [certs] Generating "sa" key and public key
I0414 12:41:15.165504 219128 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0414 12:41:15.841731 219128 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0414 12:41:16.063251 219128 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0414 12:41:16.217869 219128 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0414 12:41:16.345158 219128 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0414 12:41:16.366433 219128 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0414 12:41:16.367651 219128 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0414 12:41:16.367707 219128 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0414 12:41:16.500013 219128 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0414 12:41:16.501661 219128 out.go:235] - Booting up control plane ...
I0414 12:41:16.501774 219128 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0414 12:41:16.507966 219128 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0414 12:41:16.508798 219128 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0414 12:41:16.509674 219128 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0414 12:41:16.514379 219128 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0414 12:41:56.507448 219128 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0414 12:41:56.509287 219128 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0414 12:41:56.509555 219128 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0414 12:42:01.509872 219128 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0414 12:42:01.510165 219128 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0414 12:42:11.509182 219128 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0414 12:42:11.509367 219128 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0414 12:42:31.511301 219128 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0414 12:42:31.511586 219128 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0414 12:43:11.512174 219128 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0414 12:43:11.512389 219128 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0414 12:43:11.512401 219128 kubeadm.go:310]
I0414 12:43:11.512436 219128 kubeadm.go:310] Unfortunately, an error has occurred:
I0414 12:43:11.512471 219128 kubeadm.go:310] timed out waiting for the condition
I0414 12:43:11.512478 219128 kubeadm.go:310]
I0414 12:43:11.512507 219128 kubeadm.go:310] This error is likely caused by:
I0414 12:43:11.512536 219128 kubeadm.go:310] - The kubelet is not running
I0414 12:43:11.512644 219128 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0414 12:43:11.512654 219128 kubeadm.go:310]
I0414 12:43:11.512756 219128 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0414 12:43:11.512787 219128 kubeadm.go:310] - 'systemctl status kubelet'
I0414 12:43:11.512862 219128 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0414 12:43:11.512887 219128 kubeadm.go:310]
I0414 12:43:11.513039 219128 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0414 12:43:11.513351 219128 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0414 12:43:11.513379 219128 kubeadm.go:310]
I0414 12:43:11.513527 219128 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0414 12:43:11.513666 219128 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0414 12:43:11.513787 219128 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0414 12:43:11.513902 219128 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0414 12:43:11.513941 219128 kubeadm.go:310]
I0414 12:43:11.514303 219128 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0414 12:43:11.514428 219128 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0414 12:43:11.514525 219128 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
W0414 12:43:11.514682 219128 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-650280] and IPs [192.168.39.30 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-650280] and IPs [192.168.39.30 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-650280] and IPs [192.168.39.30 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-650280] and IPs [192.168.39.30 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0414 12:43:11.514723 219128 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0414 12:43:11.982906 219128 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0414 12:43:11.997446 219128 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0414 12:43:12.007490 219128 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0414 12:43:12.007507 219128 kubeadm.go:157] found existing configuration files:
I0414 12:43:12.007545 219128 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0414 12:43:12.016820 219128 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0414 12:43:12.016861 219128 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0414 12:43:12.026361 219128 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0414 12:43:12.035451 219128 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0414 12:43:12.035505 219128 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0414 12:43:12.044863 219128 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0414 12:43:12.054618 219128 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0414 12:43:12.054663 219128 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0414 12:43:12.064068 219128 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0414 12:43:12.073272 219128 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0414 12:43:12.073315 219128 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0414 12:43:12.083203 219128 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0414 12:43:12.293490 219128 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0414 12:45:08.176663 219128 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0414 12:45:08.176797 219128 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0414 12:45:08.179148 219128 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0414 12:45:08.179251 219128 kubeadm.go:310] [preflight] Running pre-flight checks
I0414 12:45:08.179387 219128 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0414 12:45:08.179522 219128 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0414 12:45:08.179657 219128 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0414 12:45:08.179747 219128 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0414 12:45:08.191192 219128 out.go:235] - Generating certificates and keys ...
I0414 12:45:08.191301 219128 kubeadm.go:310] [certs] Using existing ca certificate authority
I0414 12:45:08.191390 219128 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0414 12:45:08.191522 219128 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0414 12:45:08.191638 219128 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0414 12:45:08.191750 219128 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0414 12:45:08.191829 219128 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0414 12:45:08.191916 219128 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0414 12:45:08.192000 219128 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0414 12:45:08.192088 219128 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0414 12:45:08.192202 219128 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0414 12:45:08.192257 219128 kubeadm.go:310] [certs] Using the existing "sa" key
I0414 12:45:08.192326 219128 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0414 12:45:08.192398 219128 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0414 12:45:08.192465 219128 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0414 12:45:08.192547 219128 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0414 12:45:08.192652 219128 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0414 12:45:08.192814 219128 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0414 12:45:08.192933 219128 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0414 12:45:08.192991 219128 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0414 12:45:08.193072 219128 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0414 12:45:08.197553 219128 out.go:235] - Booting up control plane ...
I0414 12:45:08.197655 219128 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0414 12:45:08.197735 219128 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0414 12:45:08.197821 219128 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0414 12:45:08.197934 219128 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0414 12:45:08.198168 219128 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0414 12:45:08.198231 219128 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0414 12:45:08.198358 219128 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0414 12:45:08.198610 219128 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0414 12:45:08.198715 219128 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0414 12:45:08.198971 219128 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0414 12:45:08.199064 219128 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0414 12:45:08.199332 219128 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0414 12:45:08.199426 219128 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0414 12:45:08.199679 219128 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0414 12:45:08.199775 219128 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0414 12:45:08.200031 219128 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0414 12:45:08.200043 219128 kubeadm.go:310]
I0414 12:45:08.200114 219128 kubeadm.go:310] Unfortunately, an error has occurred:
I0414 12:45:08.200186 219128 kubeadm.go:310] timed out waiting for the condition
I0414 12:45:08.200205 219128 kubeadm.go:310]
I0414 12:45:08.200255 219128 kubeadm.go:310] This error is likely caused by:
I0414 12:45:08.200317 219128 kubeadm.go:310] - The kubelet is not running
I0414 12:45:08.200420 219128 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0414 12:45:08.200432 219128 kubeadm.go:310]
I0414 12:45:08.200537 219128 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0414 12:45:08.200595 219128 kubeadm.go:310] - 'systemctl status kubelet'
I0414 12:45:08.200653 219128 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0414 12:45:08.200668 219128 kubeadm.go:310]
I0414 12:45:08.200784 219128 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0414 12:45:08.200855 219128 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0414 12:45:08.200862 219128 kubeadm.go:310]
I0414 12:45:08.201009 219128 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0414 12:45:08.201138 219128 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0414 12:45:08.201244 219128 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0414 12:45:08.201348 219128 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0414 12:45:08.201376 219128 kubeadm.go:310]
I0414 12:45:08.201447 219128 kubeadm.go:394] duration metric: took 3m55.770418315s to StartCluster
I0414 12:45:08.201509 219128 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0414 12:45:08.201578 219128 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0414 12:45:08.271334 219128 cri.go:89] found id: ""
I0414 12:45:08.271366 219128 logs.go:282] 0 containers: []
W0414 12:45:08.271378 219128 logs.go:284] No container was found matching "kube-apiserver"
I0414 12:45:08.271386 219128 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0414 12:45:08.271465 219128 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0414 12:45:08.325073 219128 cri.go:89] found id: ""
I0414 12:45:08.325100 219128 logs.go:282] 0 containers: []
W0414 12:45:08.325107 219128 logs.go:284] No container was found matching "etcd"
I0414 12:45:08.325134 219128 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0414 12:45:08.325226 219128 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0414 12:45:08.372849 219128 cri.go:89] found id: ""
I0414 12:45:08.372897 219128 logs.go:282] 0 containers: []
W0414 12:45:08.372920 219128 logs.go:284] No container was found matching "coredns"
I0414 12:45:08.372929 219128 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0414 12:45:08.372995 219128 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0414 12:45:08.428692 219128 cri.go:89] found id: ""
I0414 12:45:08.428732 219128 logs.go:282] 0 containers: []
W0414 12:45:08.428745 219128 logs.go:284] No container was found matching "kube-scheduler"
I0414 12:45:08.428752 219128 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0414 12:45:08.428822 219128 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0414 12:45:08.471439 219128 cri.go:89] found id: ""
I0414 12:45:08.471477 219128 logs.go:282] 0 containers: []
W0414 12:45:08.471488 219128 logs.go:284] No container was found matching "kube-proxy"
I0414 12:45:08.471497 219128 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0414 12:45:08.471565 219128 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0414 12:45:08.513122 219128 cri.go:89] found id: ""
I0414 12:45:08.513160 219128 logs.go:282] 0 containers: []
W0414 12:45:08.513173 219128 logs.go:284] No container was found matching "kube-controller-manager"
I0414 12:45:08.513183 219128 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0414 12:45:08.513258 219128 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0414 12:45:08.554296 219128 cri.go:89] found id: ""
I0414 12:45:08.554387 219128 logs.go:282] 0 containers: []
W0414 12:45:08.554414 219128 logs.go:284] No container was found matching "kindnet"
I0414 12:45:08.554439 219128 logs.go:123] Gathering logs for kubelet ...
I0414 12:45:08.554462 219128 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0414 12:45:08.611782 219128 logs.go:123] Gathering logs for dmesg ...
I0414 12:45:08.611820 219128 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0414 12:45:08.630026 219128 logs.go:123] Gathering logs for describe nodes ...
I0414 12:45:08.630064 219128 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0414 12:45:08.782730 219128 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0414 12:45:08.782764 219128 logs.go:123] Gathering logs for CRI-O ...
I0414 12:45:08.782780 219128 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0414 12:45:08.945113 219128 logs.go:123] Gathering logs for container status ...
I0414 12:45:08.945171 219128 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0414 12:45:09.025204 219128 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0414 12:45:09.025327 219128 out.go:270] *
*
W0414 12:45:09.025411 219128 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0414 12:45:09.025435 219128 out.go:270] *
*
W0414 12:45:09.026548 219128 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0414 12:45:09.029971 219128 out.go:201]
W0414 12:45:09.031152 219128 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0414 12:45:09.031516 219128 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0414 12:45:09.031576 219128 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0414 12:45:09.033528 219128 out.go:201]
** /stderr **
start_stop_delete_test.go:186: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-650280 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-650280 -n old-k8s-version-650280
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-650280 -n old-k8s-version-650280: exit status 6 (302.793904ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0414 12:45:09.406414 222225 status.go:458] kubeconfig endpoint: get endpoint: "old-k8s-version-650280" does not appear in /home/jenkins/minikube-integration/20446-171825/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-650280" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (269.86s)