=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:184: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-191773 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:184: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-191773 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m28.612827419s)
-- stdout --
* [old-k8s-version-191773] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=20363
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/20363-12788/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/20363-12788/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-191773" primary control-plane node in "old-k8s-version-191773" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0205 03:11:40.671428 60782 out.go:345] Setting OutFile to fd 1 ...
I0205 03:11:40.671522 60782 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0205 03:11:40.671529 60782 out.go:358] Setting ErrFile to fd 2...
I0205 03:11:40.671534 60782 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0205 03:11:40.671726 60782 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20363-12788/.minikube/bin
I0205 03:11:40.672293 60782 out.go:352] Setting JSON to false
I0205 03:11:40.673191 60782 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-7","uptime":6852,"bootTime":1738718249,"procs":210,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1075-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0205 03:11:40.673284 60782 start.go:139] virtualization: kvm guest
I0205 03:11:40.675592 60782 out.go:177] * [old-k8s-version-191773] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
I0205 03:11:40.676847 60782 out.go:177] - MINIKUBE_LOCATION=20363
I0205 03:11:40.676862 60782 notify.go:220] Checking for updates...
I0205 03:11:40.679069 60782 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0205 03:11:40.680298 60782 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/20363-12788/kubeconfig
I0205 03:11:40.681573 60782 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/20363-12788/.minikube
I0205 03:11:40.682733 60782 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0205 03:11:40.683793 60782 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0205 03:11:40.685621 60782 config.go:182] Loaded profile config "cert-expiration-908105": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.1
I0205 03:11:40.685717 60782 config.go:182] Loaded profile config "kubernetes-upgrade-024079": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0205 03:11:40.685828 60782 config.go:182] Loaded profile config "pause-922984": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.1
I0205 03:11:40.685907 60782 driver.go:394] Setting default libvirt URI to qemu:///system
I0205 03:11:40.721282 60782 out.go:177] * Using the kvm2 driver based on user configuration
I0205 03:11:40.722411 60782 start.go:297] selected driver: kvm2
I0205 03:11:40.722426 60782 start.go:901] validating driver "kvm2" against <nil>
I0205 03:11:40.722436 60782 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0205 03:11:40.723144 60782 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0205 03:11:40.723224 60782 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/20363-12788/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0205 03:11:40.738182 60782 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.35.0
I0205 03:11:40.738230 60782 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0205 03:11:40.738554 60782 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0205 03:11:40.738588 60782 cni.go:84] Creating CNI manager for ""
I0205 03:11:40.738634 60782 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0205 03:11:40.738643 60782 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0205 03:11:40.738695 60782 start.go:340] cluster config:
{Name:old-k8s-version-191773 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-191773 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRI
Socket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:
0 GPUs: AutoPauseInterval:1m0s}
I0205 03:11:40.738786 60782 iso.go:125] acquiring lock: {Name:mk486603e8d6546d81b9e7d0a893261360630790 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0205 03:11:40.740506 60782 out.go:177] * Starting "old-k8s-version-191773" primary control-plane node in "old-k8s-version-191773" cluster
I0205 03:11:40.741611 60782 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0205 03:11:40.741644 60782 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20363-12788/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0205 03:11:40.741650 60782 cache.go:56] Caching tarball of preloaded images
I0205 03:11:40.741718 60782 preload.go:172] Found /home/jenkins/minikube-integration/20363-12788/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0205 03:11:40.741728 60782 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0205 03:11:40.741806 60782 profile.go:143] Saving config to /home/jenkins/minikube-integration/20363-12788/.minikube/profiles/old-k8s-version-191773/config.json ...
I0205 03:11:40.741823 60782 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20363-12788/.minikube/profiles/old-k8s-version-191773/config.json: {Name:mkd389f8141f413ff5ed61ed7f2339fe6ed23959 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0205 03:11:40.741936 60782 start.go:360] acquireMachinesLock for old-k8s-version-191773: {Name:mka859d8706e94e04a549fcebb98cdac86bfe5a9 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0205 03:11:40.741963 60782 start.go:364] duration metric: took 14.094µs to acquireMachinesLock for "old-k8s-version-191773"
I0205 03:11:40.741977 60782 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-191773 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-versi
on-191773 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMir
ror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0205 03:11:40.742032 60782 start.go:125] createHost starting for "" (driver="kvm2")
I0205 03:11:40.743419 60782 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0205 03:11:40.743555 60782 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0205 03:11:40.743595 60782 main.go:141] libmachine: Launching plugin server for driver kvm2
I0205 03:11:40.758033 60782 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42229
I0205 03:11:40.758517 60782 main.go:141] libmachine: () Calling .GetVersion
I0205 03:11:40.759062 60782 main.go:141] libmachine: Using API Version 1
I0205 03:11:40.759082 60782 main.go:141] libmachine: () Calling .SetConfigRaw
I0205 03:11:40.759446 60782 main.go:141] libmachine: () Calling .GetMachineName
I0205 03:11:40.759644 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetMachineName
I0205 03:11:40.759838 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .DriverName
I0205 03:11:40.759997 60782 start.go:159] libmachine.API.Create for "old-k8s-version-191773" (driver="kvm2")
I0205 03:11:40.760024 60782 client.go:168] LocalClient.Create starting
I0205 03:11:40.760054 60782 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20363-12788/.minikube/certs/ca.pem
I0205 03:11:40.760090 60782 main.go:141] libmachine: Decoding PEM data...
I0205 03:11:40.760106 60782 main.go:141] libmachine: Parsing certificate...
I0205 03:11:40.760164 60782 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20363-12788/.minikube/certs/cert.pem
I0205 03:11:40.760183 60782 main.go:141] libmachine: Decoding PEM data...
I0205 03:11:40.760206 60782 main.go:141] libmachine: Parsing certificate...
I0205 03:11:40.760221 60782 main.go:141] libmachine: Running pre-create checks...
I0205 03:11:40.760234 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .PreCreateCheck
I0205 03:11:40.760551 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetConfigRaw
I0205 03:11:40.760907 60782 main.go:141] libmachine: Creating machine...
I0205 03:11:40.760919 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .Create
I0205 03:11:40.761072 60782 main.go:141] libmachine: (old-k8s-version-191773) creating KVM machine...
I0205 03:11:40.761087 60782 main.go:141] libmachine: (old-k8s-version-191773) creating network...
I0205 03:11:40.762310 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | found existing default KVM network
I0205 03:11:40.764055 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | I0205 03:11:40.763889 60805 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0001157f0}
I0205 03:11:40.764093 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | created network xml:
I0205 03:11:40.764109 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | <network>
I0205 03:11:40.764125 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | <name>mk-old-k8s-version-191773</name>
I0205 03:11:40.764140 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | <dns enable='no'/>
I0205 03:11:40.764153 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG |
I0205 03:11:40.764166 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | <ip address='192.168.39.1' netmask='255.255.255.0'>
I0205 03:11:40.764179 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | <dhcp>
I0205 03:11:40.764202 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | <range start='192.168.39.2' end='192.168.39.253'/>
I0205 03:11:40.764216 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | </dhcp>
I0205 03:11:40.764226 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | </ip>
I0205 03:11:40.764245 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG |
I0205 03:11:40.764255 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | </network>
I0205 03:11:40.764286 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG |
I0205 03:11:40.769522 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | trying to create private KVM network mk-old-k8s-version-191773 192.168.39.0/24...
I0205 03:11:40.840387 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | private KVM network mk-old-k8s-version-191773 192.168.39.0/24 created
I0205 03:11:40.840508 60782 main.go:141] libmachine: (old-k8s-version-191773) setting up store path in /home/jenkins/minikube-integration/20363-12788/.minikube/machines/old-k8s-version-191773 ...
I0205 03:11:40.840531 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | I0205 03:11:40.840343 60805 common.go:144] Making disk image using store path: /home/jenkins/minikube-integration/20363-12788/.minikube
I0205 03:11:40.840551 60782 main.go:141] libmachine: (old-k8s-version-191773) building disk image from file:///home/jenkins/minikube-integration/20363-12788/.minikube/cache/iso/amd64/minikube-v1.35.0-amd64.iso
I0205 03:11:40.840580 60782 main.go:141] libmachine: (old-k8s-version-191773) Downloading /home/jenkins/minikube-integration/20363-12788/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/20363-12788/.minikube/cache/iso/amd64/minikube-v1.35.0-amd64.iso...
I0205 03:11:41.093421 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | I0205 03:11:41.093262 60805 common.go:151] Creating ssh key: /home/jenkins/minikube-integration/20363-12788/.minikube/machines/old-k8s-version-191773/id_rsa...
I0205 03:11:41.231703 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | I0205 03:11:41.231590 60805 common.go:157] Creating raw disk image: /home/jenkins/minikube-integration/20363-12788/.minikube/machines/old-k8s-version-191773/old-k8s-version-191773.rawdisk...
I0205 03:11:41.231738 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | Writing magic tar header
I0205 03:11:41.231754 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | Writing SSH key tar header
I0205 03:11:41.231772 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | I0205 03:11:41.231731 60805 common.go:171] Fixing permissions on /home/jenkins/minikube-integration/20363-12788/.minikube/machines/old-k8s-version-191773 ...
I0205 03:11:41.231904 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20363-12788/.minikube/machines/old-k8s-version-191773
I0205 03:11:41.231939 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20363-12788/.minikube/machines
I0205 03:11:41.231955 60782 main.go:141] libmachine: (old-k8s-version-191773) setting executable bit set on /home/jenkins/minikube-integration/20363-12788/.minikube/machines/old-k8s-version-191773 (perms=drwx------)
I0205 03:11:41.231984 60782 main.go:141] libmachine: (old-k8s-version-191773) setting executable bit set on /home/jenkins/minikube-integration/20363-12788/.minikube/machines (perms=drwxr-xr-x)
I0205 03:11:41.231990 60782 main.go:141] libmachine: (old-k8s-version-191773) setting executable bit set on /home/jenkins/minikube-integration/20363-12788/.minikube (perms=drwxr-xr-x)
I0205 03:11:41.232004 60782 main.go:141] libmachine: (old-k8s-version-191773) setting executable bit set on /home/jenkins/minikube-integration/20363-12788 (perms=drwxrwxr-x)
I0205 03:11:41.232019 60782 main.go:141] libmachine: (old-k8s-version-191773) setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0205 03:11:41.232031 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20363-12788/.minikube
I0205 03:11:41.232044 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20363-12788
I0205 03:11:41.232057 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | checking permissions on dir: /home/jenkins/minikube-integration
I0205 03:11:41.232064 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | checking permissions on dir: /home/jenkins
I0205 03:11:41.232071 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | checking permissions on dir: /home
I0205 03:11:41.232095 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | skipping /home - not owner
I0205 03:11:41.232112 60782 main.go:141] libmachine: (old-k8s-version-191773) setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0205 03:11:41.232124 60782 main.go:141] libmachine: (old-k8s-version-191773) creating domain...
I0205 03:11:41.233250 60782 main.go:141] libmachine: (old-k8s-version-191773) define libvirt domain using xml:
I0205 03:11:41.233270 60782 main.go:141] libmachine: (old-k8s-version-191773) <domain type='kvm'>
I0205 03:11:41.233277 60782 main.go:141] libmachine: (old-k8s-version-191773) <name>old-k8s-version-191773</name>
I0205 03:11:41.233282 60782 main.go:141] libmachine: (old-k8s-version-191773) <memory unit='MiB'>2200</memory>
I0205 03:11:41.233288 60782 main.go:141] libmachine: (old-k8s-version-191773) <vcpu>2</vcpu>
I0205 03:11:41.233292 60782 main.go:141] libmachine: (old-k8s-version-191773) <features>
I0205 03:11:41.233297 60782 main.go:141] libmachine: (old-k8s-version-191773) <acpi/>
I0205 03:11:41.233301 60782 main.go:141] libmachine: (old-k8s-version-191773) <apic/>
I0205 03:11:41.233313 60782 main.go:141] libmachine: (old-k8s-version-191773) <pae/>
I0205 03:11:41.233320 60782 main.go:141] libmachine: (old-k8s-version-191773)
I0205 03:11:41.233324 60782 main.go:141] libmachine: (old-k8s-version-191773) </features>
I0205 03:11:41.233332 60782 main.go:141] libmachine: (old-k8s-version-191773) <cpu mode='host-passthrough'>
I0205 03:11:41.233350 60782 main.go:141] libmachine: (old-k8s-version-191773)
I0205 03:11:41.233355 60782 main.go:141] libmachine: (old-k8s-version-191773) </cpu>
I0205 03:11:41.233381 60782 main.go:141] libmachine: (old-k8s-version-191773) <os>
I0205 03:11:41.233410 60782 main.go:141] libmachine: (old-k8s-version-191773) <type>hvm</type>
I0205 03:11:41.233419 60782 main.go:141] libmachine: (old-k8s-version-191773) <boot dev='cdrom'/>
I0205 03:11:41.233427 60782 main.go:141] libmachine: (old-k8s-version-191773) <boot dev='hd'/>
I0205 03:11:41.233457 60782 main.go:141] libmachine: (old-k8s-version-191773) <bootmenu enable='no'/>
I0205 03:11:41.233485 60782 main.go:141] libmachine: (old-k8s-version-191773) </os>
I0205 03:11:41.233497 60782 main.go:141] libmachine: (old-k8s-version-191773) <devices>
I0205 03:11:41.233509 60782 main.go:141] libmachine: (old-k8s-version-191773) <disk type='file' device='cdrom'>
I0205 03:11:41.233521 60782 main.go:141] libmachine: (old-k8s-version-191773) <source file='/home/jenkins/minikube-integration/20363-12788/.minikube/machines/old-k8s-version-191773/boot2docker.iso'/>
I0205 03:11:41.233531 60782 main.go:141] libmachine: (old-k8s-version-191773) <target dev='hdc' bus='scsi'/>
I0205 03:11:41.233539 60782 main.go:141] libmachine: (old-k8s-version-191773) <readonly/>
I0205 03:11:41.233548 60782 main.go:141] libmachine: (old-k8s-version-191773) </disk>
I0205 03:11:41.233557 60782 main.go:141] libmachine: (old-k8s-version-191773) <disk type='file' device='disk'>
I0205 03:11:41.233581 60782 main.go:141] libmachine: (old-k8s-version-191773) <driver name='qemu' type='raw' cache='default' io='threads' />
I0205 03:11:41.233595 60782 main.go:141] libmachine: (old-k8s-version-191773) <source file='/home/jenkins/minikube-integration/20363-12788/.minikube/machines/old-k8s-version-191773/old-k8s-version-191773.rawdisk'/>
I0205 03:11:41.233602 60782 main.go:141] libmachine: (old-k8s-version-191773) <target dev='hda' bus='virtio'/>
I0205 03:11:41.233615 60782 main.go:141] libmachine: (old-k8s-version-191773) </disk>
I0205 03:11:41.233623 60782 main.go:141] libmachine: (old-k8s-version-191773) <interface type='network'>
I0205 03:11:41.233630 60782 main.go:141] libmachine: (old-k8s-version-191773) <source network='mk-old-k8s-version-191773'/>
I0205 03:11:41.233641 60782 main.go:141] libmachine: (old-k8s-version-191773) <model type='virtio'/>
I0205 03:11:41.233650 60782 main.go:141] libmachine: (old-k8s-version-191773) </interface>
I0205 03:11:41.233664 60782 main.go:141] libmachine: (old-k8s-version-191773) <interface type='network'>
I0205 03:11:41.233688 60782 main.go:141] libmachine: (old-k8s-version-191773) <source network='default'/>
I0205 03:11:41.233706 60782 main.go:141] libmachine: (old-k8s-version-191773) <model type='virtio'/>
I0205 03:11:41.233718 60782 main.go:141] libmachine: (old-k8s-version-191773) </interface>
I0205 03:11:41.233726 60782 main.go:141] libmachine: (old-k8s-version-191773) <serial type='pty'>
I0205 03:11:41.233734 60782 main.go:141] libmachine: (old-k8s-version-191773) <target port='0'/>
I0205 03:11:41.233739 60782 main.go:141] libmachine: (old-k8s-version-191773) </serial>
I0205 03:11:41.233747 60782 main.go:141] libmachine: (old-k8s-version-191773) <console type='pty'>
I0205 03:11:41.233752 60782 main.go:141] libmachine: (old-k8s-version-191773) <target type='serial' port='0'/>
I0205 03:11:41.233760 60782 main.go:141] libmachine: (old-k8s-version-191773) </console>
I0205 03:11:41.233765 60782 main.go:141] libmachine: (old-k8s-version-191773) <rng model='virtio'>
I0205 03:11:41.233781 60782 main.go:141] libmachine: (old-k8s-version-191773) <backend model='random'>/dev/random</backend>
I0205 03:11:41.233791 60782 main.go:141] libmachine: (old-k8s-version-191773) </rng>
I0205 03:11:41.233811 60782 main.go:141] libmachine: (old-k8s-version-191773)
I0205 03:11:41.233829 60782 main.go:141] libmachine: (old-k8s-version-191773)
I0205 03:11:41.233841 60782 main.go:141] libmachine: (old-k8s-version-191773) </devices>
I0205 03:11:41.233865 60782 main.go:141] libmachine: (old-k8s-version-191773) </domain>
I0205 03:11:41.233879 60782 main.go:141] libmachine: (old-k8s-version-191773)
I0205 03:11:41.238314 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has defined MAC address 52:54:00:f9:b3:7f in network default
I0205 03:11:41.238833 60782 main.go:141] libmachine: (old-k8s-version-191773) starting domain...
I0205 03:11:41.238848 60782 main.go:141] libmachine: (old-k8s-version-191773) ensuring networks are active...
I0205 03:11:41.238861 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has defined MAC address 52:54:00:87:fe:dd in network mk-old-k8s-version-191773
I0205 03:11:41.239577 60782 main.go:141] libmachine: (old-k8s-version-191773) Ensuring network default is active
I0205 03:11:41.239960 60782 main.go:141] libmachine: (old-k8s-version-191773) Ensuring network mk-old-k8s-version-191773 is active
I0205 03:11:41.240542 60782 main.go:141] libmachine: (old-k8s-version-191773) getting domain XML...
I0205 03:11:41.241275 60782 main.go:141] libmachine: (old-k8s-version-191773) creating domain...
I0205 03:11:42.475404 60782 main.go:141] libmachine: (old-k8s-version-191773) waiting for IP...
I0205 03:11:42.476394 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has defined MAC address 52:54:00:87:fe:dd in network mk-old-k8s-version-191773
I0205 03:11:42.476908 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | unable to find current IP address of domain old-k8s-version-191773 in network mk-old-k8s-version-191773
I0205 03:11:42.476981 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | I0205 03:11:42.476912 60805 retry.go:31] will retry after 196.482731ms: waiting for domain to come up
I0205 03:11:42.675369 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has defined MAC address 52:54:00:87:fe:dd in network mk-old-k8s-version-191773
I0205 03:11:42.675832 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | unable to find current IP address of domain old-k8s-version-191773 in network mk-old-k8s-version-191773
I0205 03:11:42.675858 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | I0205 03:11:42.675798 60805 retry.go:31] will retry after 271.826905ms: waiting for domain to come up
I0205 03:11:42.949236 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has defined MAC address 52:54:00:87:fe:dd in network mk-old-k8s-version-191773
I0205 03:11:42.949724 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | unable to find current IP address of domain old-k8s-version-191773 in network mk-old-k8s-version-191773
I0205 03:11:42.949750 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | I0205 03:11:42.949681 60805 retry.go:31] will retry after 297.751701ms: waiting for domain to come up
I0205 03:11:43.249228 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has defined MAC address 52:54:00:87:fe:dd in network mk-old-k8s-version-191773
I0205 03:11:43.249685 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | unable to find current IP address of domain old-k8s-version-191773 in network mk-old-k8s-version-191773
I0205 03:11:43.249751 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | I0205 03:11:43.249676 60805 retry.go:31] will retry after 467.173579ms: waiting for domain to come up
I0205 03:11:43.717992 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has defined MAC address 52:54:00:87:fe:dd in network mk-old-k8s-version-191773
I0205 03:11:43.718510 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | unable to find current IP address of domain old-k8s-version-191773 in network mk-old-k8s-version-191773
I0205 03:11:43.718537 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | I0205 03:11:43.718480 60805 retry.go:31] will retry after 762.823451ms: waiting for domain to come up
I0205 03:11:44.482442 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has defined MAC address 52:54:00:87:fe:dd in network mk-old-k8s-version-191773
I0205 03:11:44.482956 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | unable to find current IP address of domain old-k8s-version-191773 in network mk-old-k8s-version-191773
I0205 03:11:44.482997 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | I0205 03:11:44.482942 60805 retry.go:31] will retry after 659.833499ms: waiting for domain to come up
I0205 03:11:45.144837 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has defined MAC address 52:54:00:87:fe:dd in network mk-old-k8s-version-191773
I0205 03:11:45.145276 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | unable to find current IP address of domain old-k8s-version-191773 in network mk-old-k8s-version-191773
I0205 03:11:45.145303 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | I0205 03:11:45.145242 60805 retry.go:31] will retry after 1.026080572s: waiting for domain to come up
I0205 03:11:46.172529 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has defined MAC address 52:54:00:87:fe:dd in network mk-old-k8s-version-191773
I0205 03:11:46.172952 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | unable to find current IP address of domain old-k8s-version-191773 in network mk-old-k8s-version-191773
I0205 03:11:46.172979 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | I0205 03:11:46.172912 60805 retry.go:31] will retry after 1.292954846s: waiting for domain to come up
I0205 03:11:47.467651 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has defined MAC address 52:54:00:87:fe:dd in network mk-old-k8s-version-191773
I0205 03:11:47.468100 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | unable to find current IP address of domain old-k8s-version-191773 in network mk-old-k8s-version-191773
I0205 03:11:47.468130 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | I0205 03:11:47.468061 60805 retry.go:31] will retry after 1.379560684s: waiting for domain to come up
I0205 03:11:48.849673 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has defined MAC address 52:54:00:87:fe:dd in network mk-old-k8s-version-191773
I0205 03:11:48.850181 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | unable to find current IP address of domain old-k8s-version-191773 in network mk-old-k8s-version-191773
I0205 03:11:48.850213 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | I0205 03:11:48.850137 60805 retry.go:31] will retry after 1.638893449s: waiting for domain to come up
I0205 03:11:50.491249 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has defined MAC address 52:54:00:87:fe:dd in network mk-old-k8s-version-191773
I0205 03:11:50.491896 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | unable to find current IP address of domain old-k8s-version-191773 in network mk-old-k8s-version-191773
I0205 03:11:50.491975 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | I0205 03:11:50.491876 60805 retry.go:31] will retry after 1.889793749s: waiting for domain to come up
I0205 03:11:52.383103 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has defined MAC address 52:54:00:87:fe:dd in network mk-old-k8s-version-191773
I0205 03:11:52.383707 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | unable to find current IP address of domain old-k8s-version-191773 in network mk-old-k8s-version-191773
I0205 03:11:52.383755 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | I0205 03:11:52.383683 60805 retry.go:31] will retry after 2.796178827s: waiting for domain to come up
I0205 03:11:55.183542 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has defined MAC address 52:54:00:87:fe:dd in network mk-old-k8s-version-191773
I0205 03:11:55.183984 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | unable to find current IP address of domain old-k8s-version-191773 in network mk-old-k8s-version-191773
I0205 03:11:55.184015 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | I0205 03:11:55.183957 60805 retry.go:31] will retry after 3.303291267s: waiting for domain to come up
I0205 03:11:58.490824 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has defined MAC address 52:54:00:87:fe:dd in network mk-old-k8s-version-191773
I0205 03:11:58.491300 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | unable to find current IP address of domain old-k8s-version-191773 in network mk-old-k8s-version-191773
I0205 03:11:58.491326 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | I0205 03:11:58.491262 60805 retry.go:31] will retry after 4.650233729s: waiting for domain to come up
I0205 03:12:03.143388 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has defined MAC address 52:54:00:87:fe:dd in network mk-old-k8s-version-191773
I0205 03:12:03.143813 60782 main.go:141] libmachine: (old-k8s-version-191773) found domain IP: 192.168.39.74
I0205 03:12:03.143838 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has current primary IP address 192.168.39.74 and MAC address 52:54:00:87:fe:dd in network mk-old-k8s-version-191773
I0205 03:12:03.143846 60782 main.go:141] libmachine: (old-k8s-version-191773) reserving static IP address...
I0205 03:12:03.144201 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-191773", mac: "52:54:00:87:fe:dd", ip: "192.168.39.74"} in network mk-old-k8s-version-191773
I0205 03:12:03.222721 60782 main.go:141] libmachine: (old-k8s-version-191773) reserved static IP address 192.168.39.74 for domain old-k8s-version-191773
I0205 03:12:03.222782 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | Getting to WaitForSSH function...
I0205 03:12:03.222793 60782 main.go:141] libmachine: (old-k8s-version-191773) waiting for SSH...
I0205 03:12:03.225675 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has defined MAC address 52:54:00:87:fe:dd in network mk-old-k8s-version-191773
I0205 03:12:03.226078 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:87:fe:dd", ip: ""} in network mk-old-k8s-version-191773: {Iface:virbr2 ExpiryTime:2025-02-05 04:11:55 +0000 UTC Type:0 Mac:52:54:00:87:fe:dd Iaid: IPaddr:192.168.39.74 Prefix:24 Hostname:minikube Clientid:01:52:54:00:87:fe:dd}
I0205 03:12:03.226119 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has defined IP address 192.168.39.74 and MAC address 52:54:00:87:fe:dd in network mk-old-k8s-version-191773
I0205 03:12:03.226290 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | Using SSH client type: external
I0205 03:12:03.226319 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | Using SSH private key: /home/jenkins/minikube-integration/20363-12788/.minikube/machines/old-k8s-version-191773/id_rsa (-rw-------)
I0205 03:12:03.226359 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.74 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/20363-12788/.minikube/machines/old-k8s-version-191773/id_rsa -p 22] /usr/bin/ssh <nil>}
I0205 03:12:03.226394 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | About to run SSH command:
I0205 03:12:03.226417 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | exit 0
I0205 03:12:03.353425 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | SSH cmd err, output: <nil>:
I0205 03:12:03.353723 60782 main.go:141] libmachine: (old-k8s-version-191773) KVM machine creation complete
I0205 03:12:03.354024 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetConfigRaw
I0205 03:12:03.354623 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .DriverName
I0205 03:12:03.354834 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .DriverName
I0205 03:12:03.355035 60782 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0205 03:12:03.355049 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetState
I0205 03:12:03.356449 60782 main.go:141] libmachine: Detecting operating system of created instance...
I0205 03:12:03.356467 60782 main.go:141] libmachine: Waiting for SSH to be available...
I0205 03:12:03.356475 60782 main.go:141] libmachine: Getting to WaitForSSH function...
I0205 03:12:03.356483 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetSSHHostname
I0205 03:12:03.359073 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has defined MAC address 52:54:00:87:fe:dd in network mk-old-k8s-version-191773
I0205 03:12:03.359540 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:87:fe:dd", ip: ""} in network mk-old-k8s-version-191773: {Iface:virbr2 ExpiryTime:2025-02-05 04:11:55 +0000 UTC Type:0 Mac:52:54:00:87:fe:dd Iaid: IPaddr:192.168.39.74 Prefix:24 Hostname:old-k8s-version-191773 Clientid:01:52:54:00:87:fe:dd}
I0205 03:12:03.359569 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has defined IP address 192.168.39.74 and MAC address 52:54:00:87:fe:dd in network mk-old-k8s-version-191773
I0205 03:12:03.359687 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetSSHPort
I0205 03:12:03.359877 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetSSHKeyPath
I0205 03:12:03.360049 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetSSHKeyPath
I0205 03:12:03.360213 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetSSHUsername
I0205 03:12:03.360405 60782 main.go:141] libmachine: Using SSH client type: native
I0205 03:12:03.360662 60782 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x865a00] 0x8686e0 <nil> [] 0s} 192.168.39.74 22 <nil> <nil>}
I0205 03:12:03.360679 60782 main.go:141] libmachine: About to run SSH command:
exit 0
I0205 03:12:03.472737 60782 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0205 03:12:03.472766 60782 main.go:141] libmachine: Detecting the provisioner...
I0205 03:12:03.472776 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetSSHHostname
I0205 03:12:03.475945 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has defined MAC address 52:54:00:87:fe:dd in network mk-old-k8s-version-191773
I0205 03:12:03.476311 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:87:fe:dd", ip: ""} in network mk-old-k8s-version-191773: {Iface:virbr2 ExpiryTime:2025-02-05 04:11:55 +0000 UTC Type:0 Mac:52:54:00:87:fe:dd Iaid: IPaddr:192.168.39.74 Prefix:24 Hostname:old-k8s-version-191773 Clientid:01:52:54:00:87:fe:dd}
I0205 03:12:03.476358 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has defined IP address 192.168.39.74 and MAC address 52:54:00:87:fe:dd in network mk-old-k8s-version-191773
I0205 03:12:03.476543 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetSSHPort
I0205 03:12:03.476713 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetSSHKeyPath
I0205 03:12:03.476880 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetSSHKeyPath
I0205 03:12:03.476998 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetSSHUsername
I0205 03:12:03.477132 60782 main.go:141] libmachine: Using SSH client type: native
I0205 03:12:03.477312 60782 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x865a00] 0x8686e0 <nil> [] 0s} 192.168.39.74 22 <nil> <nil>}
I0205 03:12:03.477322 60782 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0205 03:12:03.590041 60782 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0205 03:12:03.590123 60782 main.go:141] libmachine: found compatible host: buildroot
I0205 03:12:03.590155 60782 main.go:141] libmachine: Provisioning with buildroot...
I0205 03:12:03.590166 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetMachineName
I0205 03:12:03.590415 60782 buildroot.go:166] provisioning hostname "old-k8s-version-191773"
I0205 03:12:03.590446 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetMachineName
I0205 03:12:03.590634 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetSSHHostname
I0205 03:12:03.593191 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has defined MAC address 52:54:00:87:fe:dd in network mk-old-k8s-version-191773
I0205 03:12:03.593513 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:87:fe:dd", ip: ""} in network mk-old-k8s-version-191773: {Iface:virbr2 ExpiryTime:2025-02-05 04:11:55 +0000 UTC Type:0 Mac:52:54:00:87:fe:dd Iaid: IPaddr:192.168.39.74 Prefix:24 Hostname:old-k8s-version-191773 Clientid:01:52:54:00:87:fe:dd}
I0205 03:12:03.593550 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has defined IP address 192.168.39.74 and MAC address 52:54:00:87:fe:dd in network mk-old-k8s-version-191773
I0205 03:12:03.593722 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetSSHPort
I0205 03:12:03.593896 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetSSHKeyPath
I0205 03:12:03.594033 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetSSHKeyPath
I0205 03:12:03.594204 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetSSHUsername
I0205 03:12:03.594381 60782 main.go:141] libmachine: Using SSH client type: native
I0205 03:12:03.594569 60782 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x865a00] 0x8686e0 <nil> [] 0s} 192.168.39.74 22 <nil> <nil>}
I0205 03:12:03.594586 60782 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-191773 && echo "old-k8s-version-191773" | sudo tee /etc/hostname
I0205 03:12:03.725290 60782 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-191773
I0205 03:12:03.725319 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetSSHHostname
I0205 03:12:03.728056 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has defined MAC address 52:54:00:87:fe:dd in network mk-old-k8s-version-191773
I0205 03:12:03.728455 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:87:fe:dd", ip: ""} in network mk-old-k8s-version-191773: {Iface:virbr2 ExpiryTime:2025-02-05 04:11:55 +0000 UTC Type:0 Mac:52:54:00:87:fe:dd Iaid: IPaddr:192.168.39.74 Prefix:24 Hostname:old-k8s-version-191773 Clientid:01:52:54:00:87:fe:dd}
I0205 03:12:03.728488 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has defined IP address 192.168.39.74 and MAC address 52:54:00:87:fe:dd in network mk-old-k8s-version-191773
I0205 03:12:03.728662 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetSSHPort
I0205 03:12:03.728841 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetSSHKeyPath
I0205 03:12:03.729027 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetSSHKeyPath
I0205 03:12:03.729161 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetSSHUsername
I0205 03:12:03.729282 60782 main.go:141] libmachine: Using SSH client type: native
I0205 03:12:03.729486 60782 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x865a00] 0x8686e0 <nil> [] 0s} 192.168.39.74 22 <nil> <nil>}
I0205 03:12:03.729504 60782 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-191773' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-191773/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-191773' | sudo tee -a /etc/hosts;
fi
fi
I0205 03:12:03.846524 60782 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0205 03:12:03.846552 60782 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/20363-12788/.minikube CaCertPath:/home/jenkins/minikube-integration/20363-12788/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20363-12788/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20363-12788/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20363-12788/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20363-12788/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20363-12788/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20363-12788/.minikube}
I0205 03:12:03.846568 60782 buildroot.go:174] setting up certificates
I0205 03:12:03.846578 60782 provision.go:84] configureAuth start
I0205 03:12:03.846586 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetMachineName
I0205 03:12:03.846862 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetIP
I0205 03:12:03.849675 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has defined MAC address 52:54:00:87:fe:dd in network mk-old-k8s-version-191773
I0205 03:12:03.850051 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:87:fe:dd", ip: ""} in network mk-old-k8s-version-191773: {Iface:virbr2 ExpiryTime:2025-02-05 04:11:55 +0000 UTC Type:0 Mac:52:54:00:87:fe:dd Iaid: IPaddr:192.168.39.74 Prefix:24 Hostname:old-k8s-version-191773 Clientid:01:52:54:00:87:fe:dd}
I0205 03:12:03.850074 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has defined IP address 192.168.39.74 and MAC address 52:54:00:87:fe:dd in network mk-old-k8s-version-191773
I0205 03:12:03.850242 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetSSHHostname
I0205 03:12:03.852591 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has defined MAC address 52:54:00:87:fe:dd in network mk-old-k8s-version-191773
I0205 03:12:03.852930 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:87:fe:dd", ip: ""} in network mk-old-k8s-version-191773: {Iface:virbr2 ExpiryTime:2025-02-05 04:11:55 +0000 UTC Type:0 Mac:52:54:00:87:fe:dd Iaid: IPaddr:192.168.39.74 Prefix:24 Hostname:old-k8s-version-191773 Clientid:01:52:54:00:87:fe:dd}
I0205 03:12:03.852960 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has defined IP address 192.168.39.74 and MAC address 52:54:00:87:fe:dd in network mk-old-k8s-version-191773
I0205 03:12:03.853114 60782 provision.go:143] copyHostCerts
I0205 03:12:03.853193 60782 exec_runner.go:144] found /home/jenkins/minikube-integration/20363-12788/.minikube/key.pem, removing ...
I0205 03:12:03.853210 60782 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20363-12788/.minikube/key.pem
I0205 03:12:03.853302 60782 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20363-12788/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20363-12788/.minikube/key.pem (1675 bytes)
I0205 03:12:03.853462 60782 exec_runner.go:144] found /home/jenkins/minikube-integration/20363-12788/.minikube/ca.pem, removing ...
I0205 03:12:03.853480 60782 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20363-12788/.minikube/ca.pem
I0205 03:12:03.853522 60782 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20363-12788/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20363-12788/.minikube/ca.pem (1082 bytes)
I0205 03:12:03.853613 60782 exec_runner.go:144] found /home/jenkins/minikube-integration/20363-12788/.minikube/cert.pem, removing ...
I0205 03:12:03.853622 60782 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20363-12788/.minikube/cert.pem
I0205 03:12:03.853656 60782 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20363-12788/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20363-12788/.minikube/cert.pem (1123 bytes)
I0205 03:12:03.853738 60782 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20363-12788/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20363-12788/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20363-12788/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-191773 san=[127.0.0.1 192.168.39.74 localhost minikube old-k8s-version-191773]
I0205 03:12:04.112400 60782 provision.go:177] copyRemoteCerts
I0205 03:12:04.112464 60782 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0205 03:12:04.112486 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetSSHHostname
I0205 03:12:04.115099 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has defined MAC address 52:54:00:87:fe:dd in network mk-old-k8s-version-191773
I0205 03:12:04.115516 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:87:fe:dd", ip: ""} in network mk-old-k8s-version-191773: {Iface:virbr2 ExpiryTime:2025-02-05 04:11:55 +0000 UTC Type:0 Mac:52:54:00:87:fe:dd Iaid: IPaddr:192.168.39.74 Prefix:24 Hostname:old-k8s-version-191773 Clientid:01:52:54:00:87:fe:dd}
I0205 03:12:04.115552 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has defined IP address 192.168.39.74 and MAC address 52:54:00:87:fe:dd in network mk-old-k8s-version-191773
I0205 03:12:04.115744 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetSSHPort
I0205 03:12:04.115931 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetSSHKeyPath
I0205 03:12:04.116086 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetSSHUsername
I0205 03:12:04.116217 60782 sshutil.go:53] new ssh client: &{IP:192.168.39.74 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20363-12788/.minikube/machines/old-k8s-version-191773/id_rsa Username:docker}
I0205 03:12:04.199570 60782 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20363-12788/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0205 03:12:04.224335 60782 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20363-12788/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0205 03:12:04.248575 60782 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20363-12788/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0205 03:12:04.272735 60782 provision.go:87] duration metric: took 426.141685ms to configureAuth
I0205 03:12:04.272770 60782 buildroot.go:189] setting minikube options for container-runtime
I0205 03:12:04.273005 60782 config.go:182] Loaded profile config "old-k8s-version-191773": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0205 03:12:04.273107 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetSSHHostname
I0205 03:12:04.275813 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has defined MAC address 52:54:00:87:fe:dd in network mk-old-k8s-version-191773
I0205 03:12:04.276187 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:87:fe:dd", ip: ""} in network mk-old-k8s-version-191773: {Iface:virbr2 ExpiryTime:2025-02-05 04:11:55 +0000 UTC Type:0 Mac:52:54:00:87:fe:dd Iaid: IPaddr:192.168.39.74 Prefix:24 Hostname:old-k8s-version-191773 Clientid:01:52:54:00:87:fe:dd}
I0205 03:12:04.276220 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has defined IP address 192.168.39.74 and MAC address 52:54:00:87:fe:dd in network mk-old-k8s-version-191773
I0205 03:12:04.276396 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetSSHPort
I0205 03:12:04.276566 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetSSHKeyPath
I0205 03:12:04.276737 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetSSHKeyPath
I0205 03:12:04.276905 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetSSHUsername
I0205 03:12:04.277093 60782 main.go:141] libmachine: Using SSH client type: native
I0205 03:12:04.277325 60782 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x865a00] 0x8686e0 <nil> [] 0s} 192.168.39.74 22 <nil> <nil>}
I0205 03:12:04.277361 60782 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0205 03:12:04.531262 60782 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0205 03:12:04.531289 60782 main.go:141] libmachine: Checking connection to Docker...
I0205 03:12:04.531298 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetURL
I0205 03:12:04.532694 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | using libvirt version 6000000
I0205 03:12:04.534913 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has defined MAC address 52:54:00:87:fe:dd in network mk-old-k8s-version-191773
I0205 03:12:04.535241 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:87:fe:dd", ip: ""} in network mk-old-k8s-version-191773: {Iface:virbr2 ExpiryTime:2025-02-05 04:11:55 +0000 UTC Type:0 Mac:52:54:00:87:fe:dd Iaid: IPaddr:192.168.39.74 Prefix:24 Hostname:old-k8s-version-191773 Clientid:01:52:54:00:87:fe:dd}
I0205 03:12:04.535276 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has defined IP address 192.168.39.74 and MAC address 52:54:00:87:fe:dd in network mk-old-k8s-version-191773
I0205 03:12:04.535497 60782 main.go:141] libmachine: Docker is up and running!
I0205 03:12:04.535513 60782 main.go:141] libmachine: Reticulating splines...
I0205 03:12:04.535521 60782 client.go:171] duration metric: took 23.775490638s to LocalClient.Create
I0205 03:12:04.535548 60782 start.go:167] duration metric: took 23.77554908s to libmachine.API.Create "old-k8s-version-191773"
I0205 03:12:04.535561 60782 start.go:293] postStartSetup for "old-k8s-version-191773" (driver="kvm2")
I0205 03:12:04.535574 60782 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0205 03:12:04.535598 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .DriverName
I0205 03:12:04.535874 60782 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0205 03:12:04.535902 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetSSHHostname
I0205 03:12:04.538437 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has defined MAC address 52:54:00:87:fe:dd in network mk-old-k8s-version-191773
I0205 03:12:04.538857 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:87:fe:dd", ip: ""} in network mk-old-k8s-version-191773: {Iface:virbr2 ExpiryTime:2025-02-05 04:11:55 +0000 UTC Type:0 Mac:52:54:00:87:fe:dd Iaid: IPaddr:192.168.39.74 Prefix:24 Hostname:old-k8s-version-191773 Clientid:01:52:54:00:87:fe:dd}
I0205 03:12:04.538887 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has defined IP address 192.168.39.74 and MAC address 52:54:00:87:fe:dd in network mk-old-k8s-version-191773
I0205 03:12:04.539071 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetSSHPort
I0205 03:12:04.539253 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetSSHKeyPath
I0205 03:12:04.539420 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetSSHUsername
I0205 03:12:04.539554 60782 sshutil.go:53] new ssh client: &{IP:192.168.39.74 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20363-12788/.minikube/machines/old-k8s-version-191773/id_rsa Username:docker}
I0205 03:12:04.625531 60782 ssh_runner.go:195] Run: cat /etc/os-release
I0205 03:12:04.629911 60782 info.go:137] Remote host: Buildroot 2023.02.9
I0205 03:12:04.629937 60782 filesync.go:126] Scanning /home/jenkins/minikube-integration/20363-12788/.minikube/addons for local assets ...
I0205 03:12:04.630012 60782 filesync.go:126] Scanning /home/jenkins/minikube-integration/20363-12788/.minikube/files for local assets ...
I0205 03:12:04.630137 60782 filesync.go:149] local asset: /home/jenkins/minikube-integration/20363-12788/.minikube/files/etc/ssl/certs/199892.pem -> 199892.pem in /etc/ssl/certs
I0205 03:12:04.630246 60782 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0205 03:12:04.640318 60782 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20363-12788/.minikube/files/etc/ssl/certs/199892.pem --> /etc/ssl/certs/199892.pem (1708 bytes)
I0205 03:12:04.668366 60782 start.go:296] duration metric: took 132.790893ms for postStartSetup
I0205 03:12:04.668451 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetConfigRaw
I0205 03:12:04.669067 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetIP
I0205 03:12:04.671547 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has defined MAC address 52:54:00:87:fe:dd in network mk-old-k8s-version-191773
I0205 03:12:04.671964 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:87:fe:dd", ip: ""} in network mk-old-k8s-version-191773: {Iface:virbr2 ExpiryTime:2025-02-05 04:11:55 +0000 UTC Type:0 Mac:52:54:00:87:fe:dd Iaid: IPaddr:192.168.39.74 Prefix:24 Hostname:old-k8s-version-191773 Clientid:01:52:54:00:87:fe:dd}
I0205 03:12:04.671996 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has defined IP address 192.168.39.74 and MAC address 52:54:00:87:fe:dd in network mk-old-k8s-version-191773
I0205 03:12:04.672233 60782 profile.go:143] Saving config to /home/jenkins/minikube-integration/20363-12788/.minikube/profiles/old-k8s-version-191773/config.json ...
I0205 03:12:04.672414 60782 start.go:128] duration metric: took 23.930370405s to createHost
I0205 03:12:04.672438 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetSSHHostname
I0205 03:12:04.674942 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has defined MAC address 52:54:00:87:fe:dd in network mk-old-k8s-version-191773
I0205 03:12:04.675336 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:87:fe:dd", ip: ""} in network mk-old-k8s-version-191773: {Iface:virbr2 ExpiryTime:2025-02-05 04:11:55 +0000 UTC Type:0 Mac:52:54:00:87:fe:dd Iaid: IPaddr:192.168.39.74 Prefix:24 Hostname:old-k8s-version-191773 Clientid:01:52:54:00:87:fe:dd}
I0205 03:12:04.675368 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has defined IP address 192.168.39.74 and MAC address 52:54:00:87:fe:dd in network mk-old-k8s-version-191773
I0205 03:12:04.675531 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetSSHPort
I0205 03:12:04.675723 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetSSHKeyPath
I0205 03:12:04.675878 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetSSHKeyPath
I0205 03:12:04.676018 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetSSHUsername
I0205 03:12:04.676213 60782 main.go:141] libmachine: Using SSH client type: native
I0205 03:12:04.676366 60782 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x865a00] 0x8686e0 <nil> [] 0s} 192.168.39.74 22 <nil> <nil>}
I0205 03:12:04.676384 60782 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0205 03:12:04.786113 60782 main.go:141] libmachine: SSH cmd err, output: <nil>: 1738725124.761891623
I0205 03:12:04.786152 60782 fix.go:216] guest clock: 1738725124.761891623
I0205 03:12:04.786163 60782 fix.go:229] Guest: 2025-02-05 03:12:04.761891623 +0000 UTC Remote: 2025-02-05 03:12:04.672424787 +0000 UTC m=+24.038269505 (delta=89.466836ms)
I0205 03:12:04.786218 60782 fix.go:200] guest clock delta is within tolerance: 89.466836ms
I0205 03:12:04.786225 60782 start.go:83] releasing machines lock for "old-k8s-version-191773", held for 24.044255238s
I0205 03:12:04.786257 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .DriverName
I0205 03:12:04.786558 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetIP
I0205 03:12:04.789512 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has defined MAC address 52:54:00:87:fe:dd in network mk-old-k8s-version-191773
I0205 03:12:04.789976 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:87:fe:dd", ip: ""} in network mk-old-k8s-version-191773: {Iface:virbr2 ExpiryTime:2025-02-05 04:11:55 +0000 UTC Type:0 Mac:52:54:00:87:fe:dd Iaid: IPaddr:192.168.39.74 Prefix:24 Hostname:old-k8s-version-191773 Clientid:01:52:54:00:87:fe:dd}
I0205 03:12:04.790012 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has defined IP address 192.168.39.74 and MAC address 52:54:00:87:fe:dd in network mk-old-k8s-version-191773
I0205 03:12:04.790315 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .DriverName
I0205 03:12:04.790852 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .DriverName
I0205 03:12:04.791063 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .DriverName
I0205 03:12:04.791167 60782 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0205 03:12:04.791231 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetSSHHostname
I0205 03:12:04.791327 60782 ssh_runner.go:195] Run: cat /version.json
I0205 03:12:04.791354 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetSSHHostname
I0205 03:12:04.794635 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has defined MAC address 52:54:00:87:fe:dd in network mk-old-k8s-version-191773
I0205 03:12:04.794913 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has defined MAC address 52:54:00:87:fe:dd in network mk-old-k8s-version-191773
I0205 03:12:04.795073 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:87:fe:dd", ip: ""} in network mk-old-k8s-version-191773: {Iface:virbr2 ExpiryTime:2025-02-05 04:11:55 +0000 UTC Type:0 Mac:52:54:00:87:fe:dd Iaid: IPaddr:192.168.39.74 Prefix:24 Hostname:old-k8s-version-191773 Clientid:01:52:54:00:87:fe:dd}
I0205 03:12:04.795129 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has defined IP address 192.168.39.74 and MAC address 52:54:00:87:fe:dd in network mk-old-k8s-version-191773
I0205 03:12:04.795347 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetSSHPort
I0205 03:12:04.795427 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:87:fe:dd", ip: ""} in network mk-old-k8s-version-191773: {Iface:virbr2 ExpiryTime:2025-02-05 04:11:55 +0000 UTC Type:0 Mac:52:54:00:87:fe:dd Iaid: IPaddr:192.168.39.74 Prefix:24 Hostname:old-k8s-version-191773 Clientid:01:52:54:00:87:fe:dd}
I0205 03:12:04.795446 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has defined IP address 192.168.39.74 and MAC address 52:54:00:87:fe:dd in network mk-old-k8s-version-191773
I0205 03:12:04.795493 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetSSHKeyPath
I0205 03:12:04.795648 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetSSHUsername
I0205 03:12:04.795792 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetSSHPort
I0205 03:12:04.795841 60782 sshutil.go:53] new ssh client: &{IP:192.168.39.74 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20363-12788/.minikube/machines/old-k8s-version-191773/id_rsa Username:docker}
I0205 03:12:04.795904 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetSSHKeyPath
I0205 03:12:04.795999 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetSSHUsername
I0205 03:12:04.796076 60782 sshutil.go:53] new ssh client: &{IP:192.168.39.74 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20363-12788/.minikube/machines/old-k8s-version-191773/id_rsa Username:docker}
I0205 03:12:04.905480 60782 ssh_runner.go:195] Run: systemctl --version
I0205 03:12:04.911531 60782 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0205 03:12:05.078129 60782 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0205 03:12:05.086937 60782 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0205 03:12:05.087026 60782 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0205 03:12:05.104454 60782 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0205 03:12:05.104484 60782 start.go:495] detecting cgroup driver to use...
I0205 03:12:05.104553 60782 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0205 03:12:05.121516 60782 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0205 03:12:05.136907 60782 docker.go:217] disabling cri-docker service (if available) ...
I0205 03:12:05.136969 60782 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0205 03:12:05.157674 60782 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0205 03:12:05.178457 60782 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0205 03:12:05.307688 60782 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0205 03:12:05.453913 60782 docker.go:233] disabling docker service ...
I0205 03:12:05.454051 60782 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0205 03:12:05.471545 60782 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0205 03:12:05.485814 60782 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0205 03:12:05.624616 60782 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0205 03:12:05.755112 60782 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0205 03:12:05.770747 60782 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0205 03:12:05.801491 60782 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0205 03:12:05.801568 60782 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0205 03:12:05.813204 60782 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0205 03:12:05.813289 60782 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0205 03:12:05.824826 60782 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0205 03:12:05.835923 60782 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0205 03:12:05.847500 60782 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0205 03:12:05.863830 60782 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0205 03:12:05.874701 60782 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0205 03:12:05.874770 60782 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0205 03:12:05.890432 60782 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0205 03:12:05.900598 60782 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0205 03:12:06.034028 60782 ssh_runner.go:195] Run: sudo systemctl restart crio
I0205 03:12:06.136510 60782 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0205 03:12:06.136591 60782 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0205 03:12:06.141429 60782 start.go:563] Will wait 60s for crictl version
I0205 03:12:06.141546 60782 ssh_runner.go:195] Run: which crictl
I0205 03:12:06.145621 60782 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0205 03:12:06.187188 60782 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0205 03:12:06.187291 60782 ssh_runner.go:195] Run: crio --version
I0205 03:12:06.217940 60782 ssh_runner.go:195] Run: crio --version
I0205 03:12:06.249026 60782 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0205 03:12:06.250154 60782 main.go:141] libmachine: (old-k8s-version-191773) Calling .GetIP
I0205 03:12:06.252835 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has defined MAC address 52:54:00:87:fe:dd in network mk-old-k8s-version-191773
I0205 03:12:06.253216 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:87:fe:dd", ip: ""} in network mk-old-k8s-version-191773: {Iface:virbr2 ExpiryTime:2025-02-05 04:11:55 +0000 UTC Type:0 Mac:52:54:00:87:fe:dd Iaid: IPaddr:192.168.39.74 Prefix:24 Hostname:old-k8s-version-191773 Clientid:01:52:54:00:87:fe:dd}
I0205 03:12:06.253246 60782 main.go:141] libmachine: (old-k8s-version-191773) DBG | domain old-k8s-version-191773 has defined IP address 192.168.39.74 and MAC address 52:54:00:87:fe:dd in network mk-old-k8s-version-191773
I0205 03:12:06.253524 60782 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I0205 03:12:06.257691 60782 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0205 03:12:06.269908 60782 kubeadm.go:883] updating cluster {Name:old-k8s-version-191773 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-191773 Namespace
:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.74 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: D
isableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0205 03:12:06.270047 60782 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0205 03:12:06.270111 60782 ssh_runner.go:195] Run: sudo crictl images --output json
I0205 03:12:06.304133 60782 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0205 03:12:06.304205 60782 ssh_runner.go:195] Run: which lz4
I0205 03:12:06.308256 60782 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0205 03:12:06.313197 60782 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0205 03:12:06.313235 60782 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20363-12788/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0205 03:12:07.861793 60782 crio.go:462] duration metric: took 1.553576305s to copy over tarball
I0205 03:12:07.861866 60782 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0205 03:12:10.507908 60782 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.646015961s)
I0205 03:12:10.507941 60782 crio.go:469] duration metric: took 2.646120944s to extract the tarball
I0205 03:12:10.507951 60782 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0205 03:12:10.564807 60782 ssh_runner.go:195] Run: sudo crictl images --output json
I0205 03:12:10.613502 60782 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0205 03:12:10.613537 60782 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0205 03:12:10.613623 60782 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0205 03:12:10.613653 60782 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0205 03:12:10.613668 60782 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0205 03:12:10.613678 60782 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0205 03:12:10.613628 60782 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0205 03:12:10.613667 60782 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0205 03:12:10.613657 60782 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0205 03:12:10.613646 60782 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0205 03:12:10.615069 60782 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0205 03:12:10.615150 60782 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0205 03:12:10.615169 60782 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0205 03:12:10.615081 60782 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0205 03:12:10.615249 60782 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0205 03:12:10.615336 60782 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0205 03:12:10.615400 60782 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0205 03:12:10.615491 60782 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0205 03:12:10.782457 60782 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0205 03:12:10.789310 60782 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0205 03:12:10.789448 60782 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0205 03:12:10.818605 60782 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0205 03:12:10.836924 60782 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0205 03:12:10.845000 60782 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0205 03:12:10.898637 60782 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0205 03:12:10.898702 60782 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0205 03:12:10.898752 60782 ssh_runner.go:195] Run: which crictl
I0205 03:12:10.902195 60782 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0205 03:12:10.902294 60782 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0205 03:12:10.902347 60782 ssh_runner.go:195] Run: which crictl
I0205 03:12:10.902251 60782 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0205 03:12:10.902424 60782 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0205 03:12:10.902477 60782 ssh_runner.go:195] Run: which crictl
I0205 03:12:10.944598 60782 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0205 03:12:10.949448 60782 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0205 03:12:10.949488 60782 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0205 03:12:10.949534 60782 ssh_runner.go:195] Run: which crictl
I0205 03:12:10.963100 60782 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0205 03:12:10.963149 60782 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0205 03:12:10.963154 60782 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0205 03:12:10.963184 60782 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0205 03:12:10.963206 60782 ssh_runner.go:195] Run: which crictl
I0205 03:12:10.963208 60782 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0205 03:12:10.963233 60782 ssh_runner.go:195] Run: which crictl
I0205 03:12:10.963248 60782 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0205 03:12:10.963276 60782 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0205 03:12:11.049618 60782 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0205 03:12:11.049666 60782 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0205 03:12:11.049707 60782 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0205 03:12:11.049710 60782 ssh_runner.go:195] Run: which crictl
I0205 03:12:11.063200 60782 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0205 03:12:11.063255 60782 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0205 03:12:11.063200 60782 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0205 03:12:11.063312 60782 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0205 03:12:11.063323 60782 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0205 03:12:11.146150 60782 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0205 03:12:11.146177 60782 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0205 03:12:11.215698 60782 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0205 03:12:11.215736 60782 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0205 03:12:11.224960 60782 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0205 03:12:11.224974 60782 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0205 03:12:11.225058 60782 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0205 03:12:11.285361 60782 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0205 03:12:11.285504 60782 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0205 03:12:11.353310 60782 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20363-12788/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0205 03:12:11.357560 60782 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0205 03:12:11.383686 60782 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20363-12788/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0205 03:12:11.383769 60782 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20363-12788/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0205 03:12:11.383846 60782 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0205 03:12:11.394164 60782 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20363-12788/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0205 03:12:11.405090 60782 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0205 03:12:11.440019 60782 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20363-12788/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0205 03:12:11.454873 60782 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20363-12788/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0205 03:12:11.458015 60782 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20363-12788/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0205 03:12:11.558858 60782 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0205 03:12:11.704050 60782 cache_images.go:92] duration metric: took 1.090493153s to LoadCachedImages
W0205 03:12:11.704163 60782 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20363-12788/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20363-12788/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0: no such file or directory
I0205 03:12:11.704182 60782 kubeadm.go:934] updating node { 192.168.39.74 8443 v1.20.0 crio true true} ...
I0205 03:12:11.704333 60782 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-191773 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.39.74
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-191773 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0205 03:12:11.704401 60782 ssh_runner.go:195] Run: crio config
I0205 03:12:11.753915 60782 cni.go:84] Creating CNI manager for ""
I0205 03:12:11.753938 60782 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0205 03:12:11.753949 60782 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0205 03:12:11.753967 60782 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.74 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-191773 NodeName:old-k8s-version-191773 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.74"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.74 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Stati
cPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0205 03:12:11.754086 60782 kubeadm.go:195] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.39.74
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-191773"
kubeletExtraArgs:
node-ip: 192.168.39.74
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.39.74"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0205 03:12:11.754151 60782 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0205 03:12:11.765795 60782 binaries.go:44] Found k8s binaries, skipping transfer
I0205 03:12:11.765896 60782 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0205 03:12:11.777280 60782 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (429 bytes)
I0205 03:12:11.795595 60782 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0205 03:12:11.813470 60782 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2120 bytes)
I0205 03:12:11.832154 60782 ssh_runner.go:195] Run: grep 192.168.39.74 control-plane.minikube.internal$ /etc/hosts
I0205 03:12:11.835933 60782 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.74 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0205 03:12:11.848936 60782 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0205 03:12:11.993404 60782 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0205 03:12:12.011800 60782 certs.go:68] Setting up /home/jenkins/minikube-integration/20363-12788/.minikube/profiles/old-k8s-version-191773 for IP: 192.168.39.74
I0205 03:12:12.011835 60782 certs.go:194] generating shared ca certs ...
I0205 03:12:12.011858 60782 certs.go:226] acquiring lock for ca certs: {Name:mkca3cbb562bd1b517883c3b07fce8acc6cc9038 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0205 03:12:12.012062 60782 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20363-12788/.minikube/ca.key
I0205 03:12:12.012125 60782 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20363-12788/.minikube/proxy-client-ca.key
I0205 03:12:12.012140 60782 certs.go:256] generating profile certs ...
I0205 03:12:12.012231 60782 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/20363-12788/.minikube/profiles/old-k8s-version-191773/client.key
I0205 03:12:12.012248 60782 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20363-12788/.minikube/profiles/old-k8s-version-191773/client.crt with IP's: []
I0205 03:12:12.186597 60782 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20363-12788/.minikube/profiles/old-k8s-version-191773/client.crt ...
I0205 03:12:12.186635 60782 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20363-12788/.minikube/profiles/old-k8s-version-191773/client.crt: {Name:mk49efd14d2c4ebc98894b6411b8352e5b4c5e91 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0205 03:12:12.186900 60782 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20363-12788/.minikube/profiles/old-k8s-version-191773/client.key ...
I0205 03:12:12.186918 60782 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20363-12788/.minikube/profiles/old-k8s-version-191773/client.key: {Name:mk2731786e8566a74967395c8f2a693bb73d2142 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0205 03:12:12.187030 60782 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20363-12788/.minikube/profiles/old-k8s-version-191773/apiserver.key.213c5845
I0205 03:12:12.187050 60782 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20363-12788/.minikube/profiles/old-k8s-version-191773/apiserver.crt.213c5845 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.74]
I0205 03:12:12.317837 60782 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20363-12788/.minikube/profiles/old-k8s-version-191773/apiserver.crt.213c5845 ...
I0205 03:12:12.317884 60782 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20363-12788/.minikube/profiles/old-k8s-version-191773/apiserver.crt.213c5845: {Name:mk62767e6e4268a686ae4f6dba1d3512122ff0ee Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0205 03:12:12.318130 60782 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20363-12788/.minikube/profiles/old-k8s-version-191773/apiserver.key.213c5845 ...
I0205 03:12:12.318161 60782 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20363-12788/.minikube/profiles/old-k8s-version-191773/apiserver.key.213c5845: {Name:mk0fa7405ead83cf80af104eb124adb57f1e8ec9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0205 03:12:12.318328 60782 certs.go:381] copying /home/jenkins/minikube-integration/20363-12788/.minikube/profiles/old-k8s-version-191773/apiserver.crt.213c5845 -> /home/jenkins/minikube-integration/20363-12788/.minikube/profiles/old-k8s-version-191773/apiserver.crt
I0205 03:12:12.318470 60782 certs.go:385] copying /home/jenkins/minikube-integration/20363-12788/.minikube/profiles/old-k8s-version-191773/apiserver.key.213c5845 -> /home/jenkins/minikube-integration/20363-12788/.minikube/profiles/old-k8s-version-191773/apiserver.key
I0205 03:12:12.318540 60782 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/20363-12788/.minikube/profiles/old-k8s-version-191773/proxy-client.key
I0205 03:12:12.318561 60782 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20363-12788/.minikube/profiles/old-k8s-version-191773/proxy-client.crt with IP's: []
I0205 03:12:12.752764 60782 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20363-12788/.minikube/profiles/old-k8s-version-191773/proxy-client.crt ...
I0205 03:12:12.752791 60782 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20363-12788/.minikube/profiles/old-k8s-version-191773/proxy-client.crt: {Name:mk2adee6da8d904cf0fc1de89a215d17c2a70796 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0205 03:12:12.752953 60782 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20363-12788/.minikube/profiles/old-k8s-version-191773/proxy-client.key ...
I0205 03:12:12.752965 60782 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20363-12788/.minikube/profiles/old-k8s-version-191773/proxy-client.key: {Name:mkf3d3aea44f5798ad1ec50a31e5f53fec5cd48e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0205 03:12:12.753142 60782 certs.go:484] found cert: /home/jenkins/minikube-integration/20363-12788/.minikube/certs/19989.pem (1338 bytes)
W0205 03:12:12.753181 60782 certs.go:480] ignoring /home/jenkins/minikube-integration/20363-12788/.minikube/certs/19989_empty.pem, impossibly tiny 0 bytes
I0205 03:12:12.753191 60782 certs.go:484] found cert: /home/jenkins/minikube-integration/20363-12788/.minikube/certs/ca-key.pem (1679 bytes)
I0205 03:12:12.753220 60782 certs.go:484] found cert: /home/jenkins/minikube-integration/20363-12788/.minikube/certs/ca.pem (1082 bytes)
I0205 03:12:12.753257 60782 certs.go:484] found cert: /home/jenkins/minikube-integration/20363-12788/.minikube/certs/cert.pem (1123 bytes)
I0205 03:12:12.753282 60782 certs.go:484] found cert: /home/jenkins/minikube-integration/20363-12788/.minikube/certs/key.pem (1675 bytes)
I0205 03:12:12.753319 60782 certs.go:484] found cert: /home/jenkins/minikube-integration/20363-12788/.minikube/files/etc/ssl/certs/199892.pem (1708 bytes)
I0205 03:12:12.753875 60782 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20363-12788/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0205 03:12:12.780027 60782 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20363-12788/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0205 03:12:12.803016 60782 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20363-12788/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0205 03:12:12.827463 60782 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20363-12788/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0205 03:12:12.855981 60782 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20363-12788/.minikube/profiles/old-k8s-version-191773/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0205 03:12:12.894301 60782 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20363-12788/.minikube/profiles/old-k8s-version-191773/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0205 03:12:12.928521 60782 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20363-12788/.minikube/profiles/old-k8s-version-191773/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0205 03:12:12.951023 60782 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20363-12788/.minikube/profiles/old-k8s-version-191773/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0205 03:12:12.972862 60782 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20363-12788/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0205 03:12:12.996497 60782 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20363-12788/.minikube/certs/19989.pem --> /usr/share/ca-certificates/19989.pem (1338 bytes)
I0205 03:12:13.020104 60782 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20363-12788/.minikube/files/etc/ssl/certs/199892.pem --> /usr/share/ca-certificates/199892.pem (1708 bytes)
I0205 03:12:13.042438 60782 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0205 03:12:13.059057 60782 ssh_runner.go:195] Run: openssl version
I0205 03:12:13.065088 60782 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0205 03:12:13.075992 60782 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0205 03:12:13.080360 60782 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Feb 5 02:04 /usr/share/ca-certificates/minikubeCA.pem
I0205 03:12:13.080423 60782 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0205 03:12:13.086050 60782 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0205 03:12:13.098172 60782 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/19989.pem && ln -fs /usr/share/ca-certificates/19989.pem /etc/ssl/certs/19989.pem"
I0205 03:12:13.109209 60782 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/19989.pem
I0205 03:12:13.113691 60782 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Feb 5 02:11 /usr/share/ca-certificates/19989.pem
I0205 03:12:13.113749 60782 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/19989.pem
I0205 03:12:13.119221 60782 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/19989.pem /etc/ssl/certs/51391683.0"
I0205 03:12:13.129774 60782 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/199892.pem && ln -fs /usr/share/ca-certificates/199892.pem /etc/ssl/certs/199892.pem"
I0205 03:12:13.140016 60782 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/199892.pem
I0205 03:12:13.144190 60782 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Feb 5 02:11 /usr/share/ca-certificates/199892.pem
I0205 03:12:13.144250 60782 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/199892.pem
I0205 03:12:13.149954 60782 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/199892.pem /etc/ssl/certs/3ec20f2e.0"
I0205 03:12:13.161615 60782 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0205 03:12:13.165448 60782 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0205 03:12:13.165496 60782 kubeadm.go:392] StartCluster: {Name:old-k8s-version-191773 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-191773 Namespace:de
fault APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.74 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Disa
bleOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0205 03:12:13.165560 60782 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0205 03:12:13.165600 60782 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0205 03:12:13.203035 60782 cri.go:89] found id: ""
I0205 03:12:13.203098 60782 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0205 03:12:13.213667 60782 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0205 03:12:13.224997 60782 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0205 03:12:13.234864 60782 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0205 03:12:13.234883 60782 kubeadm.go:157] found existing configuration files:
I0205 03:12:13.234924 60782 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0205 03:12:13.243961 60782 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0205 03:12:13.244034 60782 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0205 03:12:13.253106 60782 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0205 03:12:13.262227 60782 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0205 03:12:13.262315 60782 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0205 03:12:13.271749 60782 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0205 03:12:13.280487 60782 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0205 03:12:13.280543 60782 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0205 03:12:13.290671 60782 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0205 03:12:13.299751 60782 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0205 03:12:13.299815 60782 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0205 03:12:13.309369 60782 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0205 03:12:13.426162 60782 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0205 03:12:13.426256 60782 kubeadm.go:310] [preflight] Running pre-flight checks
I0205 03:12:13.594972 60782 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0205 03:12:13.595169 60782 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0205 03:12:13.595330 60782 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0205 03:12:13.827129 60782 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0205 03:12:14.044494 60782 out.go:235] - Generating certificates and keys ...
I0205 03:12:14.044638 60782 kubeadm.go:310] [certs] Using existing ca certificate authority
I0205 03:12:14.044747 60782 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0205 03:12:14.044894 60782 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0205 03:12:14.162900 60782 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0205 03:12:14.401545 60782 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0205 03:12:14.816155 60782 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0205 03:12:15.071858 60782 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0205 03:12:15.072071 60782 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-191773] and IPs [192.168.39.74 127.0.0.1 ::1]
I0205 03:12:15.223663 60782 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0205 03:12:15.224178 60782 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-191773] and IPs [192.168.39.74 127.0.0.1 ::1]
I0205 03:12:15.611954 60782 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0205 03:12:15.730142 60782 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0205 03:12:15.805509 60782 kubeadm.go:310] [certs] Generating "sa" key and public key
I0205 03:12:15.805952 60782 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0205 03:12:15.893294 60782 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0205 03:12:15.998614 60782 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0205 03:12:16.213085 60782 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0205 03:12:16.406193 60782 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0205 03:12:16.426712 60782 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0205 03:12:16.428908 60782 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0205 03:12:16.429005 60782 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0205 03:12:16.595620 60782 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0205 03:12:16.597537 60782 out.go:235] - Booting up control plane ...
I0205 03:12:16.597694 60782 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0205 03:12:16.605308 60782 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0205 03:12:16.606721 60782 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0205 03:12:16.609285 60782 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0205 03:12:16.613978 60782 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0205 03:12:56.607846 60782 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0205 03:12:56.608490 60782 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0205 03:12:56.608776 60782 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0205 03:13:01.608926 60782 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0205 03:13:01.609189 60782 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0205 03:13:11.608378 60782 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0205 03:13:11.608708 60782 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0205 03:13:31.607948 60782 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0205 03:13:31.608286 60782 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0205 03:14:11.609210 60782 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0205 03:14:11.609474 60782 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0205 03:14:11.609510 60782 kubeadm.go:310]
I0205 03:14:11.609581 60782 kubeadm.go:310] Unfortunately, an error has occurred:
I0205 03:14:11.609650 60782 kubeadm.go:310] timed out waiting for the condition
I0205 03:14:11.609660 60782 kubeadm.go:310]
I0205 03:14:11.609732 60782 kubeadm.go:310] This error is likely caused by:
I0205 03:14:11.609793 60782 kubeadm.go:310] - The kubelet is not running
I0205 03:14:11.609935 60782 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0205 03:14:11.609950 60782 kubeadm.go:310]
I0205 03:14:11.610074 60782 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0205 03:14:11.610144 60782 kubeadm.go:310] - 'systemctl status kubelet'
I0205 03:14:11.610195 60782 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0205 03:14:11.610205 60782 kubeadm.go:310]
I0205 03:14:11.610340 60782 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0205 03:14:11.610480 60782 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0205 03:14:11.610489 60782 kubeadm.go:310]
I0205 03:14:11.610566 60782 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0205 03:14:11.610634 60782 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0205 03:14:11.610693 60782 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0205 03:14:11.610753 60782 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0205 03:14:11.610762 60782 kubeadm.go:310]
I0205 03:14:11.611434 60782 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0205 03:14:11.611512 60782 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0205 03:14:11.611577 60782 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
W0205 03:14:11.611719 60782 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-191773] and IPs [192.168.39.74 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-191773] and IPs [192.168.39.74 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-191773] and IPs [192.168.39.74 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-191773] and IPs [192.168.39.74 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0205 03:14:11.611758 60782 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0205 03:14:12.081412 60782 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0205 03:14:12.096243 60782 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0205 03:14:12.107983 60782 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0205 03:14:12.108007 60782 kubeadm.go:157] found existing configuration files:
I0205 03:14:12.108064 60782 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0205 03:14:12.116793 60782 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0205 03:14:12.116846 60782 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0205 03:14:12.128376 60782 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0205 03:14:12.137247 60782 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0205 03:14:12.137315 60782 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0205 03:14:12.147851 60782 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0205 03:14:12.156915 60782 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0205 03:14:12.156982 60782 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0205 03:14:12.166352 60782 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0205 03:14:12.175035 60782 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0205 03:14:12.175101 60782 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0205 03:14:12.184344 60782 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0205 03:14:12.253322 60782 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0205 03:14:12.253431 60782 kubeadm.go:310] [preflight] Running pre-flight checks
I0205 03:14:12.415618 60782 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0205 03:14:12.415743 60782 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0205 03:14:12.415893 60782 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0205 03:14:12.615737 60782 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0205 03:14:12.618678 60782 out.go:235] - Generating certificates and keys ...
I0205 03:14:12.618801 60782 kubeadm.go:310] [certs] Using existing ca certificate authority
I0205 03:14:12.618874 60782 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0205 03:14:12.618978 60782 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0205 03:14:12.619072 60782 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0205 03:14:12.619182 60782 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0205 03:14:12.619261 60782 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0205 03:14:12.619356 60782 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0205 03:14:12.619466 60782 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0205 03:14:12.619575 60782 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0205 03:14:12.619676 60782 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0205 03:14:12.619728 60782 kubeadm.go:310] [certs] Using the existing "sa" key
I0205 03:14:12.619808 60782 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0205 03:14:12.835869 60782 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0205 03:14:12.952437 60782 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0205 03:14:13.076559 60782 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0205 03:14:13.474349 60782 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0205 03:14:13.498972 60782 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0205 03:14:13.499094 60782 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0205 03:14:13.499163 60782 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0205 03:14:13.644879 60782 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0205 03:14:13.646246 60782 out.go:235] - Booting up control plane ...
I0205 03:14:13.646401 60782 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0205 03:14:13.658451 60782 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0205 03:14:13.660351 60782 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0205 03:14:13.661585 60782 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0205 03:14:13.667893 60782 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0205 03:14:53.669895 60782 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0205 03:14:53.670234 60782 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0205 03:14:53.670427 60782 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0205 03:14:58.671339 60782 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0205 03:14:58.671704 60782 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0205 03:15:08.672313 60782 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0205 03:15:08.672597 60782 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0205 03:15:28.671893 60782 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0205 03:15:28.672164 60782 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0205 03:16:08.672460 60782 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0205 03:16:08.672681 60782 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0205 03:16:08.672702 60782 kubeadm.go:310]
I0205 03:16:08.672737 60782 kubeadm.go:310] Unfortunately, an error has occurred:
I0205 03:16:08.672772 60782 kubeadm.go:310] timed out waiting for the condition
I0205 03:16:08.672779 60782 kubeadm.go:310]
I0205 03:16:08.672812 60782 kubeadm.go:310] This error is likely caused by:
I0205 03:16:08.672841 60782 kubeadm.go:310] - The kubelet is not running
I0205 03:16:08.672933 60782 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0205 03:16:08.672952 60782 kubeadm.go:310]
I0205 03:16:08.673061 60782 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0205 03:16:08.673116 60782 kubeadm.go:310] - 'systemctl status kubelet'
I0205 03:16:08.673163 60782 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0205 03:16:08.673173 60782 kubeadm.go:310]
I0205 03:16:08.673292 60782 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0205 03:16:08.673409 60782 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0205 03:16:08.673423 60782 kubeadm.go:310]
I0205 03:16:08.673548 60782 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0205 03:16:08.673664 60782 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0205 03:16:08.673771 60782 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0205 03:16:08.673873 60782 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0205 03:16:08.673885 60782 kubeadm.go:310]
I0205 03:16:08.674391 60782 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0205 03:16:08.674535 60782 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0205 03:16:08.674655 60782 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0205 03:16:08.674725 60782 kubeadm.go:394] duration metric: took 3m55.509231187s to StartCluster
I0205 03:16:08.674761 60782 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0205 03:16:08.674818 60782 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0205 03:16:08.716336 60782 cri.go:89] found id: ""
I0205 03:16:08.716368 60782 logs.go:282] 0 containers: []
W0205 03:16:08.716388 60782 logs.go:284] No container was found matching "kube-apiserver"
I0205 03:16:08.716397 60782 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0205 03:16:08.716459 60782 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0205 03:16:08.749385 60782 cri.go:89] found id: ""
I0205 03:16:08.749432 60782 logs.go:282] 0 containers: []
W0205 03:16:08.749445 60782 logs.go:284] No container was found matching "etcd"
I0205 03:16:08.749453 60782 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0205 03:16:08.749519 60782 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0205 03:16:08.783692 60782 cri.go:89] found id: ""
I0205 03:16:08.783718 60782 logs.go:282] 0 containers: []
W0205 03:16:08.783725 60782 logs.go:284] No container was found matching "coredns"
I0205 03:16:08.783731 60782 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0205 03:16:08.783785 60782 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0205 03:16:08.816722 60782 cri.go:89] found id: ""
I0205 03:16:08.816750 60782 logs.go:282] 0 containers: []
W0205 03:16:08.816758 60782 logs.go:284] No container was found matching "kube-scheduler"
I0205 03:16:08.816763 60782 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0205 03:16:08.816810 60782 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0205 03:16:08.848568 60782 cri.go:89] found id: ""
I0205 03:16:08.848603 60782 logs.go:282] 0 containers: []
W0205 03:16:08.848614 60782 logs.go:284] No container was found matching "kube-proxy"
I0205 03:16:08.848624 60782 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0205 03:16:08.848689 60782 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0205 03:16:08.880453 60782 cri.go:89] found id: ""
I0205 03:16:08.880481 60782 logs.go:282] 0 containers: []
W0205 03:16:08.880491 60782 logs.go:284] No container was found matching "kube-controller-manager"
I0205 03:16:08.880498 60782 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0205 03:16:08.880559 60782 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0205 03:16:08.912822 60782 cri.go:89] found id: ""
I0205 03:16:08.912855 60782 logs.go:282] 0 containers: []
W0205 03:16:08.912865 60782 logs.go:284] No container was found matching "kindnet"
I0205 03:16:08.912875 60782 logs.go:123] Gathering logs for kubelet ...
I0205 03:16:08.912885 60782 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0205 03:16:08.962285 60782 logs.go:123] Gathering logs for dmesg ...
I0205 03:16:08.962321 60782 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0205 03:16:08.975626 60782 logs.go:123] Gathering logs for describe nodes ...
I0205 03:16:08.975651 60782 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0205 03:16:09.089970 60782 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0205 03:16:09.090002 60782 logs.go:123] Gathering logs for CRI-O ...
I0205 03:16:09.090018 60782 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0205 03:16:09.196191 60782 logs.go:123] Gathering logs for container status ...
I0205 03:16:09.196232 60782 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0205 03:16:09.231206 60782 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0205 03:16:09.231258 60782 out.go:270] *
*
W0205 03:16:09.231310 60782 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0205 03:16:09.231326 60782 out.go:270] *
*
W0205 03:16:09.232151 60782 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0205 03:16:09.234851 60782 out.go:201]
W0205 03:16:09.235933 60782 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0205 03:16:09.235986 60782 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0205 03:16:09.236014 60782 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0205 03:16:09.237525 60782 out.go:201]
** /stderr **
start_stop_delete_test.go:186: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-191773 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-191773 -n old-k8s-version-191773
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-191773 -n old-k8s-version-191773: exit status 6 (229.204159ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0205 03:16:09.506681 63527 status.go:458] kubeconfig endpoint: get endpoint: "old-k8s-version-191773" does not appear in /home/jenkins/minikube-integration/20363-12788/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-191773" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (268.89s)