=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-131737 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-131737 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (5m2.8964796s)
-- stdout --
* [old-k8s-version-131737] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=19529
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19529-10317/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19529-10317/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-131737" primary control-plane node in "old-k8s-version-131737" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0828 18:11:41.009716 69228 out.go:345] Setting OutFile to fd 1 ...
I0828 18:11:41.009970 69228 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0828 18:11:41.009979 69228 out.go:358] Setting ErrFile to fd 2...
I0828 18:11:41.009983 69228 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0828 18:11:41.010174 69228 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19529-10317/.minikube/bin
I0828 18:11:41.010737 69228 out.go:352] Setting JSON to false
I0828 18:11:41.011623 69228 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":6847,"bootTime":1724861854,"procs":226,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1067-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0828 18:11:41.011682 69228 start.go:139] virtualization: kvm guest
I0828 18:11:41.013814 69228 out.go:177] * [old-k8s-version-131737] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
I0828 18:11:41.015089 69228 out.go:177] - MINIKUBE_LOCATION=19529
I0828 18:11:41.015089 69228 notify.go:220] Checking for updates...
I0828 18:11:41.017215 69228 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0828 18:11:41.018360 69228 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19529-10317/kubeconfig
I0828 18:11:41.019431 69228 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19529-10317/.minikube
I0828 18:11:41.020535 69228 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0828 18:11:41.021805 69228 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0828 18:11:41.023483 69228 config.go:182] Loaded profile config "bridge-647068": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.0
I0828 18:11:41.023584 69228 config.go:182] Loaded profile config "enable-default-cni-647068": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.0
I0828 18:11:41.023679 69228 config.go:182] Loaded profile config "flannel-647068": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.0
I0828 18:11:41.023788 69228 driver.go:392] Setting default libvirt URI to qemu:///system
I0828 18:11:41.060828 69228 out.go:177] * Using the kvm2 driver based on user configuration
I0828 18:11:41.062027 69228 start.go:297] selected driver: kvm2
I0828 18:11:41.062043 69228 start.go:901] validating driver "kvm2" against <nil>
I0828 18:11:41.062053 69228 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0828 18:11:41.062795 69228 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0828 18:11:41.062859 69228 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19529-10317/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0828 18:11:41.077621 69228 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.1
I0828 18:11:41.077670 69228 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0828 18:11:41.077902 69228 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0828 18:11:41.077971 69228 cni.go:84] Creating CNI manager for ""
I0828 18:11:41.077987 69228 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0828 18:11:41.077998 69228 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0828 18:11:41.078053 69228 start.go:340] cluster config:
{Name:old-k8s-version-131737 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-131737 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0828 18:11:41.078198 69228 iso.go:125] acquiring lock: {Name:mka4c362a5716dcd382c27bdc11ff0046b15f66a Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0828 18:11:41.079959 69228 out.go:177] * Starting "old-k8s-version-131737" primary control-plane node in "old-k8s-version-131737" cluster
I0828 18:11:41.081144 69228 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0828 18:11:41.081221 69228 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19529-10317/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0828 18:11:41.081233 69228 cache.go:56] Caching tarball of preloaded images
I0828 18:11:41.081327 69228 preload.go:172] Found /home/jenkins/minikube-integration/19529-10317/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0828 18:11:41.081339 69228 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0828 18:11:41.081430 69228 profile.go:143] Saving config to /home/jenkins/minikube-integration/19529-10317/.minikube/profiles/old-k8s-version-131737/config.json ...
I0828 18:11:41.081453 69228 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19529-10317/.minikube/profiles/old-k8s-version-131737/config.json: {Name:mk131fdefb68c7b808e0f4120814129ae0fd6a62 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0828 18:11:41.081644 69228 start.go:360] acquireMachinesLock for old-k8s-version-131737: {Name:mk7ce4bbf81e21758c0e63f7f98e0a1defc75de0 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0828 18:12:09.582753 69228 start.go:364] duration metric: took 28.501068548s to acquireMachinesLock for "old-k8s-version-131737"
I0828 18:12:09.582814 69228 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-131737 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19521/minikube-v1.33.1-1724775098-19521-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-131737 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0828 18:12:09.582976 69228 start.go:125] createHost starting for "" (driver="kvm2")
I0828 18:12:09.676353 69228 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0828 18:12:09.676602 69228 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0828 18:12:09.676656 69228 main.go:141] libmachine: Launching plugin server for driver kvm2
I0828 18:12:09.692115 69228 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37917
I0828 18:12:09.692622 69228 main.go:141] libmachine: () Calling .GetVersion
I0828 18:12:09.693245 69228 main.go:141] libmachine: Using API Version 1
I0828 18:12:09.693272 69228 main.go:141] libmachine: () Calling .SetConfigRaw
I0828 18:12:09.693594 69228 main.go:141] libmachine: () Calling .GetMachineName
I0828 18:12:09.693827 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetMachineName
I0828 18:12:09.694028 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .DriverName
I0828 18:12:09.694210 69228 start.go:159] libmachine.API.Create for "old-k8s-version-131737" (driver="kvm2")
I0828 18:12:09.694241 69228 client.go:168] LocalClient.Create starting
I0828 18:12:09.694275 69228 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19529-10317/.minikube/certs/ca.pem
I0828 18:12:09.694325 69228 main.go:141] libmachine: Decoding PEM data...
I0828 18:12:09.694347 69228 main.go:141] libmachine: Parsing certificate...
I0828 18:12:09.694419 69228 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19529-10317/.minikube/certs/cert.pem
I0828 18:12:09.694440 69228 main.go:141] libmachine: Decoding PEM data...
I0828 18:12:09.694450 69228 main.go:141] libmachine: Parsing certificate...
I0828 18:12:09.694468 69228 main.go:141] libmachine: Running pre-create checks...
I0828 18:12:09.694476 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .PreCreateCheck
I0828 18:12:09.694848 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetConfigRaw
I0828 18:12:09.695258 69228 main.go:141] libmachine: Creating machine...
I0828 18:12:09.695271 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .Create
I0828 18:12:09.695475 69228 main.go:141] libmachine: (old-k8s-version-131737) Creating KVM machine...
I0828 18:12:09.696820 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | found existing default KVM network
I0828 18:12:09.698237 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | I0828 18:12:09.698044 69681 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:9c:a1:16} reservation:<nil>}
I0828 18:12:09.699381 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | I0828 18:12:09.699294 69681 network.go:206] using free private subnet 192.168.50.0/24: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0002da1d0}
I0828 18:12:09.699422 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | created network xml:
I0828 18:12:09.699430 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | <network>
I0828 18:12:09.699442 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | <name>mk-old-k8s-version-131737</name>
I0828 18:12:09.699450 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | <dns enable='no'/>
I0828 18:12:09.699456 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG |
I0828 18:12:09.699463 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | <ip address='192.168.50.1' netmask='255.255.255.0'>
I0828 18:12:09.699472 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | <dhcp>
I0828 18:12:09.699479 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | <range start='192.168.50.2' end='192.168.50.253'/>
I0828 18:12:09.699490 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | </dhcp>
I0828 18:12:09.699540 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | </ip>
I0828 18:12:09.699575 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG |
I0828 18:12:09.699586 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | </network>
I0828 18:12:09.699594 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG |
I0828 18:12:09.825524 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | trying to create private KVM network mk-old-k8s-version-131737 192.168.50.0/24...
I0828 18:12:09.902207 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | private KVM network mk-old-k8s-version-131737 192.168.50.0/24 created
I0828 18:12:09.902317 69228 main.go:141] libmachine: (old-k8s-version-131737) Setting up store path in /home/jenkins/minikube-integration/19529-10317/.minikube/machines/old-k8s-version-131737 ...
I0828 18:12:09.902358 69228 main.go:141] libmachine: (old-k8s-version-131737) Building disk image from file:///home/jenkins/minikube-integration/19529-10317/.minikube/cache/iso/amd64/minikube-v1.33.1-1724775098-19521-amd64.iso
I0828 18:12:09.902373 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | I0828 18:12:09.902301 69681 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19529-10317/.minikube
I0828 18:12:09.902594 69228 main.go:141] libmachine: (old-k8s-version-131737) Downloading /home/jenkins/minikube-integration/19529-10317/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19529-10317/.minikube/cache/iso/amd64/minikube-v1.33.1-1724775098-19521-amd64.iso...
I0828 18:12:10.177174 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | I0828 18:12:10.177050 69681 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19529-10317/.minikube/machines/old-k8s-version-131737/id_rsa...
I0828 18:12:10.325436 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | I0828 18:12:10.325303 69681 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19529-10317/.minikube/machines/old-k8s-version-131737/old-k8s-version-131737.rawdisk...
I0828 18:12:10.325471 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | Writing magic tar header
I0828 18:12:10.325485 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | Writing SSH key tar header
I0828 18:12:10.325493 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | I0828 18:12:10.325458 69681 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19529-10317/.minikube/machines/old-k8s-version-131737 ...
I0828 18:12:10.325597 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19529-10317/.minikube/machines/old-k8s-version-131737
I0828 18:12:10.325633 69228 main.go:141] libmachine: (old-k8s-version-131737) Setting executable bit set on /home/jenkins/minikube-integration/19529-10317/.minikube/machines/old-k8s-version-131737 (perms=drwx------)
I0828 18:12:10.325647 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19529-10317/.minikube/machines
I0828 18:12:10.325745 69228 main.go:141] libmachine: (old-k8s-version-131737) Setting executable bit set on /home/jenkins/minikube-integration/19529-10317/.minikube/machines (perms=drwxr-xr-x)
I0828 18:12:10.325814 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19529-10317/.minikube
I0828 18:12:10.325826 69228 main.go:141] libmachine: (old-k8s-version-131737) Setting executable bit set on /home/jenkins/minikube-integration/19529-10317/.minikube (perms=drwxr-xr-x)
I0828 18:12:10.325847 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19529-10317
I0828 18:12:10.325867 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0828 18:12:10.325880 69228 main.go:141] libmachine: (old-k8s-version-131737) Setting executable bit set on /home/jenkins/minikube-integration/19529-10317 (perms=drwxrwxr-x)
I0828 18:12:10.325891 69228 main.go:141] libmachine: (old-k8s-version-131737) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0828 18:12:10.325904 69228 main.go:141] libmachine: (old-k8s-version-131737) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0828 18:12:10.325916 69228 main.go:141] libmachine: (old-k8s-version-131737) Creating domain...
I0828 18:12:10.325929 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | Checking permissions on dir: /home/jenkins
I0828 18:12:10.325939 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | Checking permissions on dir: /home
I0828 18:12:10.325950 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | Skipping /home - not owner
I0828 18:12:10.327166 69228 main.go:141] libmachine: (old-k8s-version-131737) define libvirt domain using xml:
I0828 18:12:10.327193 69228 main.go:141] libmachine: (old-k8s-version-131737) <domain type='kvm'>
I0828 18:12:10.327210 69228 main.go:141] libmachine: (old-k8s-version-131737) <name>old-k8s-version-131737</name>
I0828 18:12:10.327217 69228 main.go:141] libmachine: (old-k8s-version-131737) <memory unit='MiB'>2200</memory>
I0828 18:12:10.327223 69228 main.go:141] libmachine: (old-k8s-version-131737) <vcpu>2</vcpu>
I0828 18:12:10.327228 69228 main.go:141] libmachine: (old-k8s-version-131737) <features>
I0828 18:12:10.327239 69228 main.go:141] libmachine: (old-k8s-version-131737) <acpi/>
I0828 18:12:10.327244 69228 main.go:141] libmachine: (old-k8s-version-131737) <apic/>
I0828 18:12:10.327258 69228 main.go:141] libmachine: (old-k8s-version-131737) <pae/>
I0828 18:12:10.327270 69228 main.go:141] libmachine: (old-k8s-version-131737)
I0828 18:12:10.327280 69228 main.go:141] libmachine: (old-k8s-version-131737) </features>
I0828 18:12:10.327286 69228 main.go:141] libmachine: (old-k8s-version-131737) <cpu mode='host-passthrough'>
I0828 18:12:10.327294 69228 main.go:141] libmachine: (old-k8s-version-131737)
I0828 18:12:10.327304 69228 main.go:141] libmachine: (old-k8s-version-131737) </cpu>
I0828 18:12:10.327332 69228 main.go:141] libmachine: (old-k8s-version-131737) <os>
I0828 18:12:10.327355 69228 main.go:141] libmachine: (old-k8s-version-131737) <type>hvm</type>
I0828 18:12:10.327370 69228 main.go:141] libmachine: (old-k8s-version-131737) <boot dev='cdrom'/>
I0828 18:12:10.327382 69228 main.go:141] libmachine: (old-k8s-version-131737) <boot dev='hd'/>
I0828 18:12:10.327395 69228 main.go:141] libmachine: (old-k8s-version-131737) <bootmenu enable='no'/>
I0828 18:12:10.327406 69228 main.go:141] libmachine: (old-k8s-version-131737) </os>
I0828 18:12:10.327417 69228 main.go:141] libmachine: (old-k8s-version-131737) <devices>
I0828 18:12:10.327433 69228 main.go:141] libmachine: (old-k8s-version-131737) <disk type='file' device='cdrom'>
I0828 18:12:10.327461 69228 main.go:141] libmachine: (old-k8s-version-131737) <source file='/home/jenkins/minikube-integration/19529-10317/.minikube/machines/old-k8s-version-131737/boot2docker.iso'/>
I0828 18:12:10.327473 69228 main.go:141] libmachine: (old-k8s-version-131737) <target dev='hdc' bus='scsi'/>
I0828 18:12:10.327482 69228 main.go:141] libmachine: (old-k8s-version-131737) <readonly/>
I0828 18:12:10.327492 69228 main.go:141] libmachine: (old-k8s-version-131737) </disk>
I0828 18:12:10.327502 69228 main.go:141] libmachine: (old-k8s-version-131737) <disk type='file' device='disk'>
I0828 18:12:10.327514 69228 main.go:141] libmachine: (old-k8s-version-131737) <driver name='qemu' type='raw' cache='default' io='threads' />
I0828 18:12:10.327536 69228 main.go:141] libmachine: (old-k8s-version-131737) <source file='/home/jenkins/minikube-integration/19529-10317/.minikube/machines/old-k8s-version-131737/old-k8s-version-131737.rawdisk'/>
I0828 18:12:10.327548 69228 main.go:141] libmachine: (old-k8s-version-131737) <target dev='hda' bus='virtio'/>
I0828 18:12:10.327560 69228 main.go:141] libmachine: (old-k8s-version-131737) </disk>
I0828 18:12:10.327573 69228 main.go:141] libmachine: (old-k8s-version-131737) <interface type='network'>
I0828 18:12:10.327588 69228 main.go:141] libmachine: (old-k8s-version-131737) <source network='mk-old-k8s-version-131737'/>
I0828 18:12:10.327607 69228 main.go:141] libmachine: (old-k8s-version-131737) <model type='virtio'/>
I0828 18:12:10.327627 69228 main.go:141] libmachine: (old-k8s-version-131737) </interface>
I0828 18:12:10.327638 69228 main.go:141] libmachine: (old-k8s-version-131737) <interface type='network'>
I0828 18:12:10.327668 69228 main.go:141] libmachine: (old-k8s-version-131737) <source network='default'/>
I0828 18:12:10.327691 69228 main.go:141] libmachine: (old-k8s-version-131737) <model type='virtio'/>
I0828 18:12:10.327704 69228 main.go:141] libmachine: (old-k8s-version-131737) </interface>
I0828 18:12:10.327719 69228 main.go:141] libmachine: (old-k8s-version-131737) <serial type='pty'>
I0828 18:12:10.327733 69228 main.go:141] libmachine: (old-k8s-version-131737) <target port='0'/>
I0828 18:12:10.327744 69228 main.go:141] libmachine: (old-k8s-version-131737) </serial>
I0828 18:12:10.327756 69228 main.go:141] libmachine: (old-k8s-version-131737) <console type='pty'>
I0828 18:12:10.327768 69228 main.go:141] libmachine: (old-k8s-version-131737) <target type='serial' port='0'/>
I0828 18:12:10.327781 69228 main.go:141] libmachine: (old-k8s-version-131737) </console>
I0828 18:12:10.327792 69228 main.go:141] libmachine: (old-k8s-version-131737) <rng model='virtio'>
I0828 18:12:10.327826 69228 main.go:141] libmachine: (old-k8s-version-131737) <backend model='random'>/dev/random</backend>
I0828 18:12:10.327850 69228 main.go:141] libmachine: (old-k8s-version-131737) </rng>
I0828 18:12:10.327862 69228 main.go:141] libmachine: (old-k8s-version-131737)
I0828 18:12:10.327874 69228 main.go:141] libmachine: (old-k8s-version-131737)
I0828 18:12:10.327887 69228 main.go:141] libmachine: (old-k8s-version-131737) </devices>
I0828 18:12:10.327900 69228 main.go:141] libmachine: (old-k8s-version-131737) </domain>
I0828 18:12:10.327916 69228 main.go:141] libmachine: (old-k8s-version-131737)
I0828 18:12:10.335491 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined MAC address 52:54:00:15:65:69 in network default
I0828 18:12:10.336126 69228 main.go:141] libmachine: (old-k8s-version-131737) Ensuring networks are active...
I0828 18:12:10.336152 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:10.336900 69228 main.go:141] libmachine: (old-k8s-version-131737) Ensuring network default is active
I0828 18:12:10.337324 69228 main.go:141] libmachine: (old-k8s-version-131737) Ensuring network mk-old-k8s-version-131737 is active
I0828 18:12:10.338067 69228 main.go:141] libmachine: (old-k8s-version-131737) Getting domain xml...
I0828 18:12:10.339116 69228 main.go:141] libmachine: (old-k8s-version-131737) Creating domain...
I0828 18:12:11.945989 69228 main.go:141] libmachine: (old-k8s-version-131737) Waiting to get IP...
I0828 18:12:11.947087 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:11.948080 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | unable to find current IP address of domain old-k8s-version-131737 in network mk-old-k8s-version-131737
I0828 18:12:11.948112 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | I0828 18:12:11.947960 69681 retry.go:31] will retry after 216.959622ms: waiting for machine to come up
I0828 18:12:12.166298 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:12.166782 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | unable to find current IP address of domain old-k8s-version-131737 in network mk-old-k8s-version-131737
I0828 18:12:12.166800 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | I0828 18:12:12.166700 69681 retry.go:31] will retry after 347.764496ms: waiting for machine to come up
I0828 18:12:12.516674 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:12.517174 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | unable to find current IP address of domain old-k8s-version-131737 in network mk-old-k8s-version-131737
I0828 18:12:12.517195 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | I0828 18:12:12.517138 69681 retry.go:31] will retry after 467.400316ms: waiting for machine to come up
I0828 18:12:12.986162 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:12.986737 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | unable to find current IP address of domain old-k8s-version-131737 in network mk-old-k8s-version-131737
I0828 18:12:12.986761 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | I0828 18:12:12.986672 69681 retry.go:31] will retry after 403.197013ms: waiting for machine to come up
I0828 18:12:13.391378 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:13.392022 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | unable to find current IP address of domain old-k8s-version-131737 in network mk-old-k8s-version-131737
I0828 18:12:13.392045 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | I0828 18:12:13.391955 69681 retry.go:31] will retry after 536.307079ms: waiting for machine to come up
I0828 18:12:13.930061 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:13.930154 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | unable to find current IP address of domain old-k8s-version-131737 in network mk-old-k8s-version-131737
I0828 18:12:13.930186 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | I0828 18:12:13.930071 69681 retry.go:31] will retry after 647.131964ms: waiting for machine to come up
I0828 18:12:14.579044 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:14.579707 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | unable to find current IP address of domain old-k8s-version-131737 in network mk-old-k8s-version-131737
I0828 18:12:14.579741 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | I0828 18:12:14.579600 69681 retry.go:31] will retry after 1.179847133s: waiting for machine to come up
I0828 18:12:15.760874 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:15.761606 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | unable to find current IP address of domain old-k8s-version-131737 in network mk-old-k8s-version-131737
I0828 18:12:15.761639 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | I0828 18:12:15.761553 69681 retry.go:31] will retry after 911.372502ms: waiting for machine to come up
I0828 18:12:16.677969 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:16.678586 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | unable to find current IP address of domain old-k8s-version-131737 in network mk-old-k8s-version-131737
I0828 18:12:16.678616 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | I0828 18:12:16.678544 69681 retry.go:31] will retry after 1.192321531s: waiting for machine to come up
I0828 18:12:17.872890 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:17.873329 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | unable to find current IP address of domain old-k8s-version-131737 in network mk-old-k8s-version-131737
I0828 18:12:17.873363 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | I0828 18:12:17.873298 69681 retry.go:31] will retry after 2.32398318s: waiting for machine to come up
I0828 18:12:20.199472 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:20.200181 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | unable to find current IP address of domain old-k8s-version-131737 in network mk-old-k8s-version-131737
I0828 18:12:20.200208 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | I0828 18:12:20.200081 69681 retry.go:31] will retry after 1.751997633s: waiting for machine to come up
I0828 18:12:21.953641 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:21.954175 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | unable to find current IP address of domain old-k8s-version-131737 in network mk-old-k8s-version-131737
I0828 18:12:21.954214 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | I0828 18:12:21.954171 69681 retry.go:31] will retry after 2.579760602s: waiting for machine to come up
I0828 18:12:24.535063 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:24.535688 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | unable to find current IP address of domain old-k8s-version-131737 in network mk-old-k8s-version-131737
I0828 18:12:24.535737 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | I0828 18:12:24.535626 69681 retry.go:31] will retry after 4.036431206s: waiting for machine to come up
I0828 18:12:28.575979 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:28.576504 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | unable to find current IP address of domain old-k8s-version-131737 in network mk-old-k8s-version-131737
I0828 18:12:28.576534 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | I0828 18:12:28.576463 69681 retry.go:31] will retry after 5.555381898s: waiting for machine to come up
I0828 18:12:34.135740 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:34.136290 69228 main.go:141] libmachine: (old-k8s-version-131737) Found IP for machine: 192.168.50.99
I0828 18:12:34.136318 69228 main.go:141] libmachine: (old-k8s-version-131737) Reserving static IP address...
I0828 18:12:34.136332 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has current primary IP address 192.168.50.99 and MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:34.136640 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-131737", mac: "52:54:00:21:f1:8b", ip: "192.168.50.99"} in network mk-old-k8s-version-131737
I0828 18:12:34.219747 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | Getting to WaitForSSH function...
I0828 18:12:34.219775 69228 main.go:141] libmachine: (old-k8s-version-131737) Reserved static IP address: 192.168.50.99
I0828 18:12:34.219791 69228 main.go:141] libmachine: (old-k8s-version-131737) Waiting for SSH to be available...
I0828 18:12:34.222346 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:34.222735 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | unable to find host DHCP lease matching {name: "", mac: "52:54:00:21:f1:8b", ip: ""} in network mk-old-k8s-version-131737
I0828 18:12:34.222762 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | unable to find defined IP address of network mk-old-k8s-version-131737 interface with MAC address 52:54:00:21:f1:8b
I0828 18:12:34.222937 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | Using SSH client type: external
I0828 18:12:34.222962 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | Using SSH private key: /home/jenkins/minikube-integration/19529-10317/.minikube/machines/old-k8s-version-131737/id_rsa (-rw-------)
I0828 18:12:34.223010 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@ -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19529-10317/.minikube/machines/old-k8s-version-131737/id_rsa -p 22] /usr/bin/ssh <nil>}
I0828 18:12:34.223033 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | About to run SSH command:
I0828 18:12:34.223050 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | exit 0
I0828 18:12:34.226705 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | SSH cmd err, output: exit status 255:
I0828 18:12:34.226727 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | Error getting ssh command 'exit 0' : ssh command error:
I0828 18:12:34.226734 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | command : exit 0
I0828 18:12:34.226740 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | err : exit status 255
I0828 18:12:34.226748 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | output :
I0828 18:12:37.229027 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | Getting to WaitForSSH function...
I0828 18:12:37.231737 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:37.232105 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:21:f1:8b", ip: ""} in network mk-old-k8s-version-131737: {Iface:virbr4 ExpiryTime:2024-08-28 19:12:26 +0000 UTC Type:0 Mac:52:54:00:21:f1:8b Iaid: IPaddr:192.168.50.99 Prefix:24 Hostname:old-k8s-version-131737 Clientid:01:52:54:00:21:f1:8b}
I0828 18:12:37.232124 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined IP address 192.168.50.99 and MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:37.232287 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | Using SSH client type: external
I0828 18:12:37.232308 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | Using SSH private key: /home/jenkins/minikube-integration/19529-10317/.minikube/machines/old-k8s-version-131737/id_rsa (-rw-------)
I0828 18:12:37.232335 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.50.99 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19529-10317/.minikube/machines/old-k8s-version-131737/id_rsa -p 22] /usr/bin/ssh <nil>}
I0828 18:12:37.232348 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | About to run SSH command:
I0828 18:12:37.232365 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | exit 0
I0828 18:12:37.358043 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | SSH cmd err, output: <nil>:
I0828 18:12:37.358356 69228 main.go:141] libmachine: (old-k8s-version-131737) KVM machine creation complete!
I0828 18:12:37.358675 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetConfigRaw
I0828 18:12:37.359230 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .DriverName
I0828 18:12:37.359421 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .DriverName
I0828 18:12:37.359565 69228 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0828 18:12:37.359579 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetState
I0828 18:12:37.360869 69228 main.go:141] libmachine: Detecting operating system of created instance...
I0828 18:12:37.360882 69228 main.go:141] libmachine: Waiting for SSH to be available...
I0828 18:12:37.360887 69228 main.go:141] libmachine: Getting to WaitForSSH function...
I0828 18:12:37.360893 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetSSHHostname
I0828 18:12:37.363662 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:37.364011 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:21:f1:8b", ip: ""} in network mk-old-k8s-version-131737: {Iface:virbr4 ExpiryTime:2024-08-28 19:12:26 +0000 UTC Type:0 Mac:52:54:00:21:f1:8b Iaid: IPaddr:192.168.50.99 Prefix:24 Hostname:old-k8s-version-131737 Clientid:01:52:54:00:21:f1:8b}
I0828 18:12:37.364032 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined IP address 192.168.50.99 and MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:37.364243 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetSSHPort
I0828 18:12:37.364404 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetSSHKeyPath
I0828 18:12:37.364561 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetSSHKeyPath
I0828 18:12:37.364716 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetSSHUsername
I0828 18:12:37.364955 69228 main.go:141] libmachine: Using SSH client type: native
I0828 18:12:37.365196 69228 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.50.99 22 <nil> <nil>}
I0828 18:12:37.365207 69228 main.go:141] libmachine: About to run SSH command:
exit 0
I0828 18:12:37.461364 69228 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0828 18:12:37.461387 69228 main.go:141] libmachine: Detecting the provisioner...
I0828 18:12:37.461395 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetSSHHostname
I0828 18:12:37.464010 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:37.464404 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:21:f1:8b", ip: ""} in network mk-old-k8s-version-131737: {Iface:virbr4 ExpiryTime:2024-08-28 19:12:26 +0000 UTC Type:0 Mac:52:54:00:21:f1:8b Iaid: IPaddr:192.168.50.99 Prefix:24 Hostname:old-k8s-version-131737 Clientid:01:52:54:00:21:f1:8b}
I0828 18:12:37.464443 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined IP address 192.168.50.99 and MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:37.464671 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetSSHPort
I0828 18:12:37.464860 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetSSHKeyPath
I0828 18:12:37.465036 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetSSHKeyPath
I0828 18:12:37.465140 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetSSHUsername
I0828 18:12:37.465360 69228 main.go:141] libmachine: Using SSH client type: native
I0828 18:12:37.465575 69228 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.50.99 22 <nil> <nil>}
I0828 18:12:37.465587 69228 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0828 18:12:37.562905 69228 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0828 18:12:37.562970 69228 main.go:141] libmachine: found compatible host: buildroot
I0828 18:12:37.562977 69228 main.go:141] libmachine: Provisioning with buildroot...
I0828 18:12:37.562985 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetMachineName
I0828 18:12:37.563247 69228 buildroot.go:166] provisioning hostname "old-k8s-version-131737"
I0828 18:12:37.563290 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetMachineName
I0828 18:12:37.563544 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetSSHHostname
I0828 18:12:37.566560 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:37.567007 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:21:f1:8b", ip: ""} in network mk-old-k8s-version-131737: {Iface:virbr4 ExpiryTime:2024-08-28 19:12:26 +0000 UTC Type:0 Mac:52:54:00:21:f1:8b Iaid: IPaddr:192.168.50.99 Prefix:24 Hostname:old-k8s-version-131737 Clientid:01:52:54:00:21:f1:8b}
I0828 18:12:37.567047 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined IP address 192.168.50.99 and MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:37.567112 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetSSHPort
I0828 18:12:37.567313 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetSSHKeyPath
I0828 18:12:37.567470 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetSSHKeyPath
I0828 18:12:37.567625 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetSSHUsername
I0828 18:12:37.567829 69228 main.go:141] libmachine: Using SSH client type: native
I0828 18:12:37.568023 69228 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.50.99 22 <nil> <nil>}
I0828 18:12:37.568041 69228 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-131737 && echo "old-k8s-version-131737" | sudo tee /etc/hostname
I0828 18:12:37.677905 69228 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-131737
I0828 18:12:37.677939 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetSSHHostname
I0828 18:12:37.680729 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:37.681054 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:21:f1:8b", ip: ""} in network mk-old-k8s-version-131737: {Iface:virbr4 ExpiryTime:2024-08-28 19:12:26 +0000 UTC Type:0 Mac:52:54:00:21:f1:8b Iaid: IPaddr:192.168.50.99 Prefix:24 Hostname:old-k8s-version-131737 Clientid:01:52:54:00:21:f1:8b}
I0828 18:12:37.681083 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined IP address 192.168.50.99 and MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:37.681241 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetSSHPort
I0828 18:12:37.681440 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetSSHKeyPath
I0828 18:12:37.681650 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetSSHKeyPath
I0828 18:12:37.681821 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetSSHUsername
I0828 18:12:37.682002 69228 main.go:141] libmachine: Using SSH client type: native
I0828 18:12:37.682206 69228 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.50.99 22 <nil> <nil>}
I0828 18:12:37.682224 69228 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-131737' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-131737/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-131737' | sudo tee -a /etc/hosts;
fi
fi
I0828 18:12:37.786501 69228 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0828 18:12:37.786534 69228 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19529-10317/.minikube CaCertPath:/home/jenkins/minikube-integration/19529-10317/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19529-10317/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19529-10317/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19529-10317/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19529-10317/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19529-10317/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19529-10317/.minikube}
I0828 18:12:37.786557 69228 buildroot.go:174] setting up certificates
I0828 18:12:37.786569 69228 provision.go:84] configureAuth start
I0828 18:12:37.786578 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetMachineName
I0828 18:12:37.786924 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetIP
I0828 18:12:37.789393 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:37.789819 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:21:f1:8b", ip: ""} in network mk-old-k8s-version-131737: {Iface:virbr4 ExpiryTime:2024-08-28 19:12:26 +0000 UTC Type:0 Mac:52:54:00:21:f1:8b Iaid: IPaddr:192.168.50.99 Prefix:24 Hostname:old-k8s-version-131737 Clientid:01:52:54:00:21:f1:8b}
I0828 18:12:37.789853 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined IP address 192.168.50.99 and MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:37.789939 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetSSHHostname
I0828 18:12:37.792445 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:37.792819 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:21:f1:8b", ip: ""} in network mk-old-k8s-version-131737: {Iface:virbr4 ExpiryTime:2024-08-28 19:12:26 +0000 UTC Type:0 Mac:52:54:00:21:f1:8b Iaid: IPaddr:192.168.50.99 Prefix:24 Hostname:old-k8s-version-131737 Clientid:01:52:54:00:21:f1:8b}
I0828 18:12:37.792852 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined IP address 192.168.50.99 and MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:37.792928 69228 provision.go:143] copyHostCerts
I0828 18:12:37.792982 69228 exec_runner.go:144] found /home/jenkins/minikube-integration/19529-10317/.minikube/cert.pem, removing ...
I0828 18:12:37.792997 69228 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19529-10317/.minikube/cert.pem
I0828 18:12:37.793055 69228 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19529-10317/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19529-10317/.minikube/cert.pem (1123 bytes)
I0828 18:12:37.793155 69228 exec_runner.go:144] found /home/jenkins/minikube-integration/19529-10317/.minikube/key.pem, removing ...
I0828 18:12:37.793162 69228 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19529-10317/.minikube/key.pem
I0828 18:12:37.793188 69228 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19529-10317/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19529-10317/.minikube/key.pem (1679 bytes)
I0828 18:12:37.793291 69228 exec_runner.go:144] found /home/jenkins/minikube-integration/19529-10317/.minikube/ca.pem, removing ...
I0828 18:12:37.793302 69228 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19529-10317/.minikube/ca.pem
I0828 18:12:37.793324 69228 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19529-10317/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19529-10317/.minikube/ca.pem (1078 bytes)
I0828 18:12:37.793378 69228 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19529-10317/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19529-10317/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19529-10317/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-131737 san=[127.0.0.1 192.168.50.99 localhost minikube old-k8s-version-131737]
I0828 18:12:38.041239 69228 provision.go:177] copyRemoteCerts
I0828 18:12:38.041292 69228 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0828 18:12:38.041315 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetSSHHostname
I0828 18:12:38.043650 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:38.043941 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:21:f1:8b", ip: ""} in network mk-old-k8s-version-131737: {Iface:virbr4 ExpiryTime:2024-08-28 19:12:26 +0000 UTC Type:0 Mac:52:54:00:21:f1:8b Iaid: IPaddr:192.168.50.99 Prefix:24 Hostname:old-k8s-version-131737 Clientid:01:52:54:00:21:f1:8b}
I0828 18:12:38.043971 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined IP address 192.168.50.99 and MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:38.044075 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetSSHPort
I0828 18:12:38.044255 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetSSHKeyPath
I0828 18:12:38.044393 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetSSHUsername
I0828 18:12:38.044533 69228 sshutil.go:53] new ssh client: &{IP:192.168.50.99 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19529-10317/.minikube/machines/old-k8s-version-131737/id_rsa Username:docker}
I0828 18:12:38.124760 69228 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19529-10317/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0828 18:12:38.148289 69228 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19529-10317/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0828 18:12:38.169987 69228 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19529-10317/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0828 18:12:38.191579 69228 provision.go:87] duration metric: took 404.997348ms to configureAuth
I0828 18:12:38.191614 69228 buildroot.go:189] setting minikube options for container-runtime
I0828 18:12:38.191821 69228 config.go:182] Loaded profile config "old-k8s-version-131737": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0828 18:12:38.191908 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetSSHHostname
I0828 18:12:38.194501 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:38.194841 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:21:f1:8b", ip: ""} in network mk-old-k8s-version-131737: {Iface:virbr4 ExpiryTime:2024-08-28 19:12:26 +0000 UTC Type:0 Mac:52:54:00:21:f1:8b Iaid: IPaddr:192.168.50.99 Prefix:24 Hostname:old-k8s-version-131737 Clientid:01:52:54:00:21:f1:8b}
I0828 18:12:38.194862 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined IP address 192.168.50.99 and MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:38.195061 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetSSHPort
I0828 18:12:38.195277 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetSSHKeyPath
I0828 18:12:38.195460 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetSSHKeyPath
I0828 18:12:38.195627 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetSSHUsername
I0828 18:12:38.195835 69228 main.go:141] libmachine: Using SSH client type: native
I0828 18:12:38.196024 69228 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.50.99 22 <nil> <nil>}
I0828 18:12:38.196043 69228 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0828 18:12:38.419560 69228 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0828 18:12:38.419585 69228 main.go:141] libmachine: Checking connection to Docker...
I0828 18:12:38.419593 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetURL
I0828 18:12:38.420938 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | Using libvirt version 6000000
I0828 18:12:38.423540 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:38.423949 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:21:f1:8b", ip: ""} in network mk-old-k8s-version-131737: {Iface:virbr4 ExpiryTime:2024-08-28 19:12:26 +0000 UTC Type:0 Mac:52:54:00:21:f1:8b Iaid: IPaddr:192.168.50.99 Prefix:24 Hostname:old-k8s-version-131737 Clientid:01:52:54:00:21:f1:8b}
I0828 18:12:38.423979 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined IP address 192.168.50.99 and MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:38.424150 69228 main.go:141] libmachine: Docker is up and running!
I0828 18:12:38.424168 69228 main.go:141] libmachine: Reticulating splines...
I0828 18:12:38.424186 69228 client.go:171] duration metric: took 28.729926888s to LocalClient.Create
I0828 18:12:38.424220 69228 start.go:167] duration metric: took 28.730009867s to libmachine.API.Create "old-k8s-version-131737"
I0828 18:12:38.424246 69228 start.go:293] postStartSetup for "old-k8s-version-131737" (driver="kvm2")
I0828 18:12:38.424262 69228 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0828 18:12:38.424286 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .DriverName
I0828 18:12:38.424511 69228 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0828 18:12:38.424537 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetSSHHostname
I0828 18:12:38.426950 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:38.427262 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:21:f1:8b", ip: ""} in network mk-old-k8s-version-131737: {Iface:virbr4 ExpiryTime:2024-08-28 19:12:26 +0000 UTC Type:0 Mac:52:54:00:21:f1:8b Iaid: IPaddr:192.168.50.99 Prefix:24 Hostname:old-k8s-version-131737 Clientid:01:52:54:00:21:f1:8b}
I0828 18:12:38.427290 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined IP address 192.168.50.99 and MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:38.427445 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetSSHPort
I0828 18:12:38.427610 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetSSHKeyPath
I0828 18:12:38.427807 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetSSHUsername
I0828 18:12:38.427949 69228 sshutil.go:53] new ssh client: &{IP:192.168.50.99 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19529-10317/.minikube/machines/old-k8s-version-131737/id_rsa Username:docker}
I0828 18:12:38.508167 69228 ssh_runner.go:195] Run: cat /etc/os-release
I0828 18:12:38.512049 69228 info.go:137] Remote host: Buildroot 2023.02.9
I0828 18:12:38.512074 69228 filesync.go:126] Scanning /home/jenkins/minikube-integration/19529-10317/.minikube/addons for local assets ...
I0828 18:12:38.512146 69228 filesync.go:126] Scanning /home/jenkins/minikube-integration/19529-10317/.minikube/files for local assets ...
I0828 18:12:38.512235 69228 filesync.go:149] local asset: /home/jenkins/minikube-integration/19529-10317/.minikube/files/etc/ssl/certs/175282.pem -> 175282.pem in /etc/ssl/certs
I0828 18:12:38.512324 69228 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0828 18:12:38.521305 69228 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19529-10317/.minikube/files/etc/ssl/certs/175282.pem --> /etc/ssl/certs/175282.pem (1708 bytes)
I0828 18:12:38.544111 69228 start.go:296] duration metric: took 119.848711ms for postStartSetup
I0828 18:12:38.544211 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetConfigRaw
I0828 18:12:38.544828 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetIP
I0828 18:12:38.547350 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:38.547760 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:21:f1:8b", ip: ""} in network mk-old-k8s-version-131737: {Iface:virbr4 ExpiryTime:2024-08-28 19:12:26 +0000 UTC Type:0 Mac:52:54:00:21:f1:8b Iaid: IPaddr:192.168.50.99 Prefix:24 Hostname:old-k8s-version-131737 Clientid:01:52:54:00:21:f1:8b}
I0828 18:12:38.547787 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined IP address 192.168.50.99 and MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:38.548045 69228 profile.go:143] Saving config to /home/jenkins/minikube-integration/19529-10317/.minikube/profiles/old-k8s-version-131737/config.json ...
I0828 18:12:38.548248 69228 start.go:128] duration metric: took 28.965258698s to createHost
I0828 18:12:38.548272 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetSSHHostname
I0828 18:12:38.550430 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:38.550730 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:21:f1:8b", ip: ""} in network mk-old-k8s-version-131737: {Iface:virbr4 ExpiryTime:2024-08-28 19:12:26 +0000 UTC Type:0 Mac:52:54:00:21:f1:8b Iaid: IPaddr:192.168.50.99 Prefix:24 Hostname:old-k8s-version-131737 Clientid:01:52:54:00:21:f1:8b}
I0828 18:12:38.550759 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined IP address 192.168.50.99 and MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:38.550972 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetSSHPort
I0828 18:12:38.551177 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetSSHKeyPath
I0828 18:12:38.551332 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetSSHKeyPath
I0828 18:12:38.551517 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetSSHUsername
I0828 18:12:38.551688 69228 main.go:141] libmachine: Using SSH client type: native
I0828 18:12:38.551848 69228 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.50.99 22 <nil> <nil>}
I0828 18:12:38.551858 69228 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0828 18:12:38.650391 69228 main.go:141] libmachine: SSH cmd err, output: <nil>: 1724868758.627265876
I0828 18:12:38.650413 69228 fix.go:216] guest clock: 1724868758.627265876
I0828 18:12:38.650422 69228 fix.go:229] Guest: 2024-08-28 18:12:38.627265876 +0000 UTC Remote: 2024-08-28 18:12:38.548260777 +0000 UTC m=+57.572068803 (delta=79.005099ms)
I0828 18:12:38.650446 69228 fix.go:200] guest clock delta is within tolerance: 79.005099ms
I0828 18:12:38.650454 69228 start.go:83] releasing machines lock for "old-k8s-version-131737", held for 29.067674086s
I0828 18:12:38.650485 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .DriverName
I0828 18:12:38.650778 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetIP
I0828 18:12:38.653416 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:38.653806 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:21:f1:8b", ip: ""} in network mk-old-k8s-version-131737: {Iface:virbr4 ExpiryTime:2024-08-28 19:12:26 +0000 UTC Type:0 Mac:52:54:00:21:f1:8b Iaid: IPaddr:192.168.50.99 Prefix:24 Hostname:old-k8s-version-131737 Clientid:01:52:54:00:21:f1:8b}
I0828 18:12:38.653836 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined IP address 192.168.50.99 and MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:38.654158 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .DriverName
I0828 18:12:38.654754 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .DriverName
I0828 18:12:38.654961 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .DriverName
I0828 18:12:38.655072 69228 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0828 18:12:38.655123 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetSSHHostname
I0828 18:12:38.655168 69228 ssh_runner.go:195] Run: cat /version.json
I0828 18:12:38.655183 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetSSHHostname
I0828 18:12:38.657780 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:38.657966 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:38.658193 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:21:f1:8b", ip: ""} in network mk-old-k8s-version-131737: {Iface:virbr4 ExpiryTime:2024-08-28 19:12:26 +0000 UTC Type:0 Mac:52:54:00:21:f1:8b Iaid: IPaddr:192.168.50.99 Prefix:24 Hostname:old-k8s-version-131737 Clientid:01:52:54:00:21:f1:8b}
I0828 18:12:38.658221 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined IP address 192.168.50.99 and MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:38.658380 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetSSHPort
I0828 18:12:38.658448 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:21:f1:8b", ip: ""} in network mk-old-k8s-version-131737: {Iface:virbr4 ExpiryTime:2024-08-28 19:12:26 +0000 UTC Type:0 Mac:52:54:00:21:f1:8b Iaid: IPaddr:192.168.50.99 Prefix:24 Hostname:old-k8s-version-131737 Clientid:01:52:54:00:21:f1:8b}
I0828 18:12:38.658508 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined IP address 192.168.50.99 and MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:38.658553 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetSSHKeyPath
I0828 18:12:38.658641 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetSSHPort
I0828 18:12:38.658741 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetSSHUsername
I0828 18:12:38.658825 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetSSHKeyPath
I0828 18:12:38.658888 69228 sshutil.go:53] new ssh client: &{IP:192.168.50.99 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19529-10317/.minikube/machines/old-k8s-version-131737/id_rsa Username:docker}
I0828 18:12:38.658951 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetSSHUsername
I0828 18:12:38.659054 69228 sshutil.go:53] new ssh client: &{IP:192.168.50.99 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19529-10317/.minikube/machines/old-k8s-version-131737/id_rsa Username:docker}
I0828 18:12:38.772415 69228 ssh_runner.go:195] Run: systemctl --version
I0828 18:12:38.778317 69228 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0828 18:12:38.933661 69228 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0828 18:12:38.939783 69228 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0828 18:12:38.939843 69228 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0828 18:12:38.958983 69228 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0828 18:12:38.959015 69228 start.go:495] detecting cgroup driver to use...
I0828 18:12:38.959089 69228 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0828 18:12:38.976260 69228 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0828 18:12:38.992207 69228 docker.go:217] disabling cri-docker service (if available) ...
I0828 18:12:38.992263 69228 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0828 18:12:39.011121 69228 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0828 18:12:39.027853 69228 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0828 18:12:39.159758 69228 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0828 18:12:39.300741 69228 docker.go:233] disabling docker service ...
I0828 18:12:39.300816 69228 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0828 18:12:39.315787 69228 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0828 18:12:39.327824 69228 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0828 18:12:39.477468 69228 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0828 18:12:39.600913 69228 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0828 18:12:39.614961 69228 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0828 18:12:39.632413 69228 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0828 18:12:39.632469 69228 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0828 18:12:39.643396 69228 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0828 18:12:39.643464 69228 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0828 18:12:39.654024 69228 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0828 18:12:39.664152 69228 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0828 18:12:39.674153 69228 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0828 18:12:39.684687 69228 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0828 18:12:39.694153 69228 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0828 18:12:39.694228 69228 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0828 18:12:39.707753 69228 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0828 18:12:39.718616 69228 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0828 18:12:39.855755 69228 ssh_runner.go:195] Run: sudo systemctl restart crio
I0828 18:12:39.962377 69228 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0828 18:12:39.962459 69228 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0828 18:12:39.967624 69228 start.go:563] Will wait 60s for crictl version
I0828 18:12:39.967695 69228 ssh_runner.go:195] Run: which crictl
I0828 18:12:39.971275 69228 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0828 18:12:40.010517 69228 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0828 18:12:40.010600 69228 ssh_runner.go:195] Run: crio --version
I0828 18:12:40.039650 69228 ssh_runner.go:195] Run: crio --version
I0828 18:12:40.076662 69228 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0828 18:12:40.077699 69228 main.go:141] libmachine: (old-k8s-version-131737) Calling .GetIP
I0828 18:12:40.080636 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:40.081002 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:21:f1:8b", ip: ""} in network mk-old-k8s-version-131737: {Iface:virbr4 ExpiryTime:2024-08-28 19:12:26 +0000 UTC Type:0 Mac:52:54:00:21:f1:8b Iaid: IPaddr:192.168.50.99 Prefix:24 Hostname:old-k8s-version-131737 Clientid:01:52:54:00:21:f1:8b}
I0828 18:12:40.081036 69228 main.go:141] libmachine: (old-k8s-version-131737) DBG | domain old-k8s-version-131737 has defined IP address 192.168.50.99 and MAC address 52:54:00:21:f1:8b in network mk-old-k8s-version-131737
I0828 18:12:40.081244 69228 ssh_runner.go:195] Run: grep 192.168.50.1 host.minikube.internal$ /etc/hosts
I0828 18:12:40.085443 69228 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.50.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0828 18:12:40.097472 69228 kubeadm.go:883] updating cluster {Name:old-k8s-version-131737 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19521/minikube-v1.33.1-1724775098-19521-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-131737 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.99 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mo
untPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0828 18:12:40.097596 69228 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0828 18:12:40.097641 69228 ssh_runner.go:195] Run: sudo crictl images --output json
I0828 18:12:40.126899 69228 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0828 18:12:40.126990 69228 ssh_runner.go:195] Run: which lz4
I0828 18:12:40.130806 69228 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0828 18:12:40.134979 69228 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0828 18:12:40.135013 69228 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19529-10317/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0828 18:12:41.699678 69228 crio.go:462] duration metric: took 1.568907378s to copy over tarball
I0828 18:12:41.699776 69228 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0828 18:12:44.579371 69228 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.879559147s)
I0828 18:12:44.579402 69228 crio.go:469] duration metric: took 2.879690624s to extract the tarball
I0828 18:12:44.579413 69228 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0828 18:12:44.624043 69228 ssh_runner.go:195] Run: sudo crictl images --output json
I0828 18:12:44.671292 69228 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0828 18:12:44.671315 69228 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0828 18:12:44.671405 69228 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0828 18:12:44.671693 69228 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0828 18:12:44.671719 69228 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0828 18:12:44.671847 69228 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0828 18:12:44.671895 69228 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0828 18:12:44.671966 69228 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0828 18:12:44.672019 69228 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0828 18:12:44.671698 69228 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0828 18:12:44.673055 69228 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0828 18:12:44.673152 69228 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0828 18:12:44.673173 69228 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0828 18:12:44.673218 69228 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0828 18:12:44.673235 69228 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0828 18:12:44.673297 69228 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0828 18:12:44.673295 69228 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0828 18:12:44.673061 69228 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0828 18:12:44.886810 69228 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0828 18:12:44.928999 69228 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0828 18:12:44.929051 69228 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0828 18:12:44.929110 69228 ssh_runner.go:195] Run: which crictl
I0828 18:12:44.930869 69228 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0828 18:12:44.933320 69228 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0828 18:12:44.958750 69228 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0828 18:12:44.965116 69228 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0828 18:12:44.974573 69228 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0828 18:12:45.006498 69228 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0828 18:12:45.006549 69228 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0828 18:12:45.006604 69228 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0828 18:12:45.006611 69228 ssh_runner.go:195] Run: which crictl
I0828 18:12:45.013898 69228 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0828 18:12:45.024864 69228 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0828 18:12:45.045462 69228 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0828 18:12:45.045513 69228 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0828 18:12:45.045569 69228 ssh_runner.go:195] Run: which crictl
I0828 18:12:45.078037 69228 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0828 18:12:45.078099 69228 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0828 18:12:45.078157 69228 ssh_runner.go:195] Run: which crictl
I0828 18:12:45.130766 69228 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0828 18:12:45.130815 69228 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0828 18:12:45.130866 69228 ssh_runner.go:195] Run: which crictl
I0828 18:12:45.136101 69228 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0828 18:12:45.136114 69228 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0828 18:12:45.150526 69228 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0828 18:12:45.150577 69228 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0828 18:12:45.150583 69228 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0828 18:12:45.150618 69228 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0828 18:12:45.150628 69228 ssh_runner.go:195] Run: which crictl
I0828 18:12:45.150663 69228 ssh_runner.go:195] Run: which crictl
I0828 18:12:45.150724 69228 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0828 18:12:45.150769 69228 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0828 18:12:45.150804 69228 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0828 18:12:45.248891 69228 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19529-10317/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0828 18:12:45.248932 69228 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0828 18:12:45.248995 69228 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0828 18:12:45.249000 69228 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0828 18:12:45.279160 69228 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0828 18:12:45.279193 69228 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0828 18:12:45.279285 69228 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0828 18:12:45.352876 69228 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0828 18:12:45.382481 69228 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0828 18:12:45.382500 69228 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0828 18:12:45.412718 69228 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0828 18:12:45.412788 69228 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0828 18:12:45.412815 69228 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0828 18:12:45.453214 69228 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0828 18:12:45.492743 69228 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19529-10317/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0828 18:12:45.517610 69228 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19529-10317/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0828 18:12:45.562269 69228 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19529-10317/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0828 18:12:45.562344 69228 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0828 18:12:45.562401 69228 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19529-10317/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0828 18:12:45.574603 69228 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19529-10317/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0828 18:12:45.597843 69228 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19529-10317/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0828 18:12:45.890858 69228 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0828 18:12:46.039990 69228 cache_images.go:92] duration metric: took 1.368656386s to LoadCachedImages
W0828 18:12:46.040091 69228 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19529-10317/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19529-10317/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0: no such file or directory
I0828 18:12:46.040109 69228 kubeadm.go:934] updating node { 192.168.50.99 8443 v1.20.0 crio true true} ...
I0828 18:12:46.040216 69228 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-131737 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.50.99
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-131737 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0828 18:12:46.040305 69228 ssh_runner.go:195] Run: crio config
I0828 18:12:46.089096 69228 cni.go:84] Creating CNI manager for ""
I0828 18:12:46.089118 69228 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0828 18:12:46.089129 69228 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0828 18:12:46.089150 69228 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.50.99 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-131737 NodeName:old-k8s-version-131737 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.50.99"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.50.99 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Stati
cPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0828 18:12:46.089305 69228 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.50.99
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-131737"
kubeletExtraArgs:
node-ip: 192.168.50.99
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.50.99"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0828 18:12:46.089386 69228 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0828 18:12:46.099493 69228 binaries.go:44] Found k8s binaries, skipping transfer
I0828 18:12:46.099575 69228 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0828 18:12:46.109152 69228 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (429 bytes)
I0828 18:12:46.127330 69228 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0828 18:12:46.143060 69228 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2120 bytes)
I0828 18:12:46.164864 69228 ssh_runner.go:195] Run: grep 192.168.50.99 control-plane.minikube.internal$ /etc/hosts
I0828 18:12:46.170162 69228 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.50.99 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0828 18:12:46.188767 69228 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0828 18:12:46.321177 69228 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0828 18:12:46.338205 69228 certs.go:68] Setting up /home/jenkins/minikube-integration/19529-10317/.minikube/profiles/old-k8s-version-131737 for IP: 192.168.50.99
I0828 18:12:46.338228 69228 certs.go:194] generating shared ca certs ...
I0828 18:12:46.338255 69228 certs.go:226] acquiring lock for ca certs: {Name:mkc0e22a5e4d8db098e67aefc1e015c59c483faf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0828 18:12:46.338432 69228 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19529-10317/.minikube/ca.key
I0828 18:12:46.338490 69228 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19529-10317/.minikube/proxy-client-ca.key
I0828 18:12:46.338504 69228 certs.go:256] generating profile certs ...
I0828 18:12:46.338572 69228 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19529-10317/.minikube/profiles/old-k8s-version-131737/client.key
I0828 18:12:46.338589 69228 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19529-10317/.minikube/profiles/old-k8s-version-131737/client.crt with IP's: []
I0828 18:12:46.458906 69228 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19529-10317/.minikube/profiles/old-k8s-version-131737/client.crt ...
I0828 18:12:46.458946 69228 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19529-10317/.minikube/profiles/old-k8s-version-131737/client.crt: {Name:mk5a2b88dd3316ea18a94f40a6b562e755e93eb8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0828 18:12:46.459167 69228 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19529-10317/.minikube/profiles/old-k8s-version-131737/client.key ...
I0828 18:12:46.459191 69228 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19529-10317/.minikube/profiles/old-k8s-version-131737/client.key: {Name:mk31fa0c002e762f00dd3919cf0f8a4bf7070310 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0828 18:12:46.459308 69228 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19529-10317/.minikube/profiles/old-k8s-version-131737/apiserver.key.131f8aa0
I0828 18:12:46.459332 69228 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19529-10317/.minikube/profiles/old-k8s-version-131737/apiserver.crt.131f8aa0 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.50.99]
I0828 18:12:46.660180 69228 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19529-10317/.minikube/profiles/old-k8s-version-131737/apiserver.crt.131f8aa0 ...
I0828 18:12:46.660208 69228 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19529-10317/.minikube/profiles/old-k8s-version-131737/apiserver.crt.131f8aa0: {Name:mk5a98aab293c282baaca80dc3bd4fafb1217c86 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0828 18:12:46.660394 69228 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19529-10317/.minikube/profiles/old-k8s-version-131737/apiserver.key.131f8aa0 ...
I0828 18:12:46.660416 69228 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19529-10317/.minikube/profiles/old-k8s-version-131737/apiserver.key.131f8aa0: {Name:mkc879acb3b8e1cbbfee13b68880c8b27233d735 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0828 18:12:46.660511 69228 certs.go:381] copying /home/jenkins/minikube-integration/19529-10317/.minikube/profiles/old-k8s-version-131737/apiserver.crt.131f8aa0 -> /home/jenkins/minikube-integration/19529-10317/.minikube/profiles/old-k8s-version-131737/apiserver.crt
I0828 18:12:46.660618 69228 certs.go:385] copying /home/jenkins/minikube-integration/19529-10317/.minikube/profiles/old-k8s-version-131737/apiserver.key.131f8aa0 -> /home/jenkins/minikube-integration/19529-10317/.minikube/profiles/old-k8s-version-131737/apiserver.key
I0828 18:12:46.660716 69228 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19529-10317/.minikube/profiles/old-k8s-version-131737/proxy-client.key
I0828 18:12:46.660738 69228 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19529-10317/.minikube/profiles/old-k8s-version-131737/proxy-client.crt with IP's: []
I0828 18:12:46.891608 69228 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19529-10317/.minikube/profiles/old-k8s-version-131737/proxy-client.crt ...
I0828 18:12:46.891643 69228 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19529-10317/.minikube/profiles/old-k8s-version-131737/proxy-client.crt: {Name:mkfeee50d742c3d76b55584377cb836c90c77f9c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0828 18:12:46.891816 69228 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19529-10317/.minikube/profiles/old-k8s-version-131737/proxy-client.key ...
I0828 18:12:46.891831 69228 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19529-10317/.minikube/profiles/old-k8s-version-131737/proxy-client.key: {Name:mkb02b9ec205644f3afcfabd10340f515b567540 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0828 18:12:46.891993 69228 certs.go:484] found cert: /home/jenkins/minikube-integration/19529-10317/.minikube/certs/17528.pem (1338 bytes)
W0828 18:12:46.892030 69228 certs.go:480] ignoring /home/jenkins/minikube-integration/19529-10317/.minikube/certs/17528_empty.pem, impossibly tiny 0 bytes
I0828 18:12:46.892040 69228 certs.go:484] found cert: /home/jenkins/minikube-integration/19529-10317/.minikube/certs/ca-key.pem (1675 bytes)
I0828 18:12:46.892061 69228 certs.go:484] found cert: /home/jenkins/minikube-integration/19529-10317/.minikube/certs/ca.pem (1078 bytes)
I0828 18:12:46.892084 69228 certs.go:484] found cert: /home/jenkins/minikube-integration/19529-10317/.minikube/certs/cert.pem (1123 bytes)
I0828 18:12:46.892105 69228 certs.go:484] found cert: /home/jenkins/minikube-integration/19529-10317/.minikube/certs/key.pem (1679 bytes)
I0828 18:12:46.892147 69228 certs.go:484] found cert: /home/jenkins/minikube-integration/19529-10317/.minikube/files/etc/ssl/certs/175282.pem (1708 bytes)
I0828 18:12:46.892721 69228 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19529-10317/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0828 18:12:46.920315 69228 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19529-10317/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0828 18:12:46.945612 69228 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19529-10317/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0828 18:12:46.972901 69228 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19529-10317/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0828 18:12:46.997308 69228 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19529-10317/.minikube/profiles/old-k8s-version-131737/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0828 18:12:47.027523 69228 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19529-10317/.minikube/profiles/old-k8s-version-131737/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0828 18:12:47.055549 69228 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19529-10317/.minikube/profiles/old-k8s-version-131737/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0828 18:12:47.080872 69228 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19529-10317/.minikube/profiles/old-k8s-version-131737/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0828 18:12:47.105078 69228 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19529-10317/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0828 18:12:47.128925 69228 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19529-10317/.minikube/certs/17528.pem --> /usr/share/ca-certificates/17528.pem (1338 bytes)
I0828 18:12:47.154974 69228 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19529-10317/.minikube/files/etc/ssl/certs/175282.pem --> /usr/share/ca-certificates/175282.pem (1708 bytes)
I0828 18:12:47.178153 69228 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0828 18:12:47.194482 69228 ssh_runner.go:195] Run: openssl version
I0828 18:12:47.200034 69228 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0828 18:12:47.212947 69228 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0828 18:12:47.217505 69228 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug 28 16:52 /usr/share/ca-certificates/minikubeCA.pem
I0828 18:12:47.217583 69228 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0828 18:12:47.223559 69228 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0828 18:12:47.234593 69228 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/17528.pem && ln -fs /usr/share/ca-certificates/17528.pem /etc/ssl/certs/17528.pem"
I0828 18:12:47.250934 69228 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/17528.pem
I0828 18:12:47.256800 69228 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug 28 17:10 /usr/share/ca-certificates/17528.pem
I0828 18:12:47.256868 69228 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/17528.pem
I0828 18:12:47.265163 69228 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/17528.pem /etc/ssl/certs/51391683.0"
I0828 18:12:47.277803 69228 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/175282.pem && ln -fs /usr/share/ca-certificates/175282.pem /etc/ssl/certs/175282.pem"
I0828 18:12:47.290232 69228 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/175282.pem
I0828 18:12:47.294938 69228 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug 28 17:10 /usr/share/ca-certificates/175282.pem
I0828 18:12:47.295008 69228 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/175282.pem
I0828 18:12:47.303214 69228 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/175282.pem /etc/ssl/certs/3ec20f2e.0"
I0828 18:12:47.316358 69228 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0828 18:12:47.320654 69228 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0828 18:12:47.320714 69228 kubeadm.go:392] StartCluster: {Name:old-k8s-version-131737 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19521/minikube-v1.33.1-1724775098-19521-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-131737 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.99 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0828 18:12:47.320806 69228 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0828 18:12:47.320890 69228 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0828 18:12:47.363749 69228 cri.go:89] found id: ""
I0828 18:12:47.363822 69228 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0828 18:12:47.374523 69228 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0828 18:12:47.384186 69228 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0828 18:12:47.393753 69228 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0828 18:12:47.393777 69228 kubeadm.go:157] found existing configuration files:
I0828 18:12:47.393829 69228 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0828 18:12:47.402962 69228 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0828 18:12:47.403033 69228 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0828 18:12:47.412707 69228 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0828 18:12:47.422836 69228 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0828 18:12:47.422900 69228 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0828 18:12:47.433398 69228 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0828 18:12:47.444425 69228 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0828 18:12:47.444501 69228 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0828 18:12:47.455276 69228 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0828 18:12:47.466453 69228 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0828 18:12:47.466516 69228 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0828 18:12:47.477011 69228 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0828 18:12:47.591736 69228 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0828 18:12:47.591806 69228 kubeadm.go:310] [preflight] Running pre-flight checks
I0828 18:12:47.731650 69228 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0828 18:12:47.731821 69228 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0828 18:12:47.731970 69228 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0828 18:12:47.929516 69228 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0828 18:12:47.931803 69228 out.go:235] - Generating certificates and keys ...
I0828 18:12:47.931912 69228 kubeadm.go:310] [certs] Using existing ca certificate authority
I0828 18:12:47.931990 69228 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0828 18:12:48.114906 69228 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0828 18:12:48.242868 69228 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0828 18:12:48.479147 69228 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0828 18:12:48.643983 69228 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0828 18:12:48.983223 69228 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0828 18:12:48.983436 69228 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-131737] and IPs [192.168.50.99 127.0.0.1 ::1]
I0828 18:12:49.631814 69228 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0828 18:12:49.632052 69228 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-131737] and IPs [192.168.50.99 127.0.0.1 ::1]
I0828 18:12:49.865713 69228 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0828 18:12:50.082842 69228 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0828 18:12:50.173497 69228 kubeadm.go:310] [certs] Generating "sa" key and public key
I0828 18:12:50.173602 69228 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0828 18:12:50.334241 69228 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0828 18:12:50.626954 69228 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0828 18:12:50.716403 69228 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0828 18:12:50.801112 69228 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0828 18:12:50.817297 69228 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0828 18:12:50.819025 69228 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0828 18:12:50.819097 69228 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0828 18:12:50.957084 69228 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0828 18:12:50.958773 69228 out.go:235] - Booting up control plane ...
I0828 18:12:50.958910 69228 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0828 18:12:50.963591 69228 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0828 18:12:50.964956 69228 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0828 18:12:50.966298 69228 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0828 18:12:50.972701 69228 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0828 18:13:30.969560 69228 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0828 18:13:30.970166 69228 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0828 18:13:30.970390 69228 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0828 18:13:35.971761 69228 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0828 18:13:35.971984 69228 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0828 18:13:45.970292 69228 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0828 18:13:45.970569 69228 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0828 18:14:05.970030 69228 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0828 18:14:05.970348 69228 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0828 18:14:45.971677 69228 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0828 18:14:45.971877 69228 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0828 18:14:45.971908 69228 kubeadm.go:310]
I0828 18:14:45.971988 69228 kubeadm.go:310] Unfortunately, an error has occurred:
I0828 18:14:45.972054 69228 kubeadm.go:310] timed out waiting for the condition
I0828 18:14:45.972075 69228 kubeadm.go:310]
I0828 18:14:45.972134 69228 kubeadm.go:310] This error is likely caused by:
I0828 18:14:45.972171 69228 kubeadm.go:310] - The kubelet is not running
I0828 18:14:45.972305 69228 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0828 18:14:45.972317 69228 kubeadm.go:310]
I0828 18:14:45.972494 69228 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0828 18:14:45.972557 69228 kubeadm.go:310] - 'systemctl status kubelet'
I0828 18:14:45.972593 69228 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0828 18:14:45.972600 69228 kubeadm.go:310]
I0828 18:14:45.972727 69228 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0828 18:14:45.972837 69228 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0828 18:14:45.972857 69228 kubeadm.go:310]
I0828 18:14:45.972949 69228 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0828 18:14:45.973024 69228 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0828 18:14:45.973162 69228 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0828 18:14:45.973282 69228 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0828 18:14:45.973302 69228 kubeadm.go:310]
I0828 18:14:45.974012 69228 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0828 18:14:45.974173 69228 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0828 18:14:45.974335 69228 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
W0828 18:14:45.974380 69228 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-131737] and IPs [192.168.50.99 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-131737] and IPs [192.168.50.99 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-131737] and IPs [192.168.50.99 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-131737] and IPs [192.168.50.99 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0828 18:14:45.974425 69228 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0828 18:14:46.430384 69228 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0828 18:14:46.443967 69228 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0828 18:14:46.453342 69228 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0828 18:14:46.453369 69228 kubeadm.go:157] found existing configuration files:
I0828 18:14:46.453415 69228 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0828 18:14:46.461867 69228 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0828 18:14:46.461934 69228 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0828 18:14:46.470934 69228 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0828 18:14:46.479394 69228 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0828 18:14:46.479464 69228 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0828 18:14:46.488209 69228 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0828 18:14:46.496575 69228 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0828 18:14:46.496654 69228 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0828 18:14:46.505136 69228 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0828 18:14:46.513524 69228 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0828 18:14:46.513586 69228 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0828 18:14:46.522765 69228 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0828 18:14:46.586063 69228 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0828 18:14:46.586163 69228 kubeadm.go:310] [preflight] Running pre-flight checks
I0828 18:14:46.717154 69228 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0828 18:14:46.717308 69228 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0828 18:14:46.717464 69228 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0828 18:14:46.887272 69228 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0828 18:14:46.889256 69228 out.go:235] - Generating certificates and keys ...
I0828 18:14:46.889418 69228 kubeadm.go:310] [certs] Using existing ca certificate authority
I0828 18:14:46.889564 69228 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0828 18:14:46.889740 69228 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0828 18:14:46.889943 69228 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0828 18:14:46.890123 69228 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0828 18:14:46.890257 69228 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0828 18:14:46.890776 69228 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0828 18:14:46.890884 69228 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0828 18:14:46.890989 69228 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0828 18:14:46.891114 69228 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0828 18:14:46.891186 69228 kubeadm.go:310] [certs] Using the existing "sa" key
I0828 18:14:46.891281 69228 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0828 18:14:47.224498 69228 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0828 18:14:47.296280 69228 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0828 18:14:47.634545 69228 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0828 18:14:48.088159 69228 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0828 18:14:48.107486 69228 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0828 18:14:48.108453 69228 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0828 18:14:48.108541 69228 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0828 18:14:48.244682 69228 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0828 18:14:48.246846 69228 out.go:235] - Booting up control plane ...
I0828 18:14:48.246990 69228 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0828 18:14:48.250848 69228 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0828 18:14:48.253783 69228 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0828 18:14:48.253912 69228 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0828 18:14:48.256855 69228 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0828 18:15:28.259672 69228 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0828 18:15:28.260102 69228 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0828 18:15:28.260329 69228 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0828 18:15:33.261100 69228 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0828 18:15:33.261284 69228 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0828 18:15:43.261594 69228 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0828 18:15:43.261860 69228 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0828 18:16:03.260886 69228 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0828 18:16:03.261098 69228 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0828 18:16:43.260880 69228 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0828 18:16:43.261138 69228 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0828 18:16:43.261162 69228 kubeadm.go:310]
I0828 18:16:43.261215 69228 kubeadm.go:310] Unfortunately, an error has occurred:
I0828 18:16:43.261268 69228 kubeadm.go:310] timed out waiting for the condition
I0828 18:16:43.261275 69228 kubeadm.go:310]
I0828 18:16:43.261319 69228 kubeadm.go:310] This error is likely caused by:
I0828 18:16:43.261366 69228 kubeadm.go:310] - The kubelet is not running
I0828 18:16:43.261456 69228 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0828 18:16:43.261463 69228 kubeadm.go:310]
I0828 18:16:43.261590 69228 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0828 18:16:43.261639 69228 kubeadm.go:310] - 'systemctl status kubelet'
I0828 18:16:43.261684 69228 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0828 18:16:43.261695 69228 kubeadm.go:310]
I0828 18:16:43.261805 69228 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0828 18:16:43.261928 69228 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0828 18:16:43.261950 69228 kubeadm.go:310]
I0828 18:16:43.262087 69228 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0828 18:16:43.262202 69228 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0828 18:16:43.262308 69228 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0828 18:16:43.262388 69228 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0828 18:16:43.262406 69228 kubeadm.go:310]
I0828 18:16:43.262910 69228 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0828 18:16:43.263022 69228 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0828 18:16:43.263113 69228 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0828 18:16:43.263181 69228 kubeadm.go:394] duration metric: took 3m55.942472311s to StartCluster
I0828 18:16:43.263216 69228 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0828 18:16:43.263268 69228 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0828 18:16:43.309426 69228 cri.go:89] found id: ""
I0828 18:16:43.309466 69228 logs.go:276] 0 containers: []
W0828 18:16:43.309474 69228 logs.go:278] No container was found matching "kube-apiserver"
I0828 18:16:43.309479 69228 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0828 18:16:43.309548 69228 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0828 18:16:43.343834 69228 cri.go:89] found id: ""
I0828 18:16:43.343864 69228 logs.go:276] 0 containers: []
W0828 18:16:43.343874 69228 logs.go:278] No container was found matching "etcd"
I0828 18:16:43.343882 69228 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0828 18:16:43.343945 69228 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0828 18:16:43.378106 69228 cri.go:89] found id: ""
I0828 18:16:43.378131 69228 logs.go:276] 0 containers: []
W0828 18:16:43.378138 69228 logs.go:278] No container was found matching "coredns"
I0828 18:16:43.378143 69228 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0828 18:16:43.378191 69228 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0828 18:16:43.414229 69228 cri.go:89] found id: ""
I0828 18:16:43.414257 69228 logs.go:276] 0 containers: []
W0828 18:16:43.414267 69228 logs.go:278] No container was found matching "kube-scheduler"
I0828 18:16:43.414274 69228 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0828 18:16:43.414338 69228 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0828 18:16:43.445926 69228 cri.go:89] found id: ""
I0828 18:16:43.445953 69228 logs.go:276] 0 containers: []
W0828 18:16:43.445960 69228 logs.go:278] No container was found matching "kube-proxy"
I0828 18:16:43.445966 69228 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0828 18:16:43.446018 69228 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0828 18:16:43.479915 69228 cri.go:89] found id: ""
I0828 18:16:43.479945 69228 logs.go:276] 0 containers: []
W0828 18:16:43.479955 69228 logs.go:278] No container was found matching "kube-controller-manager"
I0828 18:16:43.479963 69228 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0828 18:16:43.480027 69228 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0828 18:16:43.510983 69228 cri.go:89] found id: ""
I0828 18:16:43.511014 69228 logs.go:276] 0 containers: []
W0828 18:16:43.511023 69228 logs.go:278] No container was found matching "kindnet"
I0828 18:16:43.511032 69228 logs.go:123] Gathering logs for kubelet ...
I0828 18:16:43.511044 69228 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0828 18:16:43.563764 69228 logs.go:123] Gathering logs for dmesg ...
I0828 18:16:43.563803 69228 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0828 18:16:43.576449 69228 logs.go:123] Gathering logs for describe nodes ...
I0828 18:16:43.576472 69228 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0828 18:16:43.691208 69228 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0828 18:16:43.691232 69228 logs.go:123] Gathering logs for CRI-O ...
I0828 18:16:43.691248 69228 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0828 18:16:43.812438 69228 logs.go:123] Gathering logs for container status ...
I0828 18:16:43.812476 69228 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0828 18:16:43.857576 69228 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0828 18:16:43.857626 69228 out.go:270] *
*
W0828 18:16:43.857686 69228 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0828 18:16:43.857705 69228 out.go:270] *
*
W0828 18:16:43.858817 69228 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0828 18:16:43.862026 69228 out.go:201]
W0828 18:16:43.863239 69228 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0828 18:16:43.863278 69228 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0828 18:16:43.863296 69228 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0828 18:16:43.864775 69228 out.go:201]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-131737 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-131737 -n old-k8s-version-131737
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-131737 -n old-k8s-version-131737: exit status 6 (213.167467ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0828 18:16:44.120850 75997 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-131737" does not appear in /home/jenkins/minikube-integration/19529-10317/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-131737" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (303.16s)