=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:184: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-768580 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:184: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-768580 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m37.260070494s)
-- stdout --
* [old-k8s-version-768580] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=20349
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/20349-149500/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/20349-149500/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-768580" primary control-plane node in "old-k8s-version-768580" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0414 17:39:13.727038 206309 out.go:345] Setting OutFile to fd 1 ...
I0414 17:39:13.727306 206309 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0414 17:39:13.727316 206309 out.go:358] Setting ErrFile to fd 2...
I0414 17:39:13.727320 206309 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0414 17:39:13.727509 206309 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20349-149500/.minikube/bin
I0414 17:39:13.728107 206309 out.go:352] Setting JSON to false
I0414 17:39:13.729280 206309 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-14","uptime":8452,"bootTime":1744643902,"procs":305,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1078-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0414 17:39:13.729366 206309 start.go:139] virtualization: kvm guest
I0414 17:39:13.731275 206309 out.go:177] * [old-k8s-version-768580] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
I0414 17:39:13.732780 206309 notify.go:220] Checking for updates...
I0414 17:39:13.732802 206309 out.go:177] - MINIKUBE_LOCATION=20349
I0414 17:39:13.734006 206309 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0414 17:39:13.735225 206309 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/20349-149500/kubeconfig
I0414 17:39:13.736340 206309 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/20349-149500/.minikube
I0414 17:39:13.737398 206309 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0414 17:39:13.738348 206309 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0414 17:39:13.739785 206309 config.go:182] Loaded profile config "bridge-993774": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.2
I0414 17:39:13.739900 206309 config.go:182] Loaded profile config "flannel-993774": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.2
I0414 17:39:13.740009 206309 config.go:182] Loaded profile config "kubernetes-upgrade-771697": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.2
I0414 17:39:13.740126 206309 driver.go:394] Setting default libvirt URI to qemu:///system
I0414 17:39:13.776579 206309 out.go:177] * Using the kvm2 driver based on user configuration
I0414 17:39:13.777741 206309 start.go:297] selected driver: kvm2
I0414 17:39:13.777756 206309 start.go:901] validating driver "kvm2" against <nil>
I0414 17:39:13.777772 206309 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0414 17:39:13.778844 206309 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0414 17:39:13.778957 206309 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/20349-149500/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0414 17:39:13.795824 206309 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.35.0
I0414 17:39:13.795883 206309 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0414 17:39:13.796208 206309 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0414 17:39:13.796270 206309 cni.go:84] Creating CNI manager for ""
I0414 17:39:13.796330 206309 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0414 17:39:13.796344 206309 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0414 17:39:13.796395 206309 start.go:340] cluster config:
{Name:old-k8s-version-768580 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-768580 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0414 17:39:13.796497 206309 iso.go:125] acquiring lock: {Name:mk56ab209abfa01de10f2f82564ecd03de00499a Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0414 17:39:13.798269 206309 out.go:177] * Starting "old-k8s-version-768580" primary control-plane node in "old-k8s-version-768580" cluster
I0414 17:39:13.799539 206309 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0414 17:39:13.799590 206309 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20349-149500/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0414 17:39:13.799602 206309 cache.go:56] Caching tarball of preloaded images
I0414 17:39:13.799705 206309 preload.go:172] Found /home/jenkins/minikube-integration/20349-149500/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0414 17:39:13.799719 206309 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0414 17:39:13.799834 206309 profile.go:143] Saving config to /home/jenkins/minikube-integration/20349-149500/.minikube/profiles/old-k8s-version-768580/config.json ...
I0414 17:39:13.799861 206309 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20349-149500/.minikube/profiles/old-k8s-version-768580/config.json: {Name:mkbd5c16f8c4bb93f665982933917ca0fa3fab53 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0414 17:39:13.800031 206309 start.go:360] acquireMachinesLock for old-k8s-version-768580: {Name:mk6f64d523f60ec1e047c10a4c586315976dcd43 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0414 17:39:17.976197 206309 start.go:364] duration metric: took 4.176121608s to acquireMachinesLock for "old-k8s-version-768580"
I0414 17:39:17.976257 206309 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-768580 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 C
lusterName:old-k8s-version-768580 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p M
ountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0414 17:39:17.976365 206309 start.go:125] createHost starting for "" (driver="kvm2")
I0414 17:39:17.978181 206309 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0414 17:39:17.978406 206309 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0414 17:39:17.978466 206309 main.go:141] libmachine: Launching plugin server for driver kvm2
I0414 17:39:17.995481 206309 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36965
I0414 17:39:17.995988 206309 main.go:141] libmachine: () Calling .GetVersion
I0414 17:39:17.996520 206309 main.go:141] libmachine: Using API Version 1
I0414 17:39:17.996544 206309 main.go:141] libmachine: () Calling .SetConfigRaw
I0414 17:39:17.996948 206309 main.go:141] libmachine: () Calling .GetMachineName
I0414 17:39:17.997171 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetMachineName
I0414 17:39:17.997341 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .DriverName
I0414 17:39:17.997469 206309 start.go:159] libmachine.API.Create for "old-k8s-version-768580" (driver="kvm2")
I0414 17:39:17.997507 206309 client.go:168] LocalClient.Create starting
I0414 17:39:17.997543 206309 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20349-149500/.minikube/certs/ca.pem
I0414 17:39:17.997595 206309 main.go:141] libmachine: Decoding PEM data...
I0414 17:39:17.997618 206309 main.go:141] libmachine: Parsing certificate...
I0414 17:39:17.997696 206309 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20349-149500/.minikube/certs/cert.pem
I0414 17:39:17.997730 206309 main.go:141] libmachine: Decoding PEM data...
I0414 17:39:17.997748 206309 main.go:141] libmachine: Parsing certificate...
I0414 17:39:17.997776 206309 main.go:141] libmachine: Running pre-create checks...
I0414 17:39:17.997789 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .PreCreateCheck
I0414 17:39:17.998162 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetConfigRaw
I0414 17:39:17.998542 206309 main.go:141] libmachine: Creating machine...
I0414 17:39:17.998565 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .Create
I0414 17:39:17.998724 206309 main.go:141] libmachine: (old-k8s-version-768580) creating KVM machine...
I0414 17:39:17.998739 206309 main.go:141] libmachine: (old-k8s-version-768580) creating network...
I0414 17:39:17.999943 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | found existing default KVM network
I0414 17:39:18.000976 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | I0414 17:39:18.000821 206405 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:d3:e2:76} reservation:<nil>}
I0414 17:39:18.001893 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | I0414 17:39:18.001797 206405 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:76:cc:42} reservation:<nil>}
I0414 17:39:18.002534 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | I0414 17:39:18.002463 206405 network.go:211] skipping subnet 192.168.61.0/24 that is taken: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName:virbr3 IfaceIPv4:192.168.61.1 IfaceMTU:1500 IfaceMAC:52:54:00:1e:4e:88} reservation:<nil>}
I0414 17:39:18.003677 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | I0414 17:39:18.003609 206405 network.go:206] using free private subnet 192.168.72.0/24: &{IP:192.168.72.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.72.0/24 Gateway:192.168.72.1 ClientMin:192.168.72.2 ClientMax:192.168.72.254 Broadcast:192.168.72.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000305260}
I0414 17:39:18.003757 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | created network xml:
I0414 17:39:18.003772 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | <network>
I0414 17:39:18.003783 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | <name>mk-old-k8s-version-768580</name>
I0414 17:39:18.003791 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | <dns enable='no'/>
I0414 17:39:18.003799 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG |
I0414 17:39:18.003817 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | <ip address='192.168.72.1' netmask='255.255.255.0'>
I0414 17:39:18.003827 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | <dhcp>
I0414 17:39:18.003836 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | <range start='192.168.72.2' end='192.168.72.253'/>
I0414 17:39:18.003844 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | </dhcp>
I0414 17:39:18.003850 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | </ip>
I0414 17:39:18.003858 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG |
I0414 17:39:18.003872 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | </network>
I0414 17:39:18.003882 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG |
I0414 17:39:18.009101 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | trying to create private KVM network mk-old-k8s-version-768580 192.168.72.0/24...
I0414 17:39:18.101663 206309 main.go:141] libmachine: (old-k8s-version-768580) setting up store path in /home/jenkins/minikube-integration/20349-149500/.minikube/machines/old-k8s-version-768580 ...
I0414 17:39:18.101688 206309 main.go:141] libmachine: (old-k8s-version-768580) building disk image from file:///home/jenkins/minikube-integration/20349-149500/.minikube/cache/iso/amd64/minikube-v1.35.0-amd64.iso
I0414 17:39:18.101706 206309 main.go:141] libmachine: (old-k8s-version-768580) Downloading /home/jenkins/minikube-integration/20349-149500/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/20349-149500/.minikube/cache/iso/amd64/minikube-v1.35.0-amd64.iso...
I0414 17:39:18.101721 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | private KVM network mk-old-k8s-version-768580 192.168.72.0/24 created
I0414 17:39:18.101743 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | I0414 17:39:18.101415 206405 common.go:144] Making disk image using store path: /home/jenkins/minikube-integration/20349-149500/.minikube
I0414 17:39:18.416467 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | I0414 17:39:18.416292 206405 common.go:151] Creating ssh key: /home/jenkins/minikube-integration/20349-149500/.minikube/machines/old-k8s-version-768580/id_rsa...
I0414 17:39:18.782516 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | I0414 17:39:18.782366 206405 common.go:157] Creating raw disk image: /home/jenkins/minikube-integration/20349-149500/.minikube/machines/old-k8s-version-768580/old-k8s-version-768580.rawdisk...
I0414 17:39:18.782550 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | Writing magic tar header
I0414 17:39:18.782568 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | Writing SSH key tar header
I0414 17:39:18.782582 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | I0414 17:39:18.782521 206405 common.go:171] Fixing permissions on /home/jenkins/minikube-integration/20349-149500/.minikube/machines/old-k8s-version-768580 ...
I0414 17:39:18.782680 206309 main.go:141] libmachine: (old-k8s-version-768580) setting executable bit set on /home/jenkins/minikube-integration/20349-149500/.minikube/machines/old-k8s-version-768580 (perms=drwx------)
I0414 17:39:18.782695 206309 main.go:141] libmachine: (old-k8s-version-768580) setting executable bit set on /home/jenkins/minikube-integration/20349-149500/.minikube/machines (perms=drwxr-xr-x)
I0414 17:39:18.782709 206309 main.go:141] libmachine: (old-k8s-version-768580) setting executable bit set on /home/jenkins/minikube-integration/20349-149500/.minikube (perms=drwxr-xr-x)
I0414 17:39:18.782729 206309 main.go:141] libmachine: (old-k8s-version-768580) setting executable bit set on /home/jenkins/minikube-integration/20349-149500 (perms=drwxrwxr-x)
I0414 17:39:18.782739 206309 main.go:141] libmachine: (old-k8s-version-768580) setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0414 17:39:18.782748 206309 main.go:141] libmachine: (old-k8s-version-768580) setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0414 17:39:18.782759 206309 main.go:141] libmachine: (old-k8s-version-768580) creating domain...
I0414 17:39:18.782773 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20349-149500/.minikube/machines/old-k8s-version-768580
I0414 17:39:18.782785 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20349-149500/.minikube/machines
I0414 17:39:18.782795 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20349-149500/.minikube
I0414 17:39:18.782803 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20349-149500
I0414 17:39:18.782813 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | checking permissions on dir: /home/jenkins/minikube-integration
I0414 17:39:18.782825 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | checking permissions on dir: /home/jenkins
I0414 17:39:18.782836 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | checking permissions on dir: /home
I0414 17:39:18.782854 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | skipping /home - not owner
I0414 17:39:18.784188 206309 main.go:141] libmachine: (old-k8s-version-768580) define libvirt domain using xml:
I0414 17:39:18.784215 206309 main.go:141] libmachine: (old-k8s-version-768580) <domain type='kvm'>
I0414 17:39:18.784226 206309 main.go:141] libmachine: (old-k8s-version-768580) <name>old-k8s-version-768580</name>
I0414 17:39:18.784234 206309 main.go:141] libmachine: (old-k8s-version-768580) <memory unit='MiB'>2200</memory>
I0414 17:39:18.784243 206309 main.go:141] libmachine: (old-k8s-version-768580) <vcpu>2</vcpu>
I0414 17:39:18.784261 206309 main.go:141] libmachine: (old-k8s-version-768580) <features>
I0414 17:39:18.784269 206309 main.go:141] libmachine: (old-k8s-version-768580) <acpi/>
I0414 17:39:18.784275 206309 main.go:141] libmachine: (old-k8s-version-768580) <apic/>
I0414 17:39:18.784283 206309 main.go:141] libmachine: (old-k8s-version-768580) <pae/>
I0414 17:39:18.784289 206309 main.go:141] libmachine: (old-k8s-version-768580)
I0414 17:39:18.784297 206309 main.go:141] libmachine: (old-k8s-version-768580) </features>
I0414 17:39:18.784304 206309 main.go:141] libmachine: (old-k8s-version-768580) <cpu mode='host-passthrough'>
I0414 17:39:18.784312 206309 main.go:141] libmachine: (old-k8s-version-768580)
I0414 17:39:18.784317 206309 main.go:141] libmachine: (old-k8s-version-768580) </cpu>
I0414 17:39:18.784333 206309 main.go:141] libmachine: (old-k8s-version-768580) <os>
I0414 17:39:18.784340 206309 main.go:141] libmachine: (old-k8s-version-768580) <type>hvm</type>
I0414 17:39:18.784349 206309 main.go:141] libmachine: (old-k8s-version-768580) <boot dev='cdrom'/>
I0414 17:39:18.784354 206309 main.go:141] libmachine: (old-k8s-version-768580) <boot dev='hd'/>
I0414 17:39:18.784362 206309 main.go:141] libmachine: (old-k8s-version-768580) <bootmenu enable='no'/>
I0414 17:39:18.784368 206309 main.go:141] libmachine: (old-k8s-version-768580) </os>
I0414 17:39:18.784376 206309 main.go:141] libmachine: (old-k8s-version-768580) <devices>
I0414 17:39:18.784383 206309 main.go:141] libmachine: (old-k8s-version-768580) <disk type='file' device='cdrom'>
I0414 17:39:18.784396 206309 main.go:141] libmachine: (old-k8s-version-768580) <source file='/home/jenkins/minikube-integration/20349-149500/.minikube/machines/old-k8s-version-768580/boot2docker.iso'/>
I0414 17:39:18.784403 206309 main.go:141] libmachine: (old-k8s-version-768580) <target dev='hdc' bus='scsi'/>
I0414 17:39:18.784411 206309 main.go:141] libmachine: (old-k8s-version-768580) <readonly/>
I0414 17:39:18.784418 206309 main.go:141] libmachine: (old-k8s-version-768580) </disk>
I0414 17:39:18.784427 206309 main.go:141] libmachine: (old-k8s-version-768580) <disk type='file' device='disk'>
I0414 17:39:18.784435 206309 main.go:141] libmachine: (old-k8s-version-768580) <driver name='qemu' type='raw' cache='default' io='threads' />
I0414 17:39:18.784449 206309 main.go:141] libmachine: (old-k8s-version-768580) <source file='/home/jenkins/minikube-integration/20349-149500/.minikube/machines/old-k8s-version-768580/old-k8s-version-768580.rawdisk'/>
I0414 17:39:18.784457 206309 main.go:141] libmachine: (old-k8s-version-768580) <target dev='hda' bus='virtio'/>
I0414 17:39:18.784465 206309 main.go:141] libmachine: (old-k8s-version-768580) </disk>
I0414 17:39:18.784471 206309 main.go:141] libmachine: (old-k8s-version-768580) <interface type='network'>
I0414 17:39:18.784479 206309 main.go:141] libmachine: (old-k8s-version-768580) <source network='mk-old-k8s-version-768580'/>
I0414 17:39:18.784485 206309 main.go:141] libmachine: (old-k8s-version-768580) <model type='virtio'/>
I0414 17:39:18.784493 206309 main.go:141] libmachine: (old-k8s-version-768580) </interface>
I0414 17:39:18.784500 206309 main.go:141] libmachine: (old-k8s-version-768580) <interface type='network'>
I0414 17:39:18.784509 206309 main.go:141] libmachine: (old-k8s-version-768580) <source network='default'/>
I0414 17:39:18.784515 206309 main.go:141] libmachine: (old-k8s-version-768580) <model type='virtio'/>
I0414 17:39:18.784525 206309 main.go:141] libmachine: (old-k8s-version-768580) </interface>
I0414 17:39:18.784532 206309 main.go:141] libmachine: (old-k8s-version-768580) <serial type='pty'>
I0414 17:39:18.784540 206309 main.go:141] libmachine: (old-k8s-version-768580) <target port='0'/>
I0414 17:39:18.784546 206309 main.go:141] libmachine: (old-k8s-version-768580) </serial>
I0414 17:39:18.784555 206309 main.go:141] libmachine: (old-k8s-version-768580) <console type='pty'>
I0414 17:39:18.784562 206309 main.go:141] libmachine: (old-k8s-version-768580) <target type='serial' port='0'/>
I0414 17:39:18.784569 206309 main.go:141] libmachine: (old-k8s-version-768580) </console>
I0414 17:39:18.784576 206309 main.go:141] libmachine: (old-k8s-version-768580) <rng model='virtio'>
I0414 17:39:18.784585 206309 main.go:141] libmachine: (old-k8s-version-768580) <backend model='random'>/dev/random</backend>
I0414 17:39:18.784598 206309 main.go:141] libmachine: (old-k8s-version-768580) </rng>
I0414 17:39:18.784606 206309 main.go:141] libmachine: (old-k8s-version-768580)
I0414 17:39:18.784611 206309 main.go:141] libmachine: (old-k8s-version-768580)
I0414 17:39:18.784619 206309 main.go:141] libmachine: (old-k8s-version-768580) </devices>
I0414 17:39:18.784626 206309 main.go:141] libmachine: (old-k8s-version-768580) </domain>
I0414 17:39:18.784635 206309 main.go:141] libmachine: (old-k8s-version-768580)
I0414 17:39:18.789898 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has defined MAC address 52:54:00:29:79:d9 in network default
I0414 17:39:18.790773 206309 main.go:141] libmachine: (old-k8s-version-768580) starting domain...
I0414 17:39:18.790786 206309 main.go:141] libmachine: (old-k8s-version-768580) ensuring networks are active...
I0414 17:39:18.790804 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has defined MAC address 52:54:00:d8:47:6d in network mk-old-k8s-version-768580
I0414 17:39:18.791686 206309 main.go:141] libmachine: (old-k8s-version-768580) Ensuring network default is active
I0414 17:39:18.792173 206309 main.go:141] libmachine: (old-k8s-version-768580) Ensuring network mk-old-k8s-version-768580 is active
I0414 17:39:18.792842 206309 main.go:141] libmachine: (old-k8s-version-768580) getting domain XML...
I0414 17:39:18.793624 206309 main.go:141] libmachine: (old-k8s-version-768580) creating domain...
I0414 17:39:20.496002 206309 main.go:141] libmachine: (old-k8s-version-768580) waiting for IP...
I0414 17:39:20.496975 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has defined MAC address 52:54:00:d8:47:6d in network mk-old-k8s-version-768580
I0414 17:39:20.497531 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | unable to find current IP address of domain old-k8s-version-768580 in network mk-old-k8s-version-768580
I0414 17:39:20.497616 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | I0414 17:39:20.497535 206405 retry.go:31] will retry after 298.748484ms: waiting for domain to come up
I0414 17:39:20.798283 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has defined MAC address 52:54:00:d8:47:6d in network mk-old-k8s-version-768580
I0414 17:39:20.801052 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | unable to find current IP address of domain old-k8s-version-768580 in network mk-old-k8s-version-768580
I0414 17:39:20.801082 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | I0414 17:39:20.800951 206405 retry.go:31] will retry after 367.847605ms: waiting for domain to come up
I0414 17:39:21.170938 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has defined MAC address 52:54:00:d8:47:6d in network mk-old-k8s-version-768580
I0414 17:39:21.171515 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | unable to find current IP address of domain old-k8s-version-768580 in network mk-old-k8s-version-768580
I0414 17:39:21.171539 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | I0414 17:39:21.171467 206405 retry.go:31] will retry after 304.806188ms: waiting for domain to come up
I0414 17:39:21.478131 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has defined MAC address 52:54:00:d8:47:6d in network mk-old-k8s-version-768580
I0414 17:39:21.478712 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | unable to find current IP address of domain old-k8s-version-768580 in network mk-old-k8s-version-768580
I0414 17:39:21.478736 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | I0414 17:39:21.478689 206405 retry.go:31] will retry after 386.238262ms: waiting for domain to come up
I0414 17:39:21.866457 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has defined MAC address 52:54:00:d8:47:6d in network mk-old-k8s-version-768580
I0414 17:39:21.867083 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | unable to find current IP address of domain old-k8s-version-768580 in network mk-old-k8s-version-768580
I0414 17:39:21.867139 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | I0414 17:39:21.867056 206405 retry.go:31] will retry after 692.535131ms: waiting for domain to come up
I0414 17:39:22.561209 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has defined MAC address 52:54:00:d8:47:6d in network mk-old-k8s-version-768580
I0414 17:39:22.561755 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | unable to find current IP address of domain old-k8s-version-768580 in network mk-old-k8s-version-768580
I0414 17:39:22.561787 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | I0414 17:39:22.561710 206405 retry.go:31] will retry after 808.587705ms: waiting for domain to come up
I0414 17:39:23.372142 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has defined MAC address 52:54:00:d8:47:6d in network mk-old-k8s-version-768580
I0414 17:39:23.372773 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | unable to find current IP address of domain old-k8s-version-768580 in network mk-old-k8s-version-768580
I0414 17:39:23.372804 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | I0414 17:39:23.372754 206405 retry.go:31] will retry after 1.025779677s: waiting for domain to come up
I0414 17:39:24.400567 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has defined MAC address 52:54:00:d8:47:6d in network mk-old-k8s-version-768580
I0414 17:39:24.401183 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | unable to find current IP address of domain old-k8s-version-768580 in network mk-old-k8s-version-768580
I0414 17:39:24.401210 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | I0414 17:39:24.401162 206405 retry.go:31] will retry after 1.396385721s: waiting for domain to come up
I0414 17:39:25.798905 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has defined MAC address 52:54:00:d8:47:6d in network mk-old-k8s-version-768580
I0414 17:39:25.799341 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | unable to find current IP address of domain old-k8s-version-768580 in network mk-old-k8s-version-768580
I0414 17:39:25.799372 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | I0414 17:39:25.799293 206405 retry.go:31] will retry after 1.594554128s: waiting for domain to come up
I0414 17:39:27.396432 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has defined MAC address 52:54:00:d8:47:6d in network mk-old-k8s-version-768580
I0414 17:39:27.396931 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | unable to find current IP address of domain old-k8s-version-768580 in network mk-old-k8s-version-768580
I0414 17:39:27.396982 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | I0414 17:39:27.396908 206405 retry.go:31] will retry after 1.517980618s: waiting for domain to come up
I0414 17:39:28.916624 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has defined MAC address 52:54:00:d8:47:6d in network mk-old-k8s-version-768580
I0414 17:39:28.917116 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | unable to find current IP address of domain old-k8s-version-768580 in network mk-old-k8s-version-768580
I0414 17:39:28.917182 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | I0414 17:39:28.917121 206405 retry.go:31] will retry after 2.342570155s: waiting for domain to come up
I0414 17:39:31.260961 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has defined MAC address 52:54:00:d8:47:6d in network mk-old-k8s-version-768580
I0414 17:39:31.261531 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | unable to find current IP address of domain old-k8s-version-768580 in network mk-old-k8s-version-768580
I0414 17:39:31.261554 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | I0414 17:39:31.261480 206405 retry.go:31] will retry after 2.750990988s: waiting for domain to come up
I0414 17:39:34.013655 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has defined MAC address 52:54:00:d8:47:6d in network mk-old-k8s-version-768580
I0414 17:39:34.014246 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | unable to find current IP address of domain old-k8s-version-768580 in network mk-old-k8s-version-768580
I0414 17:39:34.014274 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | I0414 17:39:34.014211 206405 retry.go:31] will retry after 3.513109199s: waiting for domain to come up
I0414 17:39:37.531826 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has defined MAC address 52:54:00:d8:47:6d in network mk-old-k8s-version-768580
I0414 17:39:37.532235 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | unable to find current IP address of domain old-k8s-version-768580 in network mk-old-k8s-version-768580
I0414 17:39:37.532261 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | I0414 17:39:37.532203 206405 retry.go:31] will retry after 3.887637864s: waiting for domain to come up
I0414 17:39:41.423059 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has defined MAC address 52:54:00:d8:47:6d in network mk-old-k8s-version-768580
I0414 17:39:41.423639 206309 main.go:141] libmachine: (old-k8s-version-768580) found domain IP: 192.168.72.58
I0414 17:39:41.423664 206309 main.go:141] libmachine: (old-k8s-version-768580) reserving static IP address...
I0414 17:39:41.423688 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has current primary IP address 192.168.72.58 and MAC address 52:54:00:d8:47:6d in network mk-old-k8s-version-768580
I0414 17:39:41.424019 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-768580", mac: "52:54:00:d8:47:6d", ip: "192.168.72.58"} in network mk-old-k8s-version-768580
I0414 17:39:41.500117 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | Getting to WaitForSSH function...
I0414 17:39:41.500149 206309 main.go:141] libmachine: (old-k8s-version-768580) reserved static IP address 192.168.72.58 for domain old-k8s-version-768580
I0414 17:39:41.500160 206309 main.go:141] libmachine: (old-k8s-version-768580) waiting for SSH...
I0414 17:39:41.503790 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has defined MAC address 52:54:00:d8:47:6d in network mk-old-k8s-version-768580
I0414 17:39:41.504277 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:47:6d", ip: ""} in network mk-old-k8s-version-768580: {Iface:virbr4 ExpiryTime:2025-04-14 18:39:34 +0000 UTC Type:0 Mac:52:54:00:d8:47:6d Iaid: IPaddr:192.168.72.58 Prefix:24 Hostname:minikube Clientid:01:52:54:00:d8:47:6d}
I0414 17:39:41.504307 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has defined IP address 192.168.72.58 and MAC address 52:54:00:d8:47:6d in network mk-old-k8s-version-768580
I0414 17:39:41.504542 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | Using SSH client type: external
I0414 17:39:41.504570 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | Using SSH private key: /home/jenkins/minikube-integration/20349-149500/.minikube/machines/old-k8s-version-768580/id_rsa (-rw-------)
I0414 17:39:41.504617 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.72.58 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/20349-149500/.minikube/machines/old-k8s-version-768580/id_rsa -p 22] /usr/bin/ssh <nil>}
I0414 17:39:41.504632 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | About to run SSH command:
I0414 17:39:41.504645 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | exit 0
I0414 17:39:41.650429 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | SSH cmd err, output: <nil>:
I0414 17:39:41.650786 206309 main.go:141] libmachine: (old-k8s-version-768580) KVM machine creation complete
I0414 17:39:41.651234 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetConfigRaw
I0414 17:39:41.720559 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .DriverName
I0414 17:39:41.720889 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .DriverName
I0414 17:39:41.721094 206309 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0414 17:39:41.721168 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetState
I0414 17:39:41.722982 206309 main.go:141] libmachine: Detecting operating system of created instance...
I0414 17:39:41.722998 206309 main.go:141] libmachine: Waiting for SSH to be available...
I0414 17:39:41.723006 206309 main.go:141] libmachine: Getting to WaitForSSH function...
I0414 17:39:41.723015 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetSSHHostname
I0414 17:39:41.726216 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has defined MAC address 52:54:00:d8:47:6d in network mk-old-k8s-version-768580
I0414 17:39:41.726577 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:47:6d", ip: ""} in network mk-old-k8s-version-768580: {Iface:virbr4 ExpiryTime:2025-04-14 18:39:34 +0000 UTC Type:0 Mac:52:54:00:d8:47:6d Iaid: IPaddr:192.168.72.58 Prefix:24 Hostname:old-k8s-version-768580 Clientid:01:52:54:00:d8:47:6d}
I0414 17:39:41.726600 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has defined IP address 192.168.72.58 and MAC address 52:54:00:d8:47:6d in network mk-old-k8s-version-768580
I0414 17:39:41.727533 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetSSHPort
I0414 17:39:41.727717 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetSSHKeyPath
I0414 17:39:41.727870 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetSSHKeyPath
I0414 17:39:41.728007 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetSSHUsername
I0414 17:39:41.728195 206309 main.go:141] libmachine: Using SSH client type: native
I0414 17:39:41.728469 206309 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.72.58 22 <nil> <nil>}
I0414 17:39:41.728482 206309 main.go:141] libmachine: About to run SSH command:
exit 0
I0414 17:39:41.833225 206309 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0414 17:39:41.833253 206309 main.go:141] libmachine: Detecting the provisioner...
I0414 17:39:41.833265 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetSSHHostname
I0414 17:39:41.835829 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has defined MAC address 52:54:00:d8:47:6d in network mk-old-k8s-version-768580
I0414 17:39:41.836187 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:47:6d", ip: ""} in network mk-old-k8s-version-768580: {Iface:virbr4 ExpiryTime:2025-04-14 18:39:34 +0000 UTC Type:0 Mac:52:54:00:d8:47:6d Iaid: IPaddr:192.168.72.58 Prefix:24 Hostname:old-k8s-version-768580 Clientid:01:52:54:00:d8:47:6d}
I0414 17:39:41.836219 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has defined IP address 192.168.72.58 and MAC address 52:54:00:d8:47:6d in network mk-old-k8s-version-768580
I0414 17:39:41.836342 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetSSHPort
I0414 17:39:41.836500 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetSSHKeyPath
I0414 17:39:41.836683 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetSSHKeyPath
I0414 17:39:41.836833 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetSSHUsername
I0414 17:39:41.836999 206309 main.go:141] libmachine: Using SSH client type: native
I0414 17:39:41.837214 206309 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.72.58 22 <nil> <nil>}
I0414 17:39:41.837226 206309 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0414 17:39:41.947434 206309 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0414 17:39:41.947515 206309 main.go:141] libmachine: found compatible host: buildroot
I0414 17:39:41.947522 206309 main.go:141] libmachine: Provisioning with buildroot...
I0414 17:39:41.947529 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetMachineName
I0414 17:39:41.947776 206309 buildroot.go:166] provisioning hostname "old-k8s-version-768580"
I0414 17:39:41.947808 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetMachineName
I0414 17:39:41.947998 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetSSHHostname
I0414 17:39:41.952149 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has defined MAC address 52:54:00:d8:47:6d in network mk-old-k8s-version-768580
I0414 17:39:41.953630 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:47:6d", ip: ""} in network mk-old-k8s-version-768580: {Iface:virbr4 ExpiryTime:2025-04-14 18:39:34 +0000 UTC Type:0 Mac:52:54:00:d8:47:6d Iaid: IPaddr:192.168.72.58 Prefix:24 Hostname:old-k8s-version-768580 Clientid:01:52:54:00:d8:47:6d}
I0414 17:39:41.953669 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has defined IP address 192.168.72.58 and MAC address 52:54:00:d8:47:6d in network mk-old-k8s-version-768580
I0414 17:39:41.953955 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetSSHPort
I0414 17:39:41.954175 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetSSHKeyPath
I0414 17:39:41.954317 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetSSHKeyPath
I0414 17:39:41.954463 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetSSHUsername
I0414 17:39:41.954605 206309 main.go:141] libmachine: Using SSH client type: native
I0414 17:39:41.954843 206309 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.72.58 22 <nil> <nil>}
I0414 17:39:41.954859 206309 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-768580 && echo "old-k8s-version-768580" | sudo tee /etc/hostname
I0414 17:39:42.077742 206309 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-768580
I0414 17:39:42.077779 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetSSHHostname
I0414 17:39:42.393444 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has defined MAC address 52:54:00:d8:47:6d in network mk-old-k8s-version-768580
I0414 17:39:42.393900 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:47:6d", ip: ""} in network mk-old-k8s-version-768580: {Iface:virbr4 ExpiryTime:2025-04-14 18:39:34 +0000 UTC Type:0 Mac:52:54:00:d8:47:6d Iaid: IPaddr:192.168.72.58 Prefix:24 Hostname:old-k8s-version-768580 Clientid:01:52:54:00:d8:47:6d}
I0414 17:39:42.393927 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has defined IP address 192.168.72.58 and MAC address 52:54:00:d8:47:6d in network mk-old-k8s-version-768580
I0414 17:39:42.394066 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetSSHPort
I0414 17:39:42.394268 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetSSHKeyPath
I0414 17:39:42.394415 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetSSHKeyPath
I0414 17:39:42.394551 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetSSHUsername
I0414 17:39:42.394719 206309 main.go:141] libmachine: Using SSH client type: native
I0414 17:39:42.395039 206309 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.72.58 22 <nil> <nil>}
I0414 17:39:42.395066 206309 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-768580' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-768580/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-768580' | sudo tee -a /etc/hosts;
fi
fi
I0414 17:39:42.520647 206309 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0414 17:39:42.520676 206309 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/20349-149500/.minikube CaCertPath:/home/jenkins/minikube-integration/20349-149500/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20349-149500/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20349-149500/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20349-149500/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20349-149500/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20349-149500/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20349-149500/.minikube}
I0414 17:39:42.520723 206309 buildroot.go:174] setting up certificates
I0414 17:39:42.520739 206309 provision.go:84] configureAuth start
I0414 17:39:42.520754 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetMachineName
I0414 17:39:42.521063 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetIP
I0414 17:39:42.524518 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has defined MAC address 52:54:00:d8:47:6d in network mk-old-k8s-version-768580
I0414 17:39:42.524892 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:47:6d", ip: ""} in network mk-old-k8s-version-768580: {Iface:virbr4 ExpiryTime:2025-04-14 18:39:34 +0000 UTC Type:0 Mac:52:54:00:d8:47:6d Iaid: IPaddr:192.168.72.58 Prefix:24 Hostname:old-k8s-version-768580 Clientid:01:52:54:00:d8:47:6d}
I0414 17:39:42.524916 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has defined IP address 192.168.72.58 and MAC address 52:54:00:d8:47:6d in network mk-old-k8s-version-768580
I0414 17:39:42.525081 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetSSHHostname
I0414 17:39:42.527885 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has defined MAC address 52:54:00:d8:47:6d in network mk-old-k8s-version-768580
I0414 17:39:42.528213 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:47:6d", ip: ""} in network mk-old-k8s-version-768580: {Iface:virbr4 ExpiryTime:2025-04-14 18:39:34 +0000 UTC Type:0 Mac:52:54:00:d8:47:6d Iaid: IPaddr:192.168.72.58 Prefix:24 Hostname:old-k8s-version-768580 Clientid:01:52:54:00:d8:47:6d}
I0414 17:39:42.528232 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has defined IP address 192.168.72.58 and MAC address 52:54:00:d8:47:6d in network mk-old-k8s-version-768580
I0414 17:39:42.528447 206309 provision.go:143] copyHostCerts
I0414 17:39:42.528508 206309 exec_runner.go:144] found /home/jenkins/minikube-integration/20349-149500/.minikube/ca.pem, removing ...
I0414 17:39:42.528538 206309 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20349-149500/.minikube/ca.pem
I0414 17:39:42.528644 206309 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20349-149500/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20349-149500/.minikube/ca.pem (1082 bytes)
I0414 17:39:42.528776 206309 exec_runner.go:144] found /home/jenkins/minikube-integration/20349-149500/.minikube/cert.pem, removing ...
I0414 17:39:42.528790 206309 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20349-149500/.minikube/cert.pem
I0414 17:39:42.528837 206309 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20349-149500/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20349-149500/.minikube/cert.pem (1123 bytes)
I0414 17:39:42.528924 206309 exec_runner.go:144] found /home/jenkins/minikube-integration/20349-149500/.minikube/key.pem, removing ...
I0414 17:39:42.528936 206309 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20349-149500/.minikube/key.pem
I0414 17:39:42.528972 206309 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20349-149500/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20349-149500/.minikube/key.pem (1675 bytes)
I0414 17:39:42.529047 206309 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20349-149500/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20349-149500/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20349-149500/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-768580 san=[127.0.0.1 192.168.72.58 localhost minikube old-k8s-version-768580]
I0414 17:39:42.842504 206309 provision.go:177] copyRemoteCerts
I0414 17:39:42.842558 206309 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0414 17:39:42.842589 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetSSHHostname
I0414 17:39:42.845945 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has defined MAC address 52:54:00:d8:47:6d in network mk-old-k8s-version-768580
I0414 17:39:42.846351 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:47:6d", ip: ""} in network mk-old-k8s-version-768580: {Iface:virbr4 ExpiryTime:2025-04-14 18:39:34 +0000 UTC Type:0 Mac:52:54:00:d8:47:6d Iaid: IPaddr:192.168.72.58 Prefix:24 Hostname:old-k8s-version-768580 Clientid:01:52:54:00:d8:47:6d}
I0414 17:39:42.846378 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has defined IP address 192.168.72.58 and MAC address 52:54:00:d8:47:6d in network mk-old-k8s-version-768580
I0414 17:39:42.846579 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetSSHPort
I0414 17:39:42.846765 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetSSHKeyPath
I0414 17:39:42.846933 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetSSHUsername
I0414 17:39:42.847052 206309 sshutil.go:53] new ssh client: &{IP:192.168.72.58 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20349-149500/.minikube/machines/old-k8s-version-768580/id_rsa Username:docker}
I0414 17:39:42.933045 206309 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20349-149500/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0414 17:39:42.963827 206309 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20349-149500/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0414 17:39:42.992676 206309 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20349-149500/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0414 17:39:43.022320 206309 provision.go:87] duration metric: took 501.565888ms to configureAuth
I0414 17:39:43.022341 206309 buildroot.go:189] setting minikube options for container-runtime
I0414 17:39:43.022479 206309 config.go:182] Loaded profile config "old-k8s-version-768580": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0414 17:39:43.022585 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetSSHHostname
I0414 17:39:43.026086 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has defined MAC address 52:54:00:d8:47:6d in network mk-old-k8s-version-768580
I0414 17:39:43.026455 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:47:6d", ip: ""} in network mk-old-k8s-version-768580: {Iface:virbr4 ExpiryTime:2025-04-14 18:39:34 +0000 UTC Type:0 Mac:52:54:00:d8:47:6d Iaid: IPaddr:192.168.72.58 Prefix:24 Hostname:old-k8s-version-768580 Clientid:01:52:54:00:d8:47:6d}
I0414 17:39:43.026478 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has defined IP address 192.168.72.58 and MAC address 52:54:00:d8:47:6d in network mk-old-k8s-version-768580
I0414 17:39:43.026607 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetSSHPort
I0414 17:39:43.026808 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetSSHKeyPath
I0414 17:39:43.026978 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetSSHKeyPath
I0414 17:39:43.027134 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetSSHUsername
I0414 17:39:43.027281 206309 main.go:141] libmachine: Using SSH client type: native
I0414 17:39:43.027458 206309 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.72.58 22 <nil> <nil>}
I0414 17:39:43.027470 206309 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0414 17:39:43.289257 206309 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0414 17:39:43.289285 206309 main.go:141] libmachine: Checking connection to Docker...
I0414 17:39:43.289296 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetURL
I0414 17:39:43.291038 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | using libvirt version 6000000
I0414 17:39:43.293844 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has defined MAC address 52:54:00:d8:47:6d in network mk-old-k8s-version-768580
I0414 17:39:43.294256 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:47:6d", ip: ""} in network mk-old-k8s-version-768580: {Iface:virbr4 ExpiryTime:2025-04-14 18:39:34 +0000 UTC Type:0 Mac:52:54:00:d8:47:6d Iaid: IPaddr:192.168.72.58 Prefix:24 Hostname:old-k8s-version-768580 Clientid:01:52:54:00:d8:47:6d}
I0414 17:39:43.294279 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has defined IP address 192.168.72.58 and MAC address 52:54:00:d8:47:6d in network mk-old-k8s-version-768580
I0414 17:39:43.294429 206309 main.go:141] libmachine: Docker is up and running!
I0414 17:39:43.294457 206309 main.go:141] libmachine: Reticulating splines...
I0414 17:39:43.294467 206309 client.go:171] duration metric: took 25.29694666s to LocalClient.Create
I0414 17:39:43.294490 206309 start.go:167] duration metric: took 25.297021937s to libmachine.API.Create "old-k8s-version-768580"
I0414 17:39:43.294499 206309 start.go:293] postStartSetup for "old-k8s-version-768580" (driver="kvm2")
I0414 17:39:43.294512 206309 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0414 17:39:43.294539 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .DriverName
I0414 17:39:43.294780 206309 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0414 17:39:43.294808 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetSSHHostname
I0414 17:39:43.297542 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has defined MAC address 52:54:00:d8:47:6d in network mk-old-k8s-version-768580
I0414 17:39:43.297849 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:47:6d", ip: ""} in network mk-old-k8s-version-768580: {Iface:virbr4 ExpiryTime:2025-04-14 18:39:34 +0000 UTC Type:0 Mac:52:54:00:d8:47:6d Iaid: IPaddr:192.168.72.58 Prefix:24 Hostname:old-k8s-version-768580 Clientid:01:52:54:00:d8:47:6d}
I0414 17:39:43.297874 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has defined IP address 192.168.72.58 and MAC address 52:54:00:d8:47:6d in network mk-old-k8s-version-768580
I0414 17:39:43.297992 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetSSHPort
I0414 17:39:43.298183 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetSSHKeyPath
I0414 17:39:43.298332 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetSSHUsername
I0414 17:39:43.298480 206309 sshutil.go:53] new ssh client: &{IP:192.168.72.58 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20349-149500/.minikube/machines/old-k8s-version-768580/id_rsa Username:docker}
I0414 17:39:43.387489 206309 ssh_runner.go:195] Run: cat /etc/os-release
I0414 17:39:43.393038 206309 info.go:137] Remote host: Buildroot 2023.02.9
I0414 17:39:43.393065 206309 filesync.go:126] Scanning /home/jenkins/minikube-integration/20349-149500/.minikube/addons for local assets ...
I0414 17:39:43.393148 206309 filesync.go:126] Scanning /home/jenkins/minikube-integration/20349-149500/.minikube/files for local assets ...
I0414 17:39:43.393256 206309 filesync.go:149] local asset: /home/jenkins/minikube-integration/20349-149500/.minikube/files/etc/ssl/certs/1566332.pem -> 1566332.pem in /etc/ssl/certs
I0414 17:39:43.393393 206309 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0414 17:39:43.403782 206309 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20349-149500/.minikube/files/etc/ssl/certs/1566332.pem --> /etc/ssl/certs/1566332.pem (1708 bytes)
I0414 17:39:43.431753 206309 start.go:296] duration metric: took 137.238727ms for postStartSetup
I0414 17:39:43.431803 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetConfigRaw
I0414 17:39:43.432345 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetIP
I0414 17:39:43.435200 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has defined MAC address 52:54:00:d8:47:6d in network mk-old-k8s-version-768580
I0414 17:39:43.435632 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:47:6d", ip: ""} in network mk-old-k8s-version-768580: {Iface:virbr4 ExpiryTime:2025-04-14 18:39:34 +0000 UTC Type:0 Mac:52:54:00:d8:47:6d Iaid: IPaddr:192.168.72.58 Prefix:24 Hostname:old-k8s-version-768580 Clientid:01:52:54:00:d8:47:6d}
I0414 17:39:43.435656 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has defined IP address 192.168.72.58 and MAC address 52:54:00:d8:47:6d in network mk-old-k8s-version-768580
I0414 17:39:43.435905 206309 profile.go:143] Saving config to /home/jenkins/minikube-integration/20349-149500/.minikube/profiles/old-k8s-version-768580/config.json ...
I0414 17:39:43.436065 206309 start.go:128] duration metric: took 25.459688147s to createHost
I0414 17:39:43.436084 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetSSHHostname
I0414 17:39:43.438591 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has defined MAC address 52:54:00:d8:47:6d in network mk-old-k8s-version-768580
I0414 17:39:43.438941 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:47:6d", ip: ""} in network mk-old-k8s-version-768580: {Iface:virbr4 ExpiryTime:2025-04-14 18:39:34 +0000 UTC Type:0 Mac:52:54:00:d8:47:6d Iaid: IPaddr:192.168.72.58 Prefix:24 Hostname:old-k8s-version-768580 Clientid:01:52:54:00:d8:47:6d}
I0414 17:39:43.438967 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has defined IP address 192.168.72.58 and MAC address 52:54:00:d8:47:6d in network mk-old-k8s-version-768580
I0414 17:39:43.439138 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetSSHPort
I0414 17:39:43.439342 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetSSHKeyPath
I0414 17:39:43.439518 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetSSHKeyPath
I0414 17:39:43.439686 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetSSHUsername
I0414 17:39:43.439895 206309 main.go:141] libmachine: Using SSH client type: native
I0414 17:39:43.440160 206309 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.72.58 22 <nil> <nil>}
I0414 17:39:43.440180 206309 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0414 17:39:43.546702 206309 main.go:141] libmachine: SSH cmd err, output: <nil>: 1744652383.520454048
I0414 17:39:43.546726 206309 fix.go:216] guest clock: 1744652383.520454048
I0414 17:39:43.546735 206309 fix.go:229] Guest: 2025-04-14 17:39:43.520454048 +0000 UTC Remote: 2025-04-14 17:39:43.436074629 +0000 UTC m=+29.751364015 (delta=84.379419ms)
I0414 17:39:43.546765 206309 fix.go:200] guest clock delta is within tolerance: 84.379419ms
I0414 17:39:43.546772 206309 start.go:83] releasing machines lock for "old-k8s-version-768580", held for 25.570551162s
I0414 17:39:43.546801 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .DriverName
I0414 17:39:43.547104 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetIP
I0414 17:39:43.550401 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has defined MAC address 52:54:00:d8:47:6d in network mk-old-k8s-version-768580
I0414 17:39:43.550768 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:47:6d", ip: ""} in network mk-old-k8s-version-768580: {Iface:virbr4 ExpiryTime:2025-04-14 18:39:34 +0000 UTC Type:0 Mac:52:54:00:d8:47:6d Iaid: IPaddr:192.168.72.58 Prefix:24 Hostname:old-k8s-version-768580 Clientid:01:52:54:00:d8:47:6d}
I0414 17:39:43.550797 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has defined IP address 192.168.72.58 and MAC address 52:54:00:d8:47:6d in network mk-old-k8s-version-768580
I0414 17:39:43.550932 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .DriverName
I0414 17:39:43.551471 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .DriverName
I0414 17:39:43.551658 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .DriverName
I0414 17:39:43.551750 206309 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0414 17:39:43.551789 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetSSHHostname
I0414 17:39:43.551892 206309 ssh_runner.go:195] Run: cat /version.json
I0414 17:39:43.551916 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetSSHHostname
I0414 17:39:43.554584 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has defined MAC address 52:54:00:d8:47:6d in network mk-old-k8s-version-768580
I0414 17:39:43.554847 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has defined MAC address 52:54:00:d8:47:6d in network mk-old-k8s-version-768580
I0414 17:39:43.554892 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:47:6d", ip: ""} in network mk-old-k8s-version-768580: {Iface:virbr4 ExpiryTime:2025-04-14 18:39:34 +0000 UTC Type:0 Mac:52:54:00:d8:47:6d Iaid: IPaddr:192.168.72.58 Prefix:24 Hostname:old-k8s-version-768580 Clientid:01:52:54:00:d8:47:6d}
I0414 17:39:43.554917 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has defined IP address 192.168.72.58 and MAC address 52:54:00:d8:47:6d in network mk-old-k8s-version-768580
I0414 17:39:43.555095 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetSSHPort
I0414 17:39:43.555259 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetSSHKeyPath
I0414 17:39:43.555297 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:47:6d", ip: ""} in network mk-old-k8s-version-768580: {Iface:virbr4 ExpiryTime:2025-04-14 18:39:34 +0000 UTC Type:0 Mac:52:54:00:d8:47:6d Iaid: IPaddr:192.168.72.58 Prefix:24 Hostname:old-k8s-version-768580 Clientid:01:52:54:00:d8:47:6d}
I0414 17:39:43.555321 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has defined IP address 192.168.72.58 and MAC address 52:54:00:d8:47:6d in network mk-old-k8s-version-768580
I0414 17:39:43.555437 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetSSHUsername
I0414 17:39:43.555499 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetSSHPort
I0414 17:39:43.555568 206309 sshutil.go:53] new ssh client: &{IP:192.168.72.58 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20349-149500/.minikube/machines/old-k8s-version-768580/id_rsa Username:docker}
I0414 17:39:43.555586 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetSSHKeyPath
I0414 17:39:43.555669 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetSSHUsername
I0414 17:39:43.555764 206309 sshutil.go:53] new ssh client: &{IP:192.168.72.58 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20349-149500/.minikube/machines/old-k8s-version-768580/id_rsa Username:docker}
I0414 17:39:43.671272 206309 ssh_runner.go:195] Run: systemctl --version
I0414 17:39:43.681482 206309 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0414 17:39:43.851355 206309 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0414 17:39:43.858204 206309 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0414 17:39:43.858287 206309 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0414 17:39:43.878012 206309 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0414 17:39:43.878034 206309 start.go:495] detecting cgroup driver to use...
I0414 17:39:43.878118 206309 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0414 17:39:43.903925 206309 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0414 17:39:43.926852 206309 docker.go:217] disabling cri-docker service (if available) ...
I0414 17:39:43.926926 206309 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0414 17:39:43.947243 206309 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0414 17:39:43.966830 206309 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0414 17:39:44.156390 206309 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0414 17:39:44.528090 206309 docker.go:233] disabling docker service ...
I0414 17:39:44.528164 206309 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0414 17:39:44.602105 206309 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0414 17:39:44.629760 206309 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0414 17:39:44.831044 206309 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0414 17:39:44.985015 206309 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0414 17:39:45.000517 206309 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0414 17:39:45.030658 206309 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0414 17:39:45.030738 206309 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0414 17:39:45.041783 206309 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0414 17:39:45.041880 206309 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0414 17:39:45.052915 206309 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0414 17:39:45.064386 206309 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0414 17:39:45.077283 206309 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0414 17:39:45.088191 206309 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0414 17:39:45.098248 206309 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0414 17:39:45.098290 206309 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0414 17:39:45.112555 206309 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0414 17:39:45.124069 206309 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0414 17:39:45.253393 206309 ssh_runner.go:195] Run: sudo systemctl restart crio
I0414 17:39:45.392843 206309 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0414 17:39:45.392921 206309 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0414 17:39:45.399668 206309 start.go:563] Will wait 60s for crictl version
I0414 17:39:45.399730 206309 ssh_runner.go:195] Run: which crictl
I0414 17:39:45.404903 206309 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0414 17:39:45.454416 206309 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0414 17:39:45.454515 206309 ssh_runner.go:195] Run: crio --version
I0414 17:39:45.492346 206309 ssh_runner.go:195] Run: crio --version
I0414 17:39:45.532360 206309 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0414 17:39:45.533486 206309 main.go:141] libmachine: (old-k8s-version-768580) Calling .GetIP
I0414 17:39:45.537286 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has defined MAC address 52:54:00:d8:47:6d in network mk-old-k8s-version-768580
I0414 17:39:45.537978 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:47:6d", ip: ""} in network mk-old-k8s-version-768580: {Iface:virbr4 ExpiryTime:2025-04-14 18:39:34 +0000 UTC Type:0 Mac:52:54:00:d8:47:6d Iaid: IPaddr:192.168.72.58 Prefix:24 Hostname:old-k8s-version-768580 Clientid:01:52:54:00:d8:47:6d}
I0414 17:39:45.538007 206309 main.go:141] libmachine: (old-k8s-version-768580) DBG | domain old-k8s-version-768580 has defined IP address 192.168.72.58 and MAC address 52:54:00:d8:47:6d in network mk-old-k8s-version-768580
I0414 17:39:45.538265 206309 ssh_runner.go:195] Run: grep 192.168.72.1 host.minikube.internal$ /etc/hosts
I0414 17:39:45.545601 206309 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.72.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0414 17:39:45.573179 206309 kubeadm.go:883] updating cluster {Name:old-k8s-version-768580 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-
version-768580 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.58 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUI
D:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0414 17:39:45.573309 206309 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0414 17:39:45.573374 206309 ssh_runner.go:195] Run: sudo crictl images --output json
I0414 17:39:45.627730 206309 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0414 17:39:45.627801 206309 ssh_runner.go:195] Run: which lz4
I0414 17:39:45.633064 206309 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0414 17:39:45.639003 206309 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0414 17:39:45.639033 206309 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20349-149500/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0414 17:39:47.899622 206309 crio.go:462] duration metric: took 2.26662892s to copy over tarball
I0414 17:39:47.899745 206309 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0414 17:39:50.954958 206309 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.055176713s)
I0414 17:39:50.954990 206309 crio.go:469] duration metric: took 3.055335621s to extract the tarball
I0414 17:39:50.955022 206309 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0414 17:39:51.019112 206309 ssh_runner.go:195] Run: sudo crictl images --output json
I0414 17:39:51.082680 206309 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0414 17:39:51.082702 206309 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0414 17:39:51.082749 206309 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0414 17:39:51.082767 206309 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0414 17:39:51.082962 206309 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0414 17:39:51.082981 206309 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0414 17:39:51.083010 206309 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0414 17:39:51.082970 206309 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0414 17:39:51.083155 206309 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0414 17:39:51.083538 206309 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0414 17:39:51.084253 206309 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0414 17:39:51.085890 206309 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0414 17:39:51.086002 206309 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0414 17:39:51.086239 206309 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0414 17:39:51.086334 206309 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0414 17:39:51.086445 206309 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0414 17:39:51.088104 206309 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0414 17:39:51.088399 206309 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0414 17:39:51.225192 206309 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0414 17:39:51.225193 206309 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0414 17:39:51.227336 206309 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0414 17:39:51.228230 206309 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0414 17:39:51.229798 206309 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0414 17:39:51.230315 206309 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0414 17:39:51.246308 206309 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0414 17:39:51.409327 206309 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0414 17:39:51.409349 206309 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0414 17:39:51.409376 206309 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0414 17:39:51.409387 206309 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0414 17:39:51.409387 206309 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0414 17:39:51.409405 206309 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0414 17:39:51.409408 206309 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0414 17:39:51.409430 206309 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0414 17:39:51.409436 206309 ssh_runner.go:195] Run: which crictl
I0414 17:39:51.409440 206309 ssh_runner.go:195] Run: which crictl
I0414 17:39:51.409447 206309 ssh_runner.go:195] Run: which crictl
I0414 17:39:51.409456 206309 ssh_runner.go:195] Run: which crictl
I0414 17:39:51.433078 206309 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0414 17:39:51.433139 206309 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0414 17:39:51.433168 206309 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0414 17:39:51.433193 206309 ssh_runner.go:195] Run: which crictl
I0414 17:39:51.433200 206309 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0414 17:39:51.433240 206309 ssh_runner.go:195] Run: which crictl
I0414 17:39:51.439135 206309 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0414 17:39:51.439160 206309 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0414 17:39:51.439170 206309 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0414 17:39:51.439224 206309 ssh_runner.go:195] Run: which crictl
I0414 17:39:51.439282 206309 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0414 17:39:51.439295 206309 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0414 17:39:51.439360 206309 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0414 17:39:51.442543 206309 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0414 17:39:51.444143 206309 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0414 17:39:51.593190 206309 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0414 17:39:51.593421 206309 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0414 17:39:51.612429 206309 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0414 17:39:51.612525 206309 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0414 17:39:51.612602 206309 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0414 17:39:51.612672 206309 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0414 17:39:51.612712 206309 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0414 17:39:51.735373 206309 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0414 17:39:51.735639 206309 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0414 17:39:51.770519 206309 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0414 17:39:51.770519 206309 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0414 17:39:51.778792 206309 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0414 17:39:51.778851 206309 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0414 17:39:51.778901 206309 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0414 17:39:51.916148 206309 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0414 17:39:51.916170 206309 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20349-149500/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0414 17:39:51.939350 206309 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20349-149500/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0414 17:39:51.939413 206309 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20349-149500/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0414 17:39:51.961049 206309 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20349-149500/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0414 17:39:51.961108 206309 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20349-149500/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0414 17:39:51.961145 206309 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20349-149500/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0414 17:39:51.981763 206309 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20349-149500/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0414 17:39:52.100174 206309 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0414 17:39:52.240553 206309 cache_images.go:92] duration metric: took 1.157833313s to LoadCachedImages
W0414 17:39:52.240669 206309 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20349-149500/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20349-149500/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0: no such file or directory
I0414 17:39:52.240692 206309 kubeadm.go:934] updating node { 192.168.72.58 8443 v1.20.0 crio true true} ...
I0414 17:39:52.240851 206309 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-768580 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.72.58
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-768580 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0414 17:39:52.240934 206309 ssh_runner.go:195] Run: crio config
I0414 17:39:52.294911 206309 cni.go:84] Creating CNI manager for ""
I0414 17:39:52.294952 206309 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0414 17:39:52.294969 206309 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0414 17:39:52.294996 206309 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.72.58 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-768580 NodeName:old-k8s-version-768580 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.72.58"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.72.58 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Stati
cPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0414 17:39:52.295169 206309 kubeadm.go:195] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.72.58
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-768580"
kubeletExtraArgs:
node-ip: 192.168.72.58
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.72.58"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0414 17:39:52.295240 206309 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0414 17:39:52.305980 206309 binaries.go:44] Found k8s binaries, skipping transfer
I0414 17:39:52.306047 206309 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0414 17:39:52.317069 206309 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (429 bytes)
I0414 17:39:52.336081 206309 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0414 17:39:52.354224 206309 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2120 bytes)
I0414 17:39:52.373660 206309 ssh_runner.go:195] Run: grep 192.168.72.58 control-plane.minikube.internal$ /etc/hosts
I0414 17:39:52.378934 206309 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.72.58 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0414 17:39:52.394742 206309 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0414 17:39:52.551228 206309 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0414 17:39:52.573012 206309 certs.go:68] Setting up /home/jenkins/minikube-integration/20349-149500/.minikube/profiles/old-k8s-version-768580 for IP: 192.168.72.58
I0414 17:39:52.573034 206309 certs.go:194] generating shared ca certs ...
I0414 17:39:52.573050 206309 certs.go:226] acquiring lock for ca certs: {Name:mk65518f71a0fe967168d84423f624d889cf0622 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0414 17:39:52.573226 206309 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20349-149500/.minikube/ca.key
I0414 17:39:52.573280 206309 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20349-149500/.minikube/proxy-client-ca.key
I0414 17:39:52.573293 206309 certs.go:256] generating profile certs ...
I0414 17:39:52.573361 206309 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/20349-149500/.minikube/profiles/old-k8s-version-768580/client.key
I0414 17:39:52.573382 206309 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20349-149500/.minikube/profiles/old-k8s-version-768580/client.crt with IP's: []
I0414 17:39:52.792482 206309 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20349-149500/.minikube/profiles/old-k8s-version-768580/client.crt ...
I0414 17:39:52.792513 206309 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20349-149500/.minikube/profiles/old-k8s-version-768580/client.crt: {Name:mk8b565709e9f8ca97c9a4b1a9f5acd5ea05c4c9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0414 17:39:52.829084 206309 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20349-149500/.minikube/profiles/old-k8s-version-768580/client.key ...
I0414 17:39:52.829127 206309 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20349-149500/.minikube/profiles/old-k8s-version-768580/client.key: {Name:mk52dd8773c8c55cd3fca6cbbe90eecea9a8988a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0414 17:39:52.829265 206309 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20349-149500/.minikube/profiles/old-k8s-version-768580/apiserver.key.0f5f550a
I0414 17:39:52.829286 206309 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20349-149500/.minikube/profiles/old-k8s-version-768580/apiserver.crt.0f5f550a with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.72.58]
I0414 17:39:53.132546 206309 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20349-149500/.minikube/profiles/old-k8s-version-768580/apiserver.crt.0f5f550a ...
I0414 17:39:53.132579 206309 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20349-149500/.minikube/profiles/old-k8s-version-768580/apiserver.crt.0f5f550a: {Name:mk4927613f2d2a5d70279b14a038fff00965a4ae Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0414 17:39:53.132753 206309 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20349-149500/.minikube/profiles/old-k8s-version-768580/apiserver.key.0f5f550a ...
I0414 17:39:53.132773 206309 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20349-149500/.minikube/profiles/old-k8s-version-768580/apiserver.key.0f5f550a: {Name:mk050758690dfc7fe46b11bc5076f7d397c27980 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0414 17:39:53.132886 206309 certs.go:381] copying /home/jenkins/minikube-integration/20349-149500/.minikube/profiles/old-k8s-version-768580/apiserver.crt.0f5f550a -> /home/jenkins/minikube-integration/20349-149500/.minikube/profiles/old-k8s-version-768580/apiserver.crt
I0414 17:39:53.132979 206309 certs.go:385] copying /home/jenkins/minikube-integration/20349-149500/.minikube/profiles/old-k8s-version-768580/apiserver.key.0f5f550a -> /home/jenkins/minikube-integration/20349-149500/.minikube/profiles/old-k8s-version-768580/apiserver.key
I0414 17:39:53.133085 206309 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/20349-149500/.minikube/profiles/old-k8s-version-768580/proxy-client.key
I0414 17:39:53.133110 206309 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20349-149500/.minikube/profiles/old-k8s-version-768580/proxy-client.crt with IP's: []
I0414 17:39:53.317041 206309 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20349-149500/.minikube/profiles/old-k8s-version-768580/proxy-client.crt ...
I0414 17:39:53.317075 206309 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20349-149500/.minikube/profiles/old-k8s-version-768580/proxy-client.crt: {Name:mk397457229ba89e10f48579a72181e917a0fda2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0414 17:39:53.317259 206309 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20349-149500/.minikube/profiles/old-k8s-version-768580/proxy-client.key ...
I0414 17:39:53.317277 206309 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20349-149500/.minikube/profiles/old-k8s-version-768580/proxy-client.key: {Name:mk42997316fa111458b9a6ec311841e9d07e7e30 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0414 17:39:53.317481 206309 certs.go:484] found cert: /home/jenkins/minikube-integration/20349-149500/.minikube/certs/156633.pem (1338 bytes)
W0414 17:39:53.317525 206309 certs.go:480] ignoring /home/jenkins/minikube-integration/20349-149500/.minikube/certs/156633_empty.pem, impossibly tiny 0 bytes
I0414 17:39:53.317537 206309 certs.go:484] found cert: /home/jenkins/minikube-integration/20349-149500/.minikube/certs/ca-key.pem (1679 bytes)
I0414 17:39:53.317559 206309 certs.go:484] found cert: /home/jenkins/minikube-integration/20349-149500/.minikube/certs/ca.pem (1082 bytes)
I0414 17:39:53.317581 206309 certs.go:484] found cert: /home/jenkins/minikube-integration/20349-149500/.minikube/certs/cert.pem (1123 bytes)
I0414 17:39:53.317601 206309 certs.go:484] found cert: /home/jenkins/minikube-integration/20349-149500/.minikube/certs/key.pem (1675 bytes)
I0414 17:39:53.317638 206309 certs.go:484] found cert: /home/jenkins/minikube-integration/20349-149500/.minikube/files/etc/ssl/certs/1566332.pem (1708 bytes)
I0414 17:39:53.318201 206309 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20349-149500/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0414 17:39:53.347651 206309 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20349-149500/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0414 17:39:53.373696 206309 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20349-149500/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0414 17:39:53.407644 206309 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20349-149500/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0414 17:39:53.451777 206309 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20349-149500/.minikube/profiles/old-k8s-version-768580/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0414 17:39:53.485639 206309 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20349-149500/.minikube/profiles/old-k8s-version-768580/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0414 17:39:53.530893 206309 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20349-149500/.minikube/profiles/old-k8s-version-768580/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0414 17:39:53.557713 206309 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20349-149500/.minikube/profiles/old-k8s-version-768580/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0414 17:39:53.590437 206309 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20349-149500/.minikube/files/etc/ssl/certs/1566332.pem --> /usr/share/ca-certificates/1566332.pem (1708 bytes)
I0414 17:39:53.618860 206309 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20349-149500/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0414 17:39:53.646052 206309 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20349-149500/.minikube/certs/156633.pem --> /usr/share/ca-certificates/156633.pem (1338 bytes)
I0414 17:39:53.672341 206309 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0414 17:39:53.690529 206309 ssh_runner.go:195] Run: openssl version
I0414 17:39:53.696380 206309 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1566332.pem && ln -fs /usr/share/ca-certificates/1566332.pem /etc/ssl/certs/1566332.pem"
I0414 17:39:53.706862 206309 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1566332.pem
I0414 17:39:53.711541 206309 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Apr 14 16:39 /usr/share/ca-certificates/1566332.pem
I0414 17:39:53.711593 206309 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1566332.pem
I0414 17:39:53.717430 206309 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/1566332.pem /etc/ssl/certs/3ec20f2e.0"
I0414 17:39:53.728150 206309 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0414 17:39:53.744238 206309 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0414 17:39:53.748999 206309 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Apr 14 16:31 /usr/share/ca-certificates/minikubeCA.pem
I0414 17:39:53.749049 206309 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0414 17:39:53.755573 206309 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0414 17:39:53.767120 206309 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/156633.pem && ln -fs /usr/share/ca-certificates/156633.pem /etc/ssl/certs/156633.pem"
I0414 17:39:53.778471 206309 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/156633.pem
I0414 17:39:53.783396 206309 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Apr 14 16:39 /usr/share/ca-certificates/156633.pem
I0414 17:39:53.783446 206309 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/156633.pem
I0414 17:39:53.789381 206309 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/156633.pem /etc/ssl/certs/51391683.0"
I0414 17:39:53.801452 206309 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0414 17:39:53.805633 206309 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0414 17:39:53.805676 206309 kubeadm.go:392] StartCluster: {Name:old-k8s-version-768580 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-ver
sion-768580 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.58 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:d
ocker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0414 17:39:53.805737 206309 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0414 17:39:53.805797 206309 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0414 17:39:53.845948 206309 cri.go:89] found id: ""
I0414 17:39:53.846023 206309 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0414 17:39:53.855666 206309 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0414 17:39:53.865017 206309 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0414 17:39:53.874162 206309 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0414 17:39:53.874184 206309 kubeadm.go:157] found existing configuration files:
I0414 17:39:53.874222 206309 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0414 17:39:53.883558 206309 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0414 17:39:53.883611 206309 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0414 17:39:53.892474 206309 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0414 17:39:53.901219 206309 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0414 17:39:53.901293 206309 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0414 17:39:53.910693 206309 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0414 17:39:53.919775 206309 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0414 17:39:53.919833 206309 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0414 17:39:53.928940 206309 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0414 17:39:53.937440 206309 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0414 17:39:53.937488 206309 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0414 17:39:53.946281 206309 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0414 17:39:54.059833 206309 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0414 17:39:54.060065 206309 kubeadm.go:310] [preflight] Running pre-flight checks
I0414 17:39:54.208911 206309 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0414 17:39:54.209111 206309 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0414 17:39:54.209262 206309 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0414 17:39:54.425910 206309 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0414 17:39:54.427837 206309 out.go:235] - Generating certificates and keys ...
I0414 17:39:54.427939 206309 kubeadm.go:310] [certs] Using existing ca certificate authority
I0414 17:39:54.428024 206309 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0414 17:39:54.503982 206309 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0414 17:39:54.625623 206309 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0414 17:39:54.756443 206309 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0414 17:39:54.915076 206309 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0414 17:39:55.161590 206309 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0414 17:39:55.164486 206309 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-768580] and IPs [192.168.72.58 127.0.0.1 ::1]
I0414 17:39:55.442602 206309 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0414 17:39:55.448742 206309 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-768580] and IPs [192.168.72.58 127.0.0.1 ::1]
I0414 17:39:55.552538 206309 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0414 17:39:55.604447 206309 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0414 17:39:55.711716 206309 kubeadm.go:310] [certs] Generating "sa" key and public key
I0414 17:39:55.712077 206309 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0414 17:39:55.851022 206309 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0414 17:39:56.036736 206309 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0414 17:39:56.249486 206309 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0414 17:39:56.469019 206309 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0414 17:39:56.487822 206309 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0414 17:39:56.487979 206309 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0414 17:39:56.488359 206309 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0414 17:39:56.632258 206309 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0414 17:39:56.634014 206309 out.go:235] - Booting up control plane ...
I0414 17:39:56.634151 206309 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0414 17:39:56.641961 206309 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0414 17:39:56.643439 206309 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0414 17:39:56.644497 206309 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0414 17:39:56.649647 206309 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0414 17:40:36.645012 206309 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0414 17:40:36.646137 206309 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0414 17:40:36.646397 206309 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0414 17:40:41.646714 206309 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0414 17:40:41.646985 206309 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0414 17:40:51.646170 206309 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0414 17:40:51.646398 206309 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0414 17:41:11.645884 206309 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0414 17:41:11.646149 206309 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0414 17:41:51.648073 206309 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0414 17:41:51.648601 206309 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0414 17:41:51.648662 206309 kubeadm.go:310]
I0414 17:41:51.648766 206309 kubeadm.go:310] Unfortunately, an error has occurred:
I0414 17:41:51.648865 206309 kubeadm.go:310] timed out waiting for the condition
I0414 17:41:51.648877 206309 kubeadm.go:310]
I0414 17:41:51.648984 206309 kubeadm.go:310] This error is likely caused by:
I0414 17:41:51.649077 206309 kubeadm.go:310] - The kubelet is not running
I0414 17:41:51.649323 206309 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0414 17:41:51.649334 206309 kubeadm.go:310]
I0414 17:41:51.649545 206309 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0414 17:41:51.649633 206309 kubeadm.go:310] - 'systemctl status kubelet'
I0414 17:41:51.649714 206309 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0414 17:41:51.649730 206309 kubeadm.go:310]
I0414 17:41:51.649995 206309 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0414 17:41:51.650180 206309 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0414 17:41:51.650197 206309 kubeadm.go:310]
I0414 17:41:51.650426 206309 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0414 17:41:51.650570 206309 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0414 17:41:51.650671 206309 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0414 17:41:51.650940 206309 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0414 17:41:51.650977 206309 kubeadm.go:310]
I0414 17:41:51.651349 206309 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0414 17:41:51.651599 206309 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0414 17:41:51.652086 206309 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
W0414 17:41:51.652210 206309 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-768580] and IPs [192.168.72.58 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-768580] and IPs [192.168.72.58 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-768580] and IPs [192.168.72.58 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-768580] and IPs [192.168.72.58 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0414 17:41:51.652253 206309 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0414 17:41:53.756939 206309 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (2.104664248s)
I0414 17:41:53.757011 206309 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0414 17:41:53.774517 206309 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0414 17:41:53.784836 206309 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0414 17:41:53.784859 206309 kubeadm.go:157] found existing configuration files:
I0414 17:41:53.784913 206309 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0414 17:41:53.794788 206309 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0414 17:41:53.794852 206309 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0414 17:41:53.804698 206309 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0414 17:41:53.813875 206309 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0414 17:41:53.813911 206309 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0414 17:41:53.823405 206309 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0414 17:41:53.832593 206309 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0414 17:41:53.832679 206309 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0414 17:41:53.842043 206309 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0414 17:41:53.851036 206309 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0414 17:41:53.851069 206309 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0414 17:41:53.860340 206309 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0414 17:41:54.074132 206309 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0414 17:43:50.183690 206309 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0414 17:43:50.183827 206309 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0414 17:43:50.185577 206309 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0414 17:43:50.185639 206309 kubeadm.go:310] [preflight] Running pre-flight checks
I0414 17:43:50.185741 206309 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0414 17:43:50.185893 206309 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0414 17:43:50.186053 206309 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0414 17:43:50.186148 206309 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0414 17:43:50.188412 206309 out.go:235] - Generating certificates and keys ...
I0414 17:43:50.188524 206309 kubeadm.go:310] [certs] Using existing ca certificate authority
I0414 17:43:50.188638 206309 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0414 17:43:50.188758 206309 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0414 17:43:50.188859 206309 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0414 17:43:50.188964 206309 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0414 17:43:50.189068 206309 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0414 17:43:50.189157 206309 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0414 17:43:50.189248 206309 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0414 17:43:50.189316 206309 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0414 17:43:50.189422 206309 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0414 17:43:50.189481 206309 kubeadm.go:310] [certs] Using the existing "sa" key
I0414 17:43:50.189556 206309 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0414 17:43:50.189625 206309 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0414 17:43:50.189701 206309 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0414 17:43:50.189797 206309 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0414 17:43:50.189901 206309 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0414 17:43:50.190031 206309 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0414 17:43:50.190146 206309 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0414 17:43:50.190200 206309 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0414 17:43:50.190288 206309 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0414 17:43:50.191806 206309 out.go:235] - Booting up control plane ...
I0414 17:43:50.191910 206309 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0414 17:43:50.192028 206309 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0414 17:43:50.192129 206309 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0414 17:43:50.192239 206309 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0414 17:43:50.192443 206309 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0414 17:43:50.192522 206309 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0414 17:43:50.192614 206309 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0414 17:43:50.192873 206309 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0414 17:43:50.192968 206309 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0414 17:43:50.193209 206309 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0414 17:43:50.193314 206309 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0414 17:43:50.193585 206309 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0414 17:43:50.193696 206309 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0414 17:43:50.193997 206309 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0414 17:43:50.194133 206309 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0414 17:43:50.194385 206309 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0414 17:43:50.194394 206309 kubeadm.go:310]
I0414 17:43:50.194439 206309 kubeadm.go:310] Unfortunately, an error has occurred:
I0414 17:43:50.194511 206309 kubeadm.go:310] timed out waiting for the condition
I0414 17:43:50.194524 206309 kubeadm.go:310]
I0414 17:43:50.194553 206309 kubeadm.go:310] This error is likely caused by:
I0414 17:43:50.194583 206309 kubeadm.go:310] - The kubelet is not running
I0414 17:43:50.194671 206309 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0414 17:43:50.194680 206309 kubeadm.go:310]
I0414 17:43:50.194770 206309 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0414 17:43:50.194812 206309 kubeadm.go:310] - 'systemctl status kubelet'
I0414 17:43:50.194859 206309 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0414 17:43:50.194867 206309 kubeadm.go:310]
I0414 17:43:50.194971 206309 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0414 17:43:50.195106 206309 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0414 17:43:50.195118 206309 kubeadm.go:310]
I0414 17:43:50.195289 206309 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0414 17:43:50.195439 206309 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0414 17:43:50.195551 206309 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0414 17:43:50.195651 206309 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0414 17:43:50.195672 206309 kubeadm.go:310]
I0414 17:43:50.195732 206309 kubeadm.go:394] duration metric: took 3m56.390060019s to StartCluster
I0414 17:43:50.195792 206309 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0414 17:43:50.195856 206309 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0414 17:43:50.249637 206309 cri.go:89] found id: ""
I0414 17:43:50.249668 206309 logs.go:282] 0 containers: []
W0414 17:43:50.249679 206309 logs.go:284] No container was found matching "kube-apiserver"
I0414 17:43:50.249687 206309 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0414 17:43:50.249745 206309 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0414 17:43:50.293936 206309 cri.go:89] found id: ""
I0414 17:43:50.293966 206309 logs.go:282] 0 containers: []
W0414 17:43:50.293976 206309 logs.go:284] No container was found matching "etcd"
I0414 17:43:50.293983 206309 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0414 17:43:50.294041 206309 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0414 17:43:50.329596 206309 cri.go:89] found id: ""
I0414 17:43:50.329626 206309 logs.go:282] 0 containers: []
W0414 17:43:50.329637 206309 logs.go:284] No container was found matching "coredns"
I0414 17:43:50.329645 206309 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0414 17:43:50.329711 206309 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0414 17:43:50.368166 206309 cri.go:89] found id: ""
I0414 17:43:50.368198 206309 logs.go:282] 0 containers: []
W0414 17:43:50.368211 206309 logs.go:284] No container was found matching "kube-scheduler"
I0414 17:43:50.368219 206309 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0414 17:43:50.368288 206309 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0414 17:43:50.400868 206309 cri.go:89] found id: ""
I0414 17:43:50.400897 206309 logs.go:282] 0 containers: []
W0414 17:43:50.400910 206309 logs.go:284] No container was found matching "kube-proxy"
I0414 17:43:50.400922 206309 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0414 17:43:50.400988 206309 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0414 17:43:50.435204 206309 cri.go:89] found id: ""
I0414 17:43:50.435231 206309 logs.go:282] 0 containers: []
W0414 17:43:50.435241 206309 logs.go:284] No container was found matching "kube-controller-manager"
I0414 17:43:50.435249 206309 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0414 17:43:50.435311 206309 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0414 17:43:50.471048 206309 cri.go:89] found id: ""
I0414 17:43:50.471074 206309 logs.go:282] 0 containers: []
W0414 17:43:50.471082 206309 logs.go:284] No container was found matching "kindnet"
I0414 17:43:50.471091 206309 logs.go:123] Gathering logs for kubelet ...
I0414 17:43:50.471106 206309 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0414 17:43:50.523379 206309 logs.go:123] Gathering logs for dmesg ...
I0414 17:43:50.523412 206309 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0414 17:43:50.536422 206309 logs.go:123] Gathering logs for describe nodes ...
I0414 17:43:50.536452 206309 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0414 17:43:50.709803 206309 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0414 17:43:50.709839 206309 logs.go:123] Gathering logs for CRI-O ...
I0414 17:43:50.709857 206309 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0414 17:43:50.876341 206309 logs.go:123] Gathering logs for container status ...
I0414 17:43:50.876381 206309 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0414 17:43:50.927118 206309 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0414 17:43:50.927170 206309 out.go:270] *
*
W0414 17:43:50.927230 206309 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0414 17:43:50.927247 206309 out.go:270] *
*
W0414 17:43:50.928334 206309 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0414 17:43:50.931905 206309 out.go:201]
W0414 17:43:50.933510 206309 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0414 17:43:50.933554 206309 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0414 17:43:50.933580 206309 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0414 17:43:50.935012 206309 out.go:201]
** /stderr **
start_stop_delete_test.go:186: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-768580 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-768580 -n old-k8s-version-768580
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-768580 -n old-k8s-version-768580: exit status 6 (267.940407ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0414 17:43:51.251051 212839 status.go:458] kubeconfig endpoint: get endpoint: "old-k8s-version-768580" does not appear in /home/jenkins/minikube-integration/20349-149500/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-768580" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (277.59s)