=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-239315 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-239315 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m51.514239239s)
-- stdout --
* [old-k8s-version-239315] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=18358
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/18358-11004/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/18358-11004/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-239315" primary control-plane node in "old-k8s-version-239315" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0311 21:23:25.423576 63745 out.go:291] Setting OutFile to fd 1 ...
I0311 21:23:25.423731 63745 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0311 21:23:25.423743 63745 out.go:304] Setting ErrFile to fd 2...
I0311 21:23:25.423749 63745 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0311 21:23:25.424043 63745 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18358-11004/.minikube/bin
I0311 21:23:25.424841 63745 out.go:298] Setting JSON to false
I0311 21:23:25.426320 63745 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-13","uptime":7554,"bootTime":1710184651,"procs":300,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1053-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0311 21:23:25.426443 63745 start.go:139] virtualization: kvm guest
I0311 21:23:25.428577 63745 out.go:177] * [old-k8s-version-239315] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
I0311 21:23:25.430388 63745 out.go:177] - MINIKUBE_LOCATION=18358
I0311 21:23:25.430433 63745 notify.go:220] Checking for updates...
I0311 21:23:25.431707 63745 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0311 21:23:25.433315 63745 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18358-11004/kubeconfig
I0311 21:23:25.434612 63745 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18358-11004/.minikube
I0311 21:23:25.435957 63745 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0311 21:23:25.437258 63745 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0311 21:23:25.438970 63745 config.go:182] Loaded profile config "bridge-427678": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0311 21:23:25.439094 63745 config.go:182] Loaded profile config "enable-default-cni-427678": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0311 21:23:25.439210 63745 config.go:182] Loaded profile config "flannel-427678": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0311 21:23:25.439329 63745 driver.go:392] Setting default libvirt URI to qemu:///system
I0311 21:23:25.482122 63745 out.go:177] * Using the kvm2 driver based on user configuration
I0311 21:23:25.483601 63745 start.go:297] selected driver: kvm2
I0311 21:23:25.483616 63745 start.go:901] validating driver "kvm2" against <nil>
I0311 21:23:25.483625 63745 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0311 21:23:25.484329 63745 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0311 21:23:25.484403 63745 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/18358-11004/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0311 21:23:25.499606 63745 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.32.0
I0311 21:23:25.499665 63745 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0311 21:23:25.499940 63745 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0311 21:23:25.499976 63745 cni.go:84] Creating CNI manager for ""
I0311 21:23:25.499983 63745 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0311 21:23:25.499988 63745 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0311 21:23:25.500055 63745 start.go:340] cluster config:
{Name:old-k8s-version-239315 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-239315 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0311 21:23:25.500175 63745 iso.go:125] acquiring lock: {Name:mk01c594acb315ed9710288d0fe2c40356bbd08e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0311 21:23:25.501958 63745 out.go:177] * Starting "old-k8s-version-239315" primary control-plane node in "old-k8s-version-239315" cluster
I0311 21:23:25.503280 63745 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0311 21:23:25.503323 63745 preload.go:147] Found local preload: /home/jenkins/minikube-integration/18358-11004/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0311 21:23:25.503335 63745 cache.go:56] Caching tarball of preloaded images
I0311 21:23:25.503418 63745 preload.go:173] Found /home/jenkins/minikube-integration/18358-11004/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0311 21:23:25.503431 63745 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0311 21:23:25.503524 63745 profile.go:142] Saving config to /home/jenkins/minikube-integration/18358-11004/.minikube/profiles/old-k8s-version-239315/config.json ...
I0311 21:23:25.503548 63745 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18358-11004/.minikube/profiles/old-k8s-version-239315/config.json: {Name:mk1d4c77be6c093cca4dd64c973e62cb6e078121 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0311 21:23:25.503702 63745 start.go:360] acquireMachinesLock for old-k8s-version-239315: {Name:mk92e5668ffdba05ab9d8973476f5480b3d3956c Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0311 21:23:42.630818 63745 start.go:364] duration metric: took 17.127060027s to acquireMachinesLock for "old-k8s-version-239315"
I0311 21:23:42.630886 63745 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-239315 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-239315 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0311 21:23:42.630998 63745 start.go:125] createHost starting for "" (driver="kvm2")
I0311 21:23:42.632550 63745 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0311 21:23:42.632771 63745 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0311 21:23:42.632824 63745 main.go:141] libmachine: Launching plugin server for driver kvm2
I0311 21:23:42.652390 63745 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45679
I0311 21:23:42.652838 63745 main.go:141] libmachine: () Calling .GetVersion
I0311 21:23:42.653457 63745 main.go:141] libmachine: Using API Version 1
I0311 21:23:42.653484 63745 main.go:141] libmachine: () Calling .SetConfigRaw
I0311 21:23:42.653871 63745 main.go:141] libmachine: () Calling .GetMachineName
I0311 21:23:42.654043 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetMachineName
I0311 21:23:42.654188 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .DriverName
I0311 21:23:42.654323 63745 start.go:159] libmachine.API.Create for "old-k8s-version-239315" (driver="kvm2")
I0311 21:23:42.654351 63745 client.go:168] LocalClient.Create starting
I0311 21:23:42.654398 63745 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18358-11004/.minikube/certs/ca.pem
I0311 21:23:42.654431 63745 main.go:141] libmachine: Decoding PEM data...
I0311 21:23:42.654456 63745 main.go:141] libmachine: Parsing certificate...
I0311 21:23:42.654527 63745 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18358-11004/.minikube/certs/cert.pem
I0311 21:23:42.654551 63745 main.go:141] libmachine: Decoding PEM data...
I0311 21:23:42.654565 63745 main.go:141] libmachine: Parsing certificate...
I0311 21:23:42.654594 63745 main.go:141] libmachine: Running pre-create checks...
I0311 21:23:42.654606 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .PreCreateCheck
I0311 21:23:42.654995 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetConfigRaw
I0311 21:23:42.655404 63745 main.go:141] libmachine: Creating machine...
I0311 21:23:42.655421 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .Create
I0311 21:23:42.655556 63745 main.go:141] libmachine: (old-k8s-version-239315) Creating KVM machine...
I0311 21:23:42.656715 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | found existing default KVM network
I0311 21:23:42.658152 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | I0311 21:23:42.657991 63911 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:a7:1c:1b} reservation:<nil>}
I0311 21:23:42.659334 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | I0311 21:23:42.659243 63911 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:3a:db:63} reservation:<nil>}
I0311 21:23:42.660586 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | I0311 21:23:42.660498 63911 network.go:211] skipping subnet 192.168.61.0/24 that is taken: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName:virbr4 IfaceIPv4:192.168.61.1 IfaceMTU:1500 IfaceMAC:52:54:00:7f:c4:f8} reservation:<nil>}
I0311 21:23:42.662123 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | I0311 21:23:42.662038 63911 network.go:206] using free private subnet 192.168.72.0/24: &{IP:192.168.72.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.72.0/24 Gateway:192.168.72.1 ClientMin:192.168.72.2 ClientMax:192.168.72.254 Broadcast:192.168.72.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0003091b0}
I0311 21:23:42.662155 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | created network xml:
I0311 21:23:42.662174 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | <network>
I0311 21:23:42.662214 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | <name>mk-old-k8s-version-239315</name>
I0311 21:23:42.662240 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | <dns enable='no'/>
I0311 21:23:42.662259 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG |
I0311 21:23:42.662273 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | <ip address='192.168.72.1' netmask='255.255.255.0'>
I0311 21:23:42.662287 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | <dhcp>
I0311 21:23:42.662298 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | <range start='192.168.72.2' end='192.168.72.253'/>
I0311 21:23:42.662310 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | </dhcp>
I0311 21:23:42.662320 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | </ip>
I0311 21:23:42.662344 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG |
I0311 21:23:42.662358 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | </network>
I0311 21:23:42.662369 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG |
I0311 21:23:42.668013 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | trying to create private KVM network mk-old-k8s-version-239315 192.168.72.0/24...
I0311 21:23:42.755844 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | private KVM network mk-old-k8s-version-239315 192.168.72.0/24 created
I0311 21:23:42.755889 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | I0311 21:23:42.755832 63911 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/18358-11004/.minikube
I0311 21:23:42.755903 63745 main.go:141] libmachine: (old-k8s-version-239315) Setting up store path in /home/jenkins/minikube-integration/18358-11004/.minikube/machines/old-k8s-version-239315 ...
I0311 21:23:42.755919 63745 main.go:141] libmachine: (old-k8s-version-239315) Building disk image from file:///home/jenkins/minikube-integration/18358-11004/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso
I0311 21:23:42.755939 63745 main.go:141] libmachine: (old-k8s-version-239315) Downloading /home/jenkins/minikube-integration/18358-11004/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/18358-11004/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
I0311 21:23:43.010041 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | I0311 21:23:43.009884 63911 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/18358-11004/.minikube/machines/old-k8s-version-239315/id_rsa...
I0311 21:23:43.123845 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | I0311 21:23:43.123729 63911 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/18358-11004/.minikube/machines/old-k8s-version-239315/old-k8s-version-239315.rawdisk...
I0311 21:23:43.123912 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | Writing magic tar header
I0311 21:23:43.123991 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | Writing SSH key tar header
I0311 21:23:43.124200 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | I0311 21:23:43.124077 63911 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/18358-11004/.minikube/machines/old-k8s-version-239315 ...
I0311 21:23:43.124245 63745 main.go:141] libmachine: (old-k8s-version-239315) Setting executable bit set on /home/jenkins/minikube-integration/18358-11004/.minikube/machines/old-k8s-version-239315 (perms=drwx------)
I0311 21:23:43.124263 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18358-11004/.minikube/machines/old-k8s-version-239315
I0311 21:23:43.124278 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18358-11004/.minikube/machines
I0311 21:23:43.124291 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18358-11004/.minikube
I0311 21:23:43.124301 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18358-11004
I0311 21:23:43.124311 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0311 21:23:43.124319 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | Checking permissions on dir: /home/jenkins
I0311 21:23:43.124328 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | Checking permissions on dir: /home
I0311 21:23:43.124335 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | Skipping /home - not owner
I0311 21:23:43.124350 63745 main.go:141] libmachine: (old-k8s-version-239315) Setting executable bit set on /home/jenkins/minikube-integration/18358-11004/.minikube/machines (perms=drwxr-xr-x)
I0311 21:23:43.124362 63745 main.go:141] libmachine: (old-k8s-version-239315) Setting executable bit set on /home/jenkins/minikube-integration/18358-11004/.minikube (perms=drwxr-xr-x)
I0311 21:23:43.124373 63745 main.go:141] libmachine: (old-k8s-version-239315) Setting executable bit set on /home/jenkins/minikube-integration/18358-11004 (perms=drwxrwxr-x)
I0311 21:23:43.124381 63745 main.go:141] libmachine: (old-k8s-version-239315) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0311 21:23:43.124390 63745 main.go:141] libmachine: (old-k8s-version-239315) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0311 21:23:43.124397 63745 main.go:141] libmachine: (old-k8s-version-239315) Creating domain...
I0311 21:23:43.125783 63745 main.go:141] libmachine: (old-k8s-version-239315) define libvirt domain using xml:
I0311 21:23:43.125801 63745 main.go:141] libmachine: (old-k8s-version-239315) <domain type='kvm'>
I0311 21:23:43.125821 63745 main.go:141] libmachine: (old-k8s-version-239315) <name>old-k8s-version-239315</name>
I0311 21:23:43.125829 63745 main.go:141] libmachine: (old-k8s-version-239315) <memory unit='MiB'>2200</memory>
I0311 21:23:43.125836 63745 main.go:141] libmachine: (old-k8s-version-239315) <vcpu>2</vcpu>
I0311 21:23:43.125843 63745 main.go:141] libmachine: (old-k8s-version-239315) <features>
I0311 21:23:43.125874 63745 main.go:141] libmachine: (old-k8s-version-239315) <acpi/>
I0311 21:23:43.125881 63745 main.go:141] libmachine: (old-k8s-version-239315) <apic/>
I0311 21:23:43.125889 63745 main.go:141] libmachine: (old-k8s-version-239315) <pae/>
I0311 21:23:43.125895 63745 main.go:141] libmachine: (old-k8s-version-239315)
I0311 21:23:43.125910 63745 main.go:141] libmachine: (old-k8s-version-239315) </features>
I0311 21:23:43.125916 63745 main.go:141] libmachine: (old-k8s-version-239315) <cpu mode='host-passthrough'>
I0311 21:23:43.125923 63745 main.go:141] libmachine: (old-k8s-version-239315)
I0311 21:23:43.125928 63745 main.go:141] libmachine: (old-k8s-version-239315) </cpu>
I0311 21:23:43.125940 63745 main.go:141] libmachine: (old-k8s-version-239315) <os>
I0311 21:23:43.125947 63745 main.go:141] libmachine: (old-k8s-version-239315) <type>hvm</type>
I0311 21:23:43.125955 63745 main.go:141] libmachine: (old-k8s-version-239315) <boot dev='cdrom'/>
I0311 21:23:43.125962 63745 main.go:141] libmachine: (old-k8s-version-239315) <boot dev='hd'/>
I0311 21:23:43.125970 63745 main.go:141] libmachine: (old-k8s-version-239315) <bootmenu enable='no'/>
I0311 21:23:43.125976 63745 main.go:141] libmachine: (old-k8s-version-239315) </os>
I0311 21:23:43.125986 63745 main.go:141] libmachine: (old-k8s-version-239315) <devices>
I0311 21:23:43.125994 63745 main.go:141] libmachine: (old-k8s-version-239315) <disk type='file' device='cdrom'>
I0311 21:23:43.126007 63745 main.go:141] libmachine: (old-k8s-version-239315) <source file='/home/jenkins/minikube-integration/18358-11004/.minikube/machines/old-k8s-version-239315/boot2docker.iso'/>
I0311 21:23:43.126015 63745 main.go:141] libmachine: (old-k8s-version-239315) <target dev='hdc' bus='scsi'/>
I0311 21:23:43.126024 63745 main.go:141] libmachine: (old-k8s-version-239315) <readonly/>
I0311 21:23:43.126031 63745 main.go:141] libmachine: (old-k8s-version-239315) </disk>
I0311 21:23:43.126040 63745 main.go:141] libmachine: (old-k8s-version-239315) <disk type='file' device='disk'>
I0311 21:23:43.126048 63745 main.go:141] libmachine: (old-k8s-version-239315) <driver name='qemu' type='raw' cache='default' io='threads' />
I0311 21:23:43.126066 63745 main.go:141] libmachine: (old-k8s-version-239315) <source file='/home/jenkins/minikube-integration/18358-11004/.minikube/machines/old-k8s-version-239315/old-k8s-version-239315.rawdisk'/>
I0311 21:23:43.126075 63745 main.go:141] libmachine: (old-k8s-version-239315) <target dev='hda' bus='virtio'/>
I0311 21:23:43.126083 63745 main.go:141] libmachine: (old-k8s-version-239315) </disk>
I0311 21:23:43.126091 63745 main.go:141] libmachine: (old-k8s-version-239315) <interface type='network'>
I0311 21:23:43.126101 63745 main.go:141] libmachine: (old-k8s-version-239315) <source network='mk-old-k8s-version-239315'/>
I0311 21:23:43.126108 63745 main.go:141] libmachine: (old-k8s-version-239315) <model type='virtio'/>
I0311 21:23:43.126117 63745 main.go:141] libmachine: (old-k8s-version-239315) </interface>
I0311 21:23:43.126124 63745 main.go:141] libmachine: (old-k8s-version-239315) <interface type='network'>
I0311 21:23:43.126134 63745 main.go:141] libmachine: (old-k8s-version-239315) <source network='default'/>
I0311 21:23:43.126141 63745 main.go:141] libmachine: (old-k8s-version-239315) <model type='virtio'/>
I0311 21:23:43.126152 63745 main.go:141] libmachine: (old-k8s-version-239315) </interface>
I0311 21:23:43.126159 63745 main.go:141] libmachine: (old-k8s-version-239315) <serial type='pty'>
I0311 21:23:43.126167 63745 main.go:141] libmachine: (old-k8s-version-239315) <target port='0'/>
I0311 21:23:43.126174 63745 main.go:141] libmachine: (old-k8s-version-239315) </serial>
I0311 21:23:43.126188 63745 main.go:141] libmachine: (old-k8s-version-239315) <console type='pty'>
I0311 21:23:43.126195 63745 main.go:141] libmachine: (old-k8s-version-239315) <target type='serial' port='0'/>
I0311 21:23:43.126203 63745 main.go:141] libmachine: (old-k8s-version-239315) </console>
I0311 21:23:43.126210 63745 main.go:141] libmachine: (old-k8s-version-239315) <rng model='virtio'>
I0311 21:23:43.126219 63745 main.go:141] libmachine: (old-k8s-version-239315) <backend model='random'>/dev/random</backend>
I0311 21:23:43.126225 63745 main.go:141] libmachine: (old-k8s-version-239315) </rng>
I0311 21:23:43.126233 63745 main.go:141] libmachine: (old-k8s-version-239315)
I0311 21:23:43.126239 63745 main.go:141] libmachine: (old-k8s-version-239315)
I0311 21:23:43.126247 63745 main.go:141] libmachine: (old-k8s-version-239315) </devices>
I0311 21:23:43.126253 63745 main.go:141] libmachine: (old-k8s-version-239315) </domain>
I0311 21:23:43.126264 63745 main.go:141] libmachine: (old-k8s-version-239315)
I0311 21:23:43.130135 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has defined MAC address 52:54:00:dd:99:0e in network default
I0311 21:23:43.130891 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has defined MAC address 52:54:00:5b:9d:32 in network mk-old-k8s-version-239315
I0311 21:23:43.130913 63745 main.go:141] libmachine: (old-k8s-version-239315) Ensuring networks are active...
I0311 21:23:43.131811 63745 main.go:141] libmachine: (old-k8s-version-239315) Ensuring network default is active
I0311 21:23:43.132235 63745 main.go:141] libmachine: (old-k8s-version-239315) Ensuring network mk-old-k8s-version-239315 is active
I0311 21:23:43.132829 63745 main.go:141] libmachine: (old-k8s-version-239315) Getting domain xml...
I0311 21:23:43.133603 63745 main.go:141] libmachine: (old-k8s-version-239315) Creating domain...
I0311 21:23:44.602645 63745 main.go:141] libmachine: (old-k8s-version-239315) Waiting to get IP...
I0311 21:23:44.603387 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has defined MAC address 52:54:00:5b:9d:32 in network mk-old-k8s-version-239315
I0311 21:23:44.603862 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | unable to find current IP address of domain old-k8s-version-239315 in network mk-old-k8s-version-239315
I0311 21:23:44.603922 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | I0311 21:23:44.603860 63911 retry.go:31] will retry after 239.686243ms: waiting for machine to come up
I0311 21:23:44.845795 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has defined MAC address 52:54:00:5b:9d:32 in network mk-old-k8s-version-239315
I0311 21:23:44.846369 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | unable to find current IP address of domain old-k8s-version-239315 in network mk-old-k8s-version-239315
I0311 21:23:44.846393 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | I0311 21:23:44.846322 63911 retry.go:31] will retry after 336.3542ms: waiting for machine to come up
I0311 21:23:45.183841 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has defined MAC address 52:54:00:5b:9d:32 in network mk-old-k8s-version-239315
I0311 21:23:45.184350 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | unable to find current IP address of domain old-k8s-version-239315 in network mk-old-k8s-version-239315
I0311 21:23:45.184381 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | I0311 21:23:45.184328 63911 retry.go:31] will retry after 404.660802ms: waiting for machine to come up
I0311 21:23:45.591035 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has defined MAC address 52:54:00:5b:9d:32 in network mk-old-k8s-version-239315
I0311 21:23:45.591651 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | unable to find current IP address of domain old-k8s-version-239315 in network mk-old-k8s-version-239315
I0311 21:23:45.591690 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | I0311 21:23:45.591602 63911 retry.go:31] will retry after 413.834521ms: waiting for machine to come up
I0311 21:23:46.007020 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has defined MAC address 52:54:00:5b:9d:32 in network mk-old-k8s-version-239315
I0311 21:23:46.007569 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | unable to find current IP address of domain old-k8s-version-239315 in network mk-old-k8s-version-239315
I0311 21:23:46.007598 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | I0311 21:23:46.007541 63911 retry.go:31] will retry after 668.863679ms: waiting for machine to come up
I0311 21:23:46.677990 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has defined MAC address 52:54:00:5b:9d:32 in network mk-old-k8s-version-239315
I0311 21:23:46.678449 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | unable to find current IP address of domain old-k8s-version-239315 in network mk-old-k8s-version-239315
I0311 21:23:46.678483 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | I0311 21:23:46.678395 63911 retry.go:31] will retry after 840.803863ms: waiting for machine to come up
I0311 21:23:47.521223 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has defined MAC address 52:54:00:5b:9d:32 in network mk-old-k8s-version-239315
I0311 21:23:47.521666 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | unable to find current IP address of domain old-k8s-version-239315 in network mk-old-k8s-version-239315
I0311 21:23:47.521692 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | I0311 21:23:47.521588 63911 retry.go:31] will retry after 1.020629438s: waiting for machine to come up
I0311 21:23:48.544232 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has defined MAC address 52:54:00:5b:9d:32 in network mk-old-k8s-version-239315
I0311 21:23:48.544833 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | unable to find current IP address of domain old-k8s-version-239315 in network mk-old-k8s-version-239315
I0311 21:23:48.544865 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | I0311 21:23:48.544787 63911 retry.go:31] will retry after 1.332842478s: waiting for machine to come up
I0311 21:23:49.879397 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has defined MAC address 52:54:00:5b:9d:32 in network mk-old-k8s-version-239315
I0311 21:23:49.880479 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | unable to find current IP address of domain old-k8s-version-239315 in network mk-old-k8s-version-239315
I0311 21:23:49.880500 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | I0311 21:23:49.880183 63911 retry.go:31] will retry after 1.690370074s: waiting for machine to come up
I0311 21:23:51.572540 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has defined MAC address 52:54:00:5b:9d:32 in network mk-old-k8s-version-239315
I0311 21:23:51.573209 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | unable to find current IP address of domain old-k8s-version-239315 in network mk-old-k8s-version-239315
I0311 21:23:51.573237 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | I0311 21:23:51.573153 63911 retry.go:31] will retry after 2.041129416s: waiting for machine to come up
I0311 21:23:53.615765 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has defined MAC address 52:54:00:5b:9d:32 in network mk-old-k8s-version-239315
I0311 21:23:53.616345 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | unable to find current IP address of domain old-k8s-version-239315 in network mk-old-k8s-version-239315
I0311 21:23:53.616372 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | I0311 21:23:53.616275 63911 retry.go:31] will retry after 2.719242718s: waiting for machine to come up
I0311 21:23:56.338416 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has defined MAC address 52:54:00:5b:9d:32 in network mk-old-k8s-version-239315
I0311 21:23:56.338953 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | unable to find current IP address of domain old-k8s-version-239315 in network mk-old-k8s-version-239315
I0311 21:23:56.338984 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | I0311 21:23:56.338880 63911 retry.go:31] will retry after 3.210319334s: waiting for machine to come up
I0311 21:23:59.551394 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has defined MAC address 52:54:00:5b:9d:32 in network mk-old-k8s-version-239315
I0311 21:23:59.551932 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | unable to find current IP address of domain old-k8s-version-239315 in network mk-old-k8s-version-239315
I0311 21:23:59.551962 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | I0311 21:23:59.551897 63911 retry.go:31] will retry after 2.872302706s: waiting for machine to come up
I0311 21:24:02.425932 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has defined MAC address 52:54:00:5b:9d:32 in network mk-old-k8s-version-239315
I0311 21:24:02.426419 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | unable to find current IP address of domain old-k8s-version-239315 in network mk-old-k8s-version-239315
I0311 21:24:02.426444 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | I0311 21:24:02.426376 63911 retry.go:31] will retry after 4.705116933s: waiting for machine to come up
I0311 21:24:07.133789 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has defined MAC address 52:54:00:5b:9d:32 in network mk-old-k8s-version-239315
I0311 21:24:07.134242 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has current primary IP address 192.168.72.52 and MAC address 52:54:00:5b:9d:32 in network mk-old-k8s-version-239315
I0311 21:24:07.134270 63745 main.go:141] libmachine: (old-k8s-version-239315) Found IP for machine: 192.168.72.52
I0311 21:24:07.134286 63745 main.go:141] libmachine: (old-k8s-version-239315) Reserving static IP address...
I0311 21:24:07.134580 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-239315", mac: "52:54:00:5b:9d:32", ip: "192.168.72.52"} in network mk-old-k8s-version-239315
I0311 21:24:07.210561 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | Getting to WaitForSSH function...
I0311 21:24:07.210593 63745 main.go:141] libmachine: (old-k8s-version-239315) Reserved static IP address: 192.168.72.52
I0311 21:24:07.210609 63745 main.go:141] libmachine: (old-k8s-version-239315) Waiting for SSH to be available...
I0311 21:24:07.213435 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has defined MAC address 52:54:00:5b:9d:32 in network mk-old-k8s-version-239315
I0311 21:24:07.213861 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5b:9d:32", ip: ""} in network mk-old-k8s-version-239315: {Iface:virbr3 ExpiryTime:2024-03-11 22:24:00 +0000 UTC Type:0 Mac:52:54:00:5b:9d:32 Iaid: IPaddr:192.168.72.52 Prefix:24 Hostname:minikube Clientid:01:52:54:00:5b:9d:32}
I0311 21:24:07.213892 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has defined IP address 192.168.72.52 and MAC address 52:54:00:5b:9d:32 in network mk-old-k8s-version-239315
I0311 21:24:07.213997 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | Using SSH client type: external
I0311 21:24:07.214024 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | Using SSH private key: /home/jenkins/minikube-integration/18358-11004/.minikube/machines/old-k8s-version-239315/id_rsa (-rw-------)
I0311 21:24:07.214053 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.72.52 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/18358-11004/.minikube/machines/old-k8s-version-239315/id_rsa -p 22] /usr/bin/ssh <nil>}
I0311 21:24:07.214077 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | About to run SSH command:
I0311 21:24:07.214089 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | exit 0
I0311 21:24:07.341132 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | SSH cmd err, output: <nil>:
I0311 21:24:07.341423 63745 main.go:141] libmachine: (old-k8s-version-239315) KVM machine creation complete!
I0311 21:24:07.341865 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetConfigRaw
I0311 21:24:07.342384 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .DriverName
I0311 21:24:07.342585 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .DriverName
I0311 21:24:07.342779 63745 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0311 21:24:07.342799 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetState
I0311 21:24:07.344383 63745 main.go:141] libmachine: Detecting operating system of created instance...
I0311 21:24:07.344400 63745 main.go:141] libmachine: Waiting for SSH to be available...
I0311 21:24:07.344409 63745 main.go:141] libmachine: Getting to WaitForSSH function...
I0311 21:24:07.344419 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetSSHHostname
I0311 21:24:07.347347 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has defined MAC address 52:54:00:5b:9d:32 in network mk-old-k8s-version-239315
I0311 21:24:07.347756 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5b:9d:32", ip: ""} in network mk-old-k8s-version-239315: {Iface:virbr3 ExpiryTime:2024-03-11 22:24:00 +0000 UTC Type:0 Mac:52:54:00:5b:9d:32 Iaid: IPaddr:192.168.72.52 Prefix:24 Hostname:old-k8s-version-239315 Clientid:01:52:54:00:5b:9d:32}
I0311 21:24:07.347787 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has defined IP address 192.168.72.52 and MAC address 52:54:00:5b:9d:32 in network mk-old-k8s-version-239315
I0311 21:24:07.347927 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetSSHPort
I0311 21:24:07.348133 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetSSHKeyPath
I0311 21:24:07.348317 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetSSHKeyPath
I0311 21:24:07.348455 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetSSHUsername
I0311 21:24:07.348653 63745 main.go:141] libmachine: Using SSH client type: native
I0311 21:24:07.348893 63745 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d2e0] 0x830040 <nil> [] 0s} 192.168.72.52 22 <nil> <nil>}
I0311 21:24:07.348908 63745 main.go:141] libmachine: About to run SSH command:
exit 0
I0311 21:24:07.452039 63745 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0311 21:24:07.452064 63745 main.go:141] libmachine: Detecting the provisioner...
I0311 21:24:07.452090 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetSSHHostname
I0311 21:24:07.455167 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has defined MAC address 52:54:00:5b:9d:32 in network mk-old-k8s-version-239315
I0311 21:24:07.455536 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5b:9d:32", ip: ""} in network mk-old-k8s-version-239315: {Iface:virbr3 ExpiryTime:2024-03-11 22:24:00 +0000 UTC Type:0 Mac:52:54:00:5b:9d:32 Iaid: IPaddr:192.168.72.52 Prefix:24 Hostname:old-k8s-version-239315 Clientid:01:52:54:00:5b:9d:32}
I0311 21:24:07.455568 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has defined IP address 192.168.72.52 and MAC address 52:54:00:5b:9d:32 in network mk-old-k8s-version-239315
I0311 21:24:07.455757 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetSSHPort
I0311 21:24:07.455964 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetSSHKeyPath
I0311 21:24:07.456172 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetSSHKeyPath
I0311 21:24:07.456332 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetSSHUsername
I0311 21:24:07.456529 63745 main.go:141] libmachine: Using SSH client type: native
I0311 21:24:07.456698 63745 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d2e0] 0x830040 <nil> [] 0s} 192.168.72.52 22 <nil> <nil>}
I0311 21:24:07.456708 63745 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0311 21:24:07.562826 63745 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0311 21:24:07.562906 63745 main.go:141] libmachine: found compatible host: buildroot
I0311 21:24:07.562919 63745 main.go:141] libmachine: Provisioning with buildroot...
I0311 21:24:07.562930 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetMachineName
I0311 21:24:07.563186 63745 buildroot.go:166] provisioning hostname "old-k8s-version-239315"
I0311 21:24:07.563217 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetMachineName
I0311 21:24:07.563409 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetSSHHostname
I0311 21:24:07.566128 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has defined MAC address 52:54:00:5b:9d:32 in network mk-old-k8s-version-239315
I0311 21:24:07.566469 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5b:9d:32", ip: ""} in network mk-old-k8s-version-239315: {Iface:virbr3 ExpiryTime:2024-03-11 22:24:00 +0000 UTC Type:0 Mac:52:54:00:5b:9d:32 Iaid: IPaddr:192.168.72.52 Prefix:24 Hostname:old-k8s-version-239315 Clientid:01:52:54:00:5b:9d:32}
I0311 21:24:07.566500 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has defined IP address 192.168.72.52 and MAC address 52:54:00:5b:9d:32 in network mk-old-k8s-version-239315
I0311 21:24:07.566580 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetSSHPort
I0311 21:24:07.566798 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetSSHKeyPath
I0311 21:24:07.566990 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetSSHKeyPath
I0311 21:24:07.567150 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetSSHUsername
I0311 21:24:07.567339 63745 main.go:141] libmachine: Using SSH client type: native
I0311 21:24:07.567542 63745 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d2e0] 0x830040 <nil> [] 0s} 192.168.72.52 22 <nil> <nil>}
I0311 21:24:07.567556 63745 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-239315 && echo "old-k8s-version-239315" | sudo tee /etc/hostname
I0311 21:24:07.693929 63745 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-239315
I0311 21:24:07.693965 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetSSHHostname
I0311 21:24:07.696797 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has defined MAC address 52:54:00:5b:9d:32 in network mk-old-k8s-version-239315
I0311 21:24:07.697105 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5b:9d:32", ip: ""} in network mk-old-k8s-version-239315: {Iface:virbr3 ExpiryTime:2024-03-11 22:24:00 +0000 UTC Type:0 Mac:52:54:00:5b:9d:32 Iaid: IPaddr:192.168.72.52 Prefix:24 Hostname:old-k8s-version-239315 Clientid:01:52:54:00:5b:9d:32}
I0311 21:24:07.697130 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has defined IP address 192.168.72.52 and MAC address 52:54:00:5b:9d:32 in network mk-old-k8s-version-239315
I0311 21:24:07.697279 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetSSHPort
I0311 21:24:07.697479 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetSSHKeyPath
I0311 21:24:07.697631 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetSSHKeyPath
I0311 21:24:07.697776 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetSSHUsername
I0311 21:24:07.697961 63745 main.go:141] libmachine: Using SSH client type: native
I0311 21:24:07.698196 63745 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d2e0] 0x830040 <nil> [] 0s} 192.168.72.52 22 <nil> <nil>}
I0311 21:24:07.698218 63745 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-239315' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-239315/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-239315' | sudo tee -a /etc/hosts;
fi
fi
I0311 21:24:07.820675 63745 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0311 21:24:07.820705 63745 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/18358-11004/.minikube CaCertPath:/home/jenkins/minikube-integration/18358-11004/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18358-11004/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18358-11004/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18358-11004/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18358-11004/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18358-11004/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18358-11004/.minikube}
I0311 21:24:07.820727 63745 buildroot.go:174] setting up certificates
I0311 21:24:07.820752 63745 provision.go:84] configureAuth start
I0311 21:24:07.820766 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetMachineName
I0311 21:24:07.821053 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetIP
I0311 21:24:07.823544 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has defined MAC address 52:54:00:5b:9d:32 in network mk-old-k8s-version-239315
I0311 21:24:07.823885 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5b:9d:32", ip: ""} in network mk-old-k8s-version-239315: {Iface:virbr3 ExpiryTime:2024-03-11 22:24:00 +0000 UTC Type:0 Mac:52:54:00:5b:9d:32 Iaid: IPaddr:192.168.72.52 Prefix:24 Hostname:old-k8s-version-239315 Clientid:01:52:54:00:5b:9d:32}
I0311 21:24:07.823913 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has defined IP address 192.168.72.52 and MAC address 52:54:00:5b:9d:32 in network mk-old-k8s-version-239315
I0311 21:24:07.824063 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetSSHHostname
I0311 21:24:07.825969 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has defined MAC address 52:54:00:5b:9d:32 in network mk-old-k8s-version-239315
I0311 21:24:07.826284 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5b:9d:32", ip: ""} in network mk-old-k8s-version-239315: {Iface:virbr3 ExpiryTime:2024-03-11 22:24:00 +0000 UTC Type:0 Mac:52:54:00:5b:9d:32 Iaid: IPaddr:192.168.72.52 Prefix:24 Hostname:old-k8s-version-239315 Clientid:01:52:54:00:5b:9d:32}
I0311 21:24:07.826314 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has defined IP address 192.168.72.52 and MAC address 52:54:00:5b:9d:32 in network mk-old-k8s-version-239315
I0311 21:24:07.826468 63745 provision.go:143] copyHostCerts
I0311 21:24:07.826541 63745 exec_runner.go:144] found /home/jenkins/minikube-integration/18358-11004/.minikube/ca.pem, removing ...
I0311 21:24:07.826553 63745 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18358-11004/.minikube/ca.pem
I0311 21:24:07.826603 63745 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18358-11004/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18358-11004/.minikube/ca.pem (1082 bytes)
I0311 21:24:07.826682 63745 exec_runner.go:144] found /home/jenkins/minikube-integration/18358-11004/.minikube/cert.pem, removing ...
I0311 21:24:07.826690 63745 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18358-11004/.minikube/cert.pem
I0311 21:24:07.826708 63745 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18358-11004/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18358-11004/.minikube/cert.pem (1123 bytes)
I0311 21:24:07.826755 63745 exec_runner.go:144] found /home/jenkins/minikube-integration/18358-11004/.minikube/key.pem, removing ...
I0311 21:24:07.826762 63745 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18358-11004/.minikube/key.pem
I0311 21:24:07.826778 63745 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18358-11004/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18358-11004/.minikube/key.pem (1675 bytes)
I0311 21:24:07.826817 63745 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18358-11004/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18358-11004/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18358-11004/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-239315 san=[127.0.0.1 192.168.72.52 localhost minikube old-k8s-version-239315]
I0311 21:24:07.941187 63745 provision.go:177] copyRemoteCerts
I0311 21:24:07.941266 63745 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0311 21:24:07.941296 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetSSHHostname
I0311 21:24:07.943778 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has defined MAC address 52:54:00:5b:9d:32 in network mk-old-k8s-version-239315
I0311 21:24:07.944125 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5b:9d:32", ip: ""} in network mk-old-k8s-version-239315: {Iface:virbr3 ExpiryTime:2024-03-11 22:24:00 +0000 UTC Type:0 Mac:52:54:00:5b:9d:32 Iaid: IPaddr:192.168.72.52 Prefix:24 Hostname:old-k8s-version-239315 Clientid:01:52:54:00:5b:9d:32}
I0311 21:24:07.944152 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has defined IP address 192.168.72.52 and MAC address 52:54:00:5b:9d:32 in network mk-old-k8s-version-239315
I0311 21:24:07.944302 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetSSHPort
I0311 21:24:07.944542 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetSSHKeyPath
I0311 21:24:07.944704 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetSSHUsername
I0311 21:24:07.944884 63745 sshutil.go:53] new ssh client: &{IP:192.168.72.52 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18358-11004/.minikube/machines/old-k8s-version-239315/id_rsa Username:docker}
I0311 21:24:08.030770 63745 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18358-11004/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0311 21:24:08.059736 63745 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18358-11004/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0311 21:24:08.086277 63745 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18358-11004/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0311 21:24:08.114517 63745 provision.go:87] duration metric: took 293.751532ms to configureAuth
I0311 21:24:08.114547 63745 buildroot.go:189] setting minikube options for container-runtime
I0311 21:24:08.114772 63745 config.go:182] Loaded profile config "old-k8s-version-239315": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0311 21:24:08.114875 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetSSHHostname
I0311 21:24:08.118073 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has defined MAC address 52:54:00:5b:9d:32 in network mk-old-k8s-version-239315
I0311 21:24:08.118546 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5b:9d:32", ip: ""} in network mk-old-k8s-version-239315: {Iface:virbr3 ExpiryTime:2024-03-11 22:24:00 +0000 UTC Type:0 Mac:52:54:00:5b:9d:32 Iaid: IPaddr:192.168.72.52 Prefix:24 Hostname:old-k8s-version-239315 Clientid:01:52:54:00:5b:9d:32}
I0311 21:24:08.118574 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has defined IP address 192.168.72.52 and MAC address 52:54:00:5b:9d:32 in network mk-old-k8s-version-239315
I0311 21:24:08.118779 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetSSHPort
I0311 21:24:08.118976 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetSSHKeyPath
I0311 21:24:08.119155 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetSSHKeyPath
I0311 21:24:08.119372 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetSSHUsername
I0311 21:24:08.119561 63745 main.go:141] libmachine: Using SSH client type: native
I0311 21:24:08.119768 63745 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d2e0] 0x830040 <nil> [] 0s} 192.168.72.52 22 <nil> <nil>}
I0311 21:24:08.119791 63745 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0311 21:24:08.397191 63745 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0311 21:24:08.397218 63745 main.go:141] libmachine: Checking connection to Docker...
I0311 21:24:08.397226 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetURL
I0311 21:24:08.398626 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | Using libvirt version 6000000
I0311 21:24:08.400653 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has defined MAC address 52:54:00:5b:9d:32 in network mk-old-k8s-version-239315
I0311 21:24:08.401116 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5b:9d:32", ip: ""} in network mk-old-k8s-version-239315: {Iface:virbr3 ExpiryTime:2024-03-11 22:24:00 +0000 UTC Type:0 Mac:52:54:00:5b:9d:32 Iaid: IPaddr:192.168.72.52 Prefix:24 Hostname:old-k8s-version-239315 Clientid:01:52:54:00:5b:9d:32}
I0311 21:24:08.401144 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has defined IP address 192.168.72.52 and MAC address 52:54:00:5b:9d:32 in network mk-old-k8s-version-239315
I0311 21:24:08.401320 63745 main.go:141] libmachine: Docker is up and running!
I0311 21:24:08.401337 63745 main.go:141] libmachine: Reticulating splines...
I0311 21:24:08.401344 63745 client.go:171] duration metric: took 25.74698382s to LocalClient.Create
I0311 21:24:08.401364 63745 start.go:167] duration metric: took 25.74704228s to libmachine.API.Create "old-k8s-version-239315"
I0311 21:24:08.401373 63745 start.go:293] postStartSetup for "old-k8s-version-239315" (driver="kvm2")
I0311 21:24:08.401383 63745 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0311 21:24:08.401399 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .DriverName
I0311 21:24:08.401618 63745 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0311 21:24:08.401642 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetSSHHostname
I0311 21:24:08.403901 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has defined MAC address 52:54:00:5b:9d:32 in network mk-old-k8s-version-239315
I0311 21:24:08.404200 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5b:9d:32", ip: ""} in network mk-old-k8s-version-239315: {Iface:virbr3 ExpiryTime:2024-03-11 22:24:00 +0000 UTC Type:0 Mac:52:54:00:5b:9d:32 Iaid: IPaddr:192.168.72.52 Prefix:24 Hostname:old-k8s-version-239315 Clientid:01:52:54:00:5b:9d:32}
I0311 21:24:08.404218 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has defined IP address 192.168.72.52 and MAC address 52:54:00:5b:9d:32 in network mk-old-k8s-version-239315
I0311 21:24:08.404418 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetSSHPort
I0311 21:24:08.404596 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetSSHKeyPath
I0311 21:24:08.404776 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetSSHUsername
I0311 21:24:08.404931 63745 sshutil.go:53] new ssh client: &{IP:192.168.72.52 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18358-11004/.minikube/machines/old-k8s-version-239315/id_rsa Username:docker}
I0311 21:24:08.489050 63745 ssh_runner.go:195] Run: cat /etc/os-release
I0311 21:24:08.493940 63745 info.go:137] Remote host: Buildroot 2023.02.9
I0311 21:24:08.493962 63745 filesync.go:126] Scanning /home/jenkins/minikube-integration/18358-11004/.minikube/addons for local assets ...
I0311 21:24:08.494020 63745 filesync.go:126] Scanning /home/jenkins/minikube-integration/18358-11004/.minikube/files for local assets ...
I0311 21:24:08.494111 63745 filesync.go:149] local asset: /home/jenkins/minikube-integration/18358-11004/.minikube/files/etc/ssl/certs/182352.pem -> 182352.pem in /etc/ssl/certs
I0311 21:24:08.494223 63745 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0311 21:24:08.505778 63745 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18358-11004/.minikube/files/etc/ssl/certs/182352.pem --> /etc/ssl/certs/182352.pem (1708 bytes)
I0311 21:24:08.535897 63745 start.go:296] duration metric: took 134.512608ms for postStartSetup
I0311 21:24:08.535950 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetConfigRaw
I0311 21:24:08.536563 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetIP
I0311 21:24:08.539485 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has defined MAC address 52:54:00:5b:9d:32 in network mk-old-k8s-version-239315
I0311 21:24:08.539873 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5b:9d:32", ip: ""} in network mk-old-k8s-version-239315: {Iface:virbr3 ExpiryTime:2024-03-11 22:24:00 +0000 UTC Type:0 Mac:52:54:00:5b:9d:32 Iaid: IPaddr:192.168.72.52 Prefix:24 Hostname:old-k8s-version-239315 Clientid:01:52:54:00:5b:9d:32}
I0311 21:24:08.539905 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has defined IP address 192.168.72.52 and MAC address 52:54:00:5b:9d:32 in network mk-old-k8s-version-239315
I0311 21:24:08.540229 63745 profile.go:142] Saving config to /home/jenkins/minikube-integration/18358-11004/.minikube/profiles/old-k8s-version-239315/config.json ...
I0311 21:24:08.540457 63745 start.go:128] duration metric: took 25.90944665s to createHost
I0311 21:24:08.540480 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetSSHHostname
I0311 21:24:08.542898 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has defined MAC address 52:54:00:5b:9d:32 in network mk-old-k8s-version-239315
I0311 21:24:08.543318 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5b:9d:32", ip: ""} in network mk-old-k8s-version-239315: {Iface:virbr3 ExpiryTime:2024-03-11 22:24:00 +0000 UTC Type:0 Mac:52:54:00:5b:9d:32 Iaid: IPaddr:192.168.72.52 Prefix:24 Hostname:old-k8s-version-239315 Clientid:01:52:54:00:5b:9d:32}
I0311 21:24:08.543354 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has defined IP address 192.168.72.52 and MAC address 52:54:00:5b:9d:32 in network mk-old-k8s-version-239315
I0311 21:24:08.543489 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetSSHPort
I0311 21:24:08.543697 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetSSHKeyPath
I0311 21:24:08.543884 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetSSHKeyPath
I0311 21:24:08.544046 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetSSHUsername
I0311 21:24:08.544238 63745 main.go:141] libmachine: Using SSH client type: native
I0311 21:24:08.544444 63745 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d2e0] 0x830040 <nil> [] 0s} 192.168.72.52 22 <nil> <nil>}
I0311 21:24:08.544459 63745 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0311 21:24:08.655527 63745 main.go:141] libmachine: SSH cmd err, output: <nil>: 1710192248.601213584
I0311 21:24:08.655556 63745 fix.go:216] guest clock: 1710192248.601213584
I0311 21:24:08.655567 63745 fix.go:229] Guest: 2024-03-11 21:24:08.601213584 +0000 UTC Remote: 2024-03-11 21:24:08.540470013 +0000 UTC m=+43.180035009 (delta=60.743571ms)
I0311 21:24:08.655591 63745 fix.go:200] guest clock delta is within tolerance: 60.743571ms
I0311 21:24:08.655599 63745 start.go:83] releasing machines lock for "old-k8s-version-239315", held for 26.024743191s
I0311 21:24:08.655624 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .DriverName
I0311 21:24:08.655943 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetIP
I0311 21:24:08.659030 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has defined MAC address 52:54:00:5b:9d:32 in network mk-old-k8s-version-239315
I0311 21:24:08.659475 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5b:9d:32", ip: ""} in network mk-old-k8s-version-239315: {Iface:virbr3 ExpiryTime:2024-03-11 22:24:00 +0000 UTC Type:0 Mac:52:54:00:5b:9d:32 Iaid: IPaddr:192.168.72.52 Prefix:24 Hostname:old-k8s-version-239315 Clientid:01:52:54:00:5b:9d:32}
I0311 21:24:08.659507 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has defined IP address 192.168.72.52 and MAC address 52:54:00:5b:9d:32 in network mk-old-k8s-version-239315
I0311 21:24:08.659768 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .DriverName
I0311 21:24:08.660314 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .DriverName
I0311 21:24:08.660494 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .DriverName
I0311 21:24:08.660589 63745 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0311 21:24:08.660634 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetSSHHostname
I0311 21:24:08.660724 63745 ssh_runner.go:195] Run: cat /version.json
I0311 21:24:08.660771 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetSSHHostname
I0311 21:24:08.663431 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has defined MAC address 52:54:00:5b:9d:32 in network mk-old-k8s-version-239315
I0311 21:24:08.663618 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has defined MAC address 52:54:00:5b:9d:32 in network mk-old-k8s-version-239315
I0311 21:24:08.663833 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5b:9d:32", ip: ""} in network mk-old-k8s-version-239315: {Iface:virbr3 ExpiryTime:2024-03-11 22:24:00 +0000 UTC Type:0 Mac:52:54:00:5b:9d:32 Iaid: IPaddr:192.168.72.52 Prefix:24 Hostname:old-k8s-version-239315 Clientid:01:52:54:00:5b:9d:32}
I0311 21:24:08.663868 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has defined IP address 192.168.72.52 and MAC address 52:54:00:5b:9d:32 in network mk-old-k8s-version-239315
I0311 21:24:08.663983 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetSSHPort
I0311 21:24:08.664135 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetSSHKeyPath
I0311 21:24:08.664142 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5b:9d:32", ip: ""} in network mk-old-k8s-version-239315: {Iface:virbr3 ExpiryTime:2024-03-11 22:24:00 +0000 UTC Type:0 Mac:52:54:00:5b:9d:32 Iaid: IPaddr:192.168.72.52 Prefix:24 Hostname:old-k8s-version-239315 Clientid:01:52:54:00:5b:9d:32}
I0311 21:24:08.664165 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has defined IP address 192.168.72.52 and MAC address 52:54:00:5b:9d:32 in network mk-old-k8s-version-239315
I0311 21:24:08.664242 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetSSHUsername
I0311 21:24:08.664290 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetSSHPort
I0311 21:24:08.664453 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetSSHKeyPath
I0311 21:24:08.664462 63745 sshutil.go:53] new ssh client: &{IP:192.168.72.52 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18358-11004/.minikube/machines/old-k8s-version-239315/id_rsa Username:docker}
I0311 21:24:08.664609 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetSSHUsername
I0311 21:24:08.664756 63745 sshutil.go:53] new ssh client: &{IP:192.168.72.52 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18358-11004/.minikube/machines/old-k8s-version-239315/id_rsa Username:docker}
I0311 21:24:08.750352 63745 ssh_runner.go:195] Run: systemctl --version
I0311 21:24:08.773015 63745 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0311 21:24:08.951167 63745 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0311 21:24:08.959875 63745 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0311 21:24:08.959958 63745 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0311 21:24:08.982012 63745 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0311 21:24:08.982032 63745 start.go:494] detecting cgroup driver to use...
I0311 21:24:08.982108 63745 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0311 21:24:09.003023 63745 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0311 21:24:09.020084 63745 docker.go:217] disabling cri-docker service (if available) ...
I0311 21:24:09.020134 63745 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0311 21:24:09.038738 63745 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0311 21:24:09.060011 63745 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0311 21:24:09.214488 63745 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0311 21:24:09.386037 63745 docker.go:233] disabling docker service ...
I0311 21:24:09.386118 63745 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0311 21:24:09.404707 63745 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0311 21:24:09.426398 63745 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0311 21:24:09.634959 63745 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0311 21:24:09.797080 63745 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0311 21:24:09.813529 63745 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0311 21:24:09.837762 63745 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0311 21:24:09.837824 63745 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0311 21:24:09.850857 63745 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0311 21:24:09.850918 63745 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0311 21:24:09.863945 63745 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0311 21:24:09.877962 63745 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0311 21:24:09.889768 63745 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0311 21:24:09.903483 63745 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0311 21:24:09.917443 63745 crio.go:148] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0311 21:24:09.917498 63745 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0311 21:24:09.935583 63745 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0311 21:24:09.949991 63745 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0311 21:24:10.123625 63745 ssh_runner.go:195] Run: sudo systemctl restart crio
I0311 21:24:10.295549 63745 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0311 21:24:10.295636 63745 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0311 21:24:10.302449 63745 start.go:562] Will wait 60s for crictl version
I0311 21:24:10.302500 63745 ssh_runner.go:195] Run: which crictl
I0311 21:24:10.307104 63745 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0311 21:24:10.356071 63745 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0311 21:24:10.356123 63745 ssh_runner.go:195] Run: crio --version
I0311 21:24:10.398097 63745 ssh_runner.go:195] Run: crio --version
I0311 21:24:10.434553 63745 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0311 21:24:10.436631 63745 main.go:141] libmachine: (old-k8s-version-239315) Calling .GetIP
I0311 21:24:10.439439 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has defined MAC address 52:54:00:5b:9d:32 in network mk-old-k8s-version-239315
I0311 21:24:10.439808 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5b:9d:32", ip: ""} in network mk-old-k8s-version-239315: {Iface:virbr3 ExpiryTime:2024-03-11 22:24:00 +0000 UTC Type:0 Mac:52:54:00:5b:9d:32 Iaid: IPaddr:192.168.72.52 Prefix:24 Hostname:old-k8s-version-239315 Clientid:01:52:54:00:5b:9d:32}
I0311 21:24:10.439842 63745 main.go:141] libmachine: (old-k8s-version-239315) DBG | domain old-k8s-version-239315 has defined IP address 192.168.72.52 and MAC address 52:54:00:5b:9d:32 in network mk-old-k8s-version-239315
I0311 21:24:10.440024 63745 ssh_runner.go:195] Run: grep 192.168.72.1 host.minikube.internal$ /etc/hosts
I0311 21:24:10.445892 63745 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.72.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0311 21:24:10.462772 63745 kubeadm.go:877] updating cluster {Name:old-k8s-version-239315 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-239315 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.52 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mo
untPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0311 21:24:10.462919 63745 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0311 21:24:10.463021 63745 ssh_runner.go:195] Run: sudo crictl images --output json
I0311 21:24:10.503009 63745 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0311 21:24:10.503085 63745 ssh_runner.go:195] Run: which lz4
I0311 21:24:10.507771 63745 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0311 21:24:10.512601 63745 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0311 21:24:10.512624 63745 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18358-11004/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0311 21:24:12.608035 63745 crio.go:444] duration metric: took 2.1002854s to copy over tarball
I0311 21:24:12.608110 63745 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0311 21:24:16.012374 63745 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.404236515s)
I0311 21:24:16.012395 63745 crio.go:451] duration metric: took 3.404337578s to extract the tarball
I0311 21:24:16.012402 63745 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0311 21:24:16.065524 63745 ssh_runner.go:195] Run: sudo crictl images --output json
I0311 21:24:16.149779 63745 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0311 21:24:16.149809 63745 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0311 21:24:16.149874 63745 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0311 21:24:16.150152 63745 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0311 21:24:16.150334 63745 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0311 21:24:16.150519 63745 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0311 21:24:16.150680 63745 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0311 21:24:16.150812 63745 image.go:134] retrieving image: registry.k8s.io/pause:3.2
I0311 21:24:16.150918 63745 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0311 21:24:16.151020 63745 image.go:134] retrieving image: registry.k8s.io/coredns:1.7.0
I0311 21:24:16.153043 63745 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0311 21:24:16.153134 63745 image.go:177] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0311 21:24:16.153237 63745 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0311 21:24:16.153697 63745 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0311 21:24:16.154064 63745 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0311 21:24:16.154097 63745 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0311 21:24:16.154158 63745 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0311 21:24:16.154238 63745 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0311 21:24:16.307853 63745 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0311 21:24:16.309853 63745 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0311 21:24:16.311226 63745 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0311 21:24:16.329794 63745 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0311 21:24:16.334030 63745 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0311 21:24:16.343839 63745 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0311 21:24:16.363248 63745 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0311 21:24:16.434985 63745 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0311 21:24:16.479614 63745 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0311 21:24:16.479654 63745 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0311 21:24:16.479691 63745 ssh_runner.go:195] Run: which crictl
I0311 21:24:16.524672 63745 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0311 21:24:16.524719 63745 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0311 21:24:16.524785 63745 ssh_runner.go:195] Run: which crictl
I0311 21:24:16.524911 63745 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0311 21:24:16.524937 63745 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0311 21:24:16.524964 63745 ssh_runner.go:195] Run: which crictl
I0311 21:24:16.620935 63745 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0311 21:24:16.620975 63745 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0311 21:24:16.621022 63745 ssh_runner.go:195] Run: which crictl
I0311 21:24:16.621121 63745 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0311 21:24:16.621147 63745 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0311 21:24:16.621181 63745 ssh_runner.go:195] Run: which crictl
I0311 21:24:16.627571 63745 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0311 21:24:16.627606 63745 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0311 21:24:16.627644 63745 ssh_runner.go:195] Run: which crictl
I0311 21:24:16.627655 63745 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0311 21:24:16.627690 63745 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0311 21:24:16.627725 63745 ssh_runner.go:195] Run: which crictl
I0311 21:24:16.755113 63745 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0311 21:24:16.755186 63745 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0311 21:24:16.755221 63745 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0311 21:24:16.755271 63745 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0311 21:24:16.755306 63745 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0311 21:24:16.755348 63745 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0311 21:24:16.755378 63745 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0311 21:24:16.975164 63745 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18358-11004/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0311 21:24:16.975210 63745 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18358-11004/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0311 21:24:16.975254 63745 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18358-11004/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0311 21:24:16.975310 63745 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18358-11004/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0311 21:24:16.975371 63745 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18358-11004/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0311 21:24:16.975412 63745 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18358-11004/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0311 21:24:16.975465 63745 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18358-11004/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0311 21:24:16.975502 63745 cache_images.go:92] duration metric: took 825.677055ms to LoadCachedImages
W0311 21:24:16.975570 63745 out.go:239] X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/18358-11004/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2: no such file or directory
X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/18358-11004/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2: no such file or directory
I0311 21:24:16.975590 63745 kubeadm.go:928] updating node { 192.168.72.52 8443 v1.20.0 crio true true} ...
I0311 21:24:16.975703 63745 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-239315 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.72.52
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-239315 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0311 21:24:16.975779 63745 ssh_runner.go:195] Run: crio config
I0311 21:24:17.060584 63745 cni.go:84] Creating CNI manager for ""
I0311 21:24:17.060606 63745 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0311 21:24:17.060620 63745 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0311 21:24:17.060640 63745 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.72.52 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-239315 NodeName:old-k8s-version-239315 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.72.52"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.72.52 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Stati
cPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0311 21:24:17.060792 63745 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.72.52
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-239315"
kubeletExtraArgs:
node-ip: 192.168.72.52
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.72.52"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0311 21:24:17.060856 63745 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0311 21:24:17.076060 63745 binaries.go:44] Found k8s binaries, skipping transfer
I0311 21:24:17.076134 63745 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0311 21:24:17.094549 63745 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (429 bytes)
I0311 21:24:17.116452 63745 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0311 21:24:17.137310 63745 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2120 bytes)
I0311 21:24:17.159332 63745 ssh_runner.go:195] Run: grep 192.168.72.52 control-plane.minikube.internal$ /etc/hosts
I0311 21:24:17.169229 63745 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.72.52 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0311 21:24:17.188722 63745 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0311 21:24:17.348877 63745 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0311 21:24:17.375222 63745 certs.go:68] Setting up /home/jenkins/minikube-integration/18358-11004/.minikube/profiles/old-k8s-version-239315 for IP: 192.168.72.52
I0311 21:24:17.375250 63745 certs.go:194] generating shared ca certs ...
I0311 21:24:17.375274 63745 certs.go:226] acquiring lock for ca certs: {Name:mkc1162dd2fd565881b28a047e5f480cda50fd11 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0311 21:24:17.375427 63745 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18358-11004/.minikube/ca.key
I0311 21:24:17.375489 63745 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18358-11004/.minikube/proxy-client-ca.key
I0311 21:24:17.375510 63745 certs.go:256] generating profile certs ...
I0311 21:24:17.375610 63745 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/18358-11004/.minikube/profiles/old-k8s-version-239315/client.key
I0311 21:24:17.375635 63745 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18358-11004/.minikube/profiles/old-k8s-version-239315/client.crt with IP's: []
I0311 21:24:17.698403 63745 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18358-11004/.minikube/profiles/old-k8s-version-239315/client.crt ...
I0311 21:24:17.698433 63745 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18358-11004/.minikube/profiles/old-k8s-version-239315/client.crt: {Name:mkdbf6d4f3f1e07bf72b429104899d1e79a254a1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0311 21:24:17.698703 63745 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18358-11004/.minikube/profiles/old-k8s-version-239315/client.key ...
I0311 21:24:17.698750 63745 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18358-11004/.minikube/profiles/old-k8s-version-239315/client.key: {Name:mk1c9660c0697ee2974af1d48018a6c224632dac Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0311 21:24:17.698893 63745 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/18358-11004/.minikube/profiles/old-k8s-version-239315/apiserver.key.1e888bb1
I0311 21:24:17.698922 63745 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18358-11004/.minikube/profiles/old-k8s-version-239315/apiserver.crt.1e888bb1 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.72.52]
I0311 21:24:18.409911 63745 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18358-11004/.minikube/profiles/old-k8s-version-239315/apiserver.crt.1e888bb1 ...
I0311 21:24:18.409941 63745 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18358-11004/.minikube/profiles/old-k8s-version-239315/apiserver.crt.1e888bb1: {Name:mk8210ac89b810efdae8f50944cc64c6fca45261 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0311 21:24:18.418875 63745 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18358-11004/.minikube/profiles/old-k8s-version-239315/apiserver.key.1e888bb1 ...
I0311 21:24:18.418905 63745 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18358-11004/.minikube/profiles/old-k8s-version-239315/apiserver.key.1e888bb1: {Name:mkce763d3a36659a237e1b5919f652d5d06e30b7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0311 21:24:18.419056 63745 certs.go:381] copying /home/jenkins/minikube-integration/18358-11004/.minikube/profiles/old-k8s-version-239315/apiserver.crt.1e888bb1 -> /home/jenkins/minikube-integration/18358-11004/.minikube/profiles/old-k8s-version-239315/apiserver.crt
I0311 21:24:18.419163 63745 certs.go:385] copying /home/jenkins/minikube-integration/18358-11004/.minikube/profiles/old-k8s-version-239315/apiserver.key.1e888bb1 -> /home/jenkins/minikube-integration/18358-11004/.minikube/profiles/old-k8s-version-239315/apiserver.key
I0311 21:24:18.419250 63745 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/18358-11004/.minikube/profiles/old-k8s-version-239315/proxy-client.key
I0311 21:24:18.419272 63745 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18358-11004/.minikube/profiles/old-k8s-version-239315/proxy-client.crt with IP's: []
I0311 21:24:18.691321 63745 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18358-11004/.minikube/profiles/old-k8s-version-239315/proxy-client.crt ...
I0311 21:24:18.691395 63745 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18358-11004/.minikube/profiles/old-k8s-version-239315/proxy-client.crt: {Name:mk01951e50cd1d77e617af1a7d767cd25703f957 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0311 21:24:18.691595 63745 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18358-11004/.minikube/profiles/old-k8s-version-239315/proxy-client.key ...
I0311 21:24:18.691639 63745 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18358-11004/.minikube/profiles/old-k8s-version-239315/proxy-client.key: {Name:mk4d80047d2a6797c981d986d8daca6e63a38c2f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0311 21:24:18.691870 63745 certs.go:484] found cert: /home/jenkins/minikube-integration/18358-11004/.minikube/certs/18235.pem (1338 bytes)
W0311 21:24:18.691932 63745 certs.go:480] ignoring /home/jenkins/minikube-integration/18358-11004/.minikube/certs/18235_empty.pem, impossibly tiny 0 bytes
I0311 21:24:18.691952 63745 certs.go:484] found cert: /home/jenkins/minikube-integration/18358-11004/.minikube/certs/ca-key.pem (1679 bytes)
I0311 21:24:18.692001 63745 certs.go:484] found cert: /home/jenkins/minikube-integration/18358-11004/.minikube/certs/ca.pem (1082 bytes)
I0311 21:24:18.692046 63745 certs.go:484] found cert: /home/jenkins/minikube-integration/18358-11004/.minikube/certs/cert.pem (1123 bytes)
I0311 21:24:18.692105 63745 certs.go:484] found cert: /home/jenkins/minikube-integration/18358-11004/.minikube/certs/key.pem (1675 bytes)
I0311 21:24:18.692167 63745 certs.go:484] found cert: /home/jenkins/minikube-integration/18358-11004/.minikube/files/etc/ssl/certs/182352.pem (1708 bytes)
I0311 21:24:18.693013 63745 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18358-11004/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0311 21:24:18.735845 63745 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18358-11004/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0311 21:24:18.770635 63745 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18358-11004/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0311 21:24:18.808636 63745 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18358-11004/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0311 21:24:18.854990 63745 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18358-11004/.minikube/profiles/old-k8s-version-239315/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0311 21:24:18.894571 63745 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18358-11004/.minikube/profiles/old-k8s-version-239315/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1671 bytes)
I0311 21:24:18.927455 63745 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18358-11004/.minikube/profiles/old-k8s-version-239315/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0311 21:24:18.964378 63745 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18358-11004/.minikube/profiles/old-k8s-version-239315/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0311 21:24:19.005830 63745 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18358-11004/.minikube/files/etc/ssl/certs/182352.pem --> /usr/share/ca-certificates/182352.pem (1708 bytes)
I0311 21:24:19.037581 63745 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18358-11004/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0311 21:24:19.071319 63745 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18358-11004/.minikube/certs/18235.pem --> /usr/share/ca-certificates/18235.pem (1338 bytes)
I0311 21:24:19.104549 63745 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0311 21:24:19.127445 63745 ssh_runner.go:195] Run: openssl version
I0311 21:24:19.135014 63745 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/182352.pem && ln -fs /usr/share/ca-certificates/182352.pem /etc/ssl/certs/182352.pem"
I0311 21:24:19.151903 63745 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/182352.pem
I0311 21:24:19.159025 63745 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Mar 11 20:19 /usr/share/ca-certificates/182352.pem
I0311 21:24:19.159073 63745 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/182352.pem
I0311 21:24:19.166478 63745 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/182352.pem /etc/ssl/certs/3ec20f2e.0"
I0311 21:24:19.186567 63745 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0311 21:24:19.202828 63745 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0311 21:24:19.209942 63745 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Mar 11 20:10 /usr/share/ca-certificates/minikubeCA.pem
I0311 21:24:19.209986 63745 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0311 21:24:19.218204 63745 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0311 21:24:19.233468 63745 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/18235.pem && ln -fs /usr/share/ca-certificates/18235.pem /etc/ssl/certs/18235.pem"
I0311 21:24:19.250781 63745 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/18235.pem
I0311 21:24:19.257722 63745 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Mar 11 20:19 /usr/share/ca-certificates/18235.pem
I0311 21:24:19.257771 63745 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/18235.pem
I0311 21:24:19.268049 63745 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/18235.pem /etc/ssl/certs/51391683.0"
I0311 21:24:19.294598 63745 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0311 21:24:19.301402 63745 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0311 21:24:19.301462 63745 kubeadm.go:391] StartCluster: {Name:old-k8s-version-239315 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-239315 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.52 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0311 21:24:19.301558 63745 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0311 21:24:19.301717 63745 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0311 21:24:19.367471 63745 cri.go:89] found id: ""
I0311 21:24:19.367539 63745 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0311 21:24:19.383963 63745 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0311 21:24:19.400305 63745 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0311 21:24:19.416541 63745 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0311 21:24:19.416566 63745 kubeadm.go:156] found existing configuration files:
I0311 21:24:19.416612 63745 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0311 21:24:19.431447 63745 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0311 21:24:19.431500 63745 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0311 21:24:19.449552 63745 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0311 21:24:19.462819 63745 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0311 21:24:19.462883 63745 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0311 21:24:19.479708 63745 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0311 21:24:19.509203 63745 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0311 21:24:19.509262 63745 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0311 21:24:19.533158 63745 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0311 21:24:19.565035 63745 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0311 21:24:19.565093 63745 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0311 21:24:19.592948 63745 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0311 21:24:19.796671 63745 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0311 21:24:19.796764 63745 kubeadm.go:309] [preflight] Running pre-flight checks
I0311 21:24:20.031874 63745 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0311 21:24:20.031968 63745 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0311 21:24:20.032044 63745 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0311 21:24:20.348218 63745 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0311 21:24:20.351549 63745 out.go:204] - Generating certificates and keys ...
I0311 21:24:20.352941 63745 kubeadm.go:309] [certs] Using existing ca certificate authority
I0311 21:24:20.353042 63745 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0311 21:24:20.513462 63745 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key
I0311 21:24:20.700010 63745 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key
I0311 21:24:20.828299 63745 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key
I0311 21:24:21.160775 63745 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key
I0311 21:24:21.328042 63745 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key
I0311 21:24:21.328463 63745 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-239315] and IPs [192.168.72.52 127.0.0.1 ::1]
I0311 21:24:21.420963 63745 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key
I0311 21:24:21.425068 63745 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-239315] and IPs [192.168.72.52 127.0.0.1 ::1]
I0311 21:24:21.838757 63745 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key
I0311 21:24:21.963879 63745 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key
I0311 21:24:22.145437 63745 kubeadm.go:309] [certs] Generating "sa" key and public key
I0311 21:24:22.145866 63745 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0311 21:24:22.245469 63745 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0311 21:24:22.360169 63745 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0311 21:24:22.600029 63745 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0311 21:24:22.745647 63745 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0311 21:24:22.769635 63745 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0311 21:24:22.769751 63745 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0311 21:24:22.769800 63745 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0311 21:24:23.004907 63745 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0311 21:24:23.007194 63745 out.go:204] - Booting up control plane ...
I0311 21:24:23.007309 63745 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0311 21:24:23.014432 63745 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0311 21:24:23.016115 63745 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0311 21:24:23.027973 63745 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0311 21:24:23.033024 63745 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0311 21:25:02.982037 63745 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0311 21:25:02.982146 63745 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0311 21:25:02.982389 63745 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0311 21:25:07.982366 63745 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0311 21:25:07.982619 63745 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0311 21:25:17.982512 63745 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0311 21:25:17.982728 63745 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0311 21:25:37.983437 63745 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0311 21:25:37.983703 63745 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0311 21:26:17.985101 63745 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0311 21:26:17.985359 63745 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0311 21:26:17.985379 63745 kubeadm.go:309]
I0311 21:26:17.985427 63745 kubeadm.go:309] Unfortunately, an error has occurred:
I0311 21:26:17.985488 63745 kubeadm.go:309] timed out waiting for the condition
I0311 21:26:17.985498 63745 kubeadm.go:309]
I0311 21:26:17.985540 63745 kubeadm.go:309] This error is likely caused by:
I0311 21:26:17.985587 63745 kubeadm.go:309] - The kubelet is not running
I0311 21:26:17.985733 63745 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0311 21:26:17.985752 63745 kubeadm.go:309]
I0311 21:26:17.985880 63745 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0311 21:26:17.985926 63745 kubeadm.go:309] - 'systemctl status kubelet'
I0311 21:26:17.985987 63745 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0311 21:26:17.985995 63745 kubeadm.go:309]
I0311 21:26:17.986125 63745 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0311 21:26:17.986233 63745 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0311 21:26:17.986245 63745 kubeadm.go:309]
I0311 21:26:17.986393 63745 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0311 21:26:17.986531 63745 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0311 21:26:17.986646 63745 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0311 21:26:17.986759 63745 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0311 21:26:17.986770 63745 kubeadm.go:309]
I0311 21:26:17.987839 63745 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0311 21:26:17.987989 63745 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0311 21:26:17.988097 63745 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
W0311 21:26:17.988239 63745 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-239315] and IPs [192.168.72.52 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-239315] and IPs [192.168.72.52 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-239315] and IPs [192.168.72.52 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-239315] and IPs [192.168.72.52 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0311 21:26:17.988291 63745 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0311 21:26:19.518192 63745 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (1.529878179s)
I0311 21:26:19.518273 63745 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0311 21:26:19.534335 63745 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0311 21:26:19.545973 63745 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0311 21:26:19.545998 63745 kubeadm.go:156] found existing configuration files:
I0311 21:26:19.546069 63745 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0311 21:26:19.556856 63745 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0311 21:26:19.556919 63745 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0311 21:26:19.568082 63745 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0311 21:26:19.578609 63745 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0311 21:26:19.578665 63745 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0311 21:26:19.590523 63745 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0311 21:26:19.601234 63745 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0311 21:26:19.601297 63745 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0311 21:26:19.612394 63745 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0311 21:26:19.622439 63745 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0311 21:26:19.622497 63745 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0311 21:26:19.633778 63745 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0311 21:26:19.900175 63745 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0311 21:28:16.232636 63745 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0311 21:28:16.232716 63745 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
I0311 21:28:16.234457 63745 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0311 21:28:16.234520 63745 kubeadm.go:309] [preflight] Running pre-flight checks
I0311 21:28:16.234613 63745 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0311 21:28:16.234747 63745 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0311 21:28:16.234907 63745 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0311 21:28:16.234992 63745 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0311 21:28:16.237176 63745 out.go:204] - Generating certificates and keys ...
I0311 21:28:16.237267 63745 kubeadm.go:309] [certs] Using existing ca certificate authority
I0311 21:28:16.237335 63745 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0311 21:28:16.237412 63745 kubeadm.go:309] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0311 21:28:16.237466 63745 kubeadm.go:309] [certs] Using existing front-proxy-ca certificate authority
I0311 21:28:16.237532 63745 kubeadm.go:309] [certs] Using existing front-proxy-client certificate and key on disk
I0311 21:28:16.237608 63745 kubeadm.go:309] [certs] Using existing etcd/ca certificate authority
I0311 21:28:16.237704 63745 kubeadm.go:309] [certs] Using existing etcd/server certificate and key on disk
I0311 21:28:16.237795 63745 kubeadm.go:309] [certs] Using existing etcd/peer certificate and key on disk
I0311 21:28:16.237889 63745 kubeadm.go:309] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0311 21:28:16.237973 63745 kubeadm.go:309] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0311 21:28:16.238009 63745 kubeadm.go:309] [certs] Using the existing "sa" key
I0311 21:28:16.238091 63745 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0311 21:28:16.238148 63745 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0311 21:28:16.238194 63745 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0311 21:28:16.238257 63745 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0311 21:28:16.238318 63745 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0311 21:28:16.238440 63745 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0311 21:28:16.238553 63745 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0311 21:28:16.238607 63745 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0311 21:28:16.238663 63745 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0311 21:28:16.240259 63745 out.go:204] - Booting up control plane ...
I0311 21:28:16.240327 63745 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0311 21:28:16.240417 63745 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0311 21:28:16.240490 63745 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0311 21:28:16.240583 63745 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0311 21:28:16.240805 63745 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0311 21:28:16.240864 63745 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0311 21:28:16.240923 63745 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0311 21:28:16.241095 63745 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0311 21:28:16.241163 63745 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0311 21:28:16.241328 63745 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0311 21:28:16.241393 63745 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0311 21:28:16.241546 63745 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0311 21:28:16.241603 63745 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0311 21:28:16.241760 63745 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0311 21:28:16.241820 63745 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0311 21:28:16.241992 63745 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0311 21:28:16.242010 63745 kubeadm.go:309]
I0311 21:28:16.242058 63745 kubeadm.go:309] Unfortunately, an error has occurred:
I0311 21:28:16.242124 63745 kubeadm.go:309] timed out waiting for the condition
I0311 21:28:16.242134 63745 kubeadm.go:309]
I0311 21:28:16.242185 63745 kubeadm.go:309] This error is likely caused by:
I0311 21:28:16.242226 63745 kubeadm.go:309] - The kubelet is not running
I0311 21:28:16.242342 63745 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0311 21:28:16.242349 63745 kubeadm.go:309]
I0311 21:28:16.242446 63745 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0311 21:28:16.242478 63745 kubeadm.go:309] - 'systemctl status kubelet'
I0311 21:28:16.242506 63745 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0311 21:28:16.242513 63745 kubeadm.go:309]
I0311 21:28:16.242597 63745 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0311 21:28:16.242668 63745 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0311 21:28:16.242675 63745 kubeadm.go:309]
I0311 21:28:16.242780 63745 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0311 21:28:16.242856 63745 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0311 21:28:16.242923 63745 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0311 21:28:16.243019 63745 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0311 21:28:16.243032 63745 kubeadm.go:309]
I0311 21:28:16.243122 63745 kubeadm.go:393] duration metric: took 3m56.94166406s to StartCluster
I0311 21:28:16.243173 63745 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0311 21:28:16.243230 63745 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0311 21:28:16.290041 63745 cri.go:89] found id: ""
I0311 21:28:16.290067 63745 logs.go:276] 0 containers: []
W0311 21:28:16.290076 63745 logs.go:278] No container was found matching "kube-apiserver"
I0311 21:28:16.290084 63745 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0311 21:28:16.290148 63745 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0311 21:28:16.328917 63745 cri.go:89] found id: ""
I0311 21:28:16.328942 63745 logs.go:276] 0 containers: []
W0311 21:28:16.328952 63745 logs.go:278] No container was found matching "etcd"
I0311 21:28:16.328960 63745 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0311 21:28:16.329020 63745 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0311 21:28:16.365933 63745 cri.go:89] found id: ""
I0311 21:28:16.365960 63745 logs.go:276] 0 containers: []
W0311 21:28:16.365971 63745 logs.go:278] No container was found matching "coredns"
I0311 21:28:16.365979 63745 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0311 21:28:16.366035 63745 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0311 21:28:16.403497 63745 cri.go:89] found id: ""
I0311 21:28:16.403524 63745 logs.go:276] 0 containers: []
W0311 21:28:16.403534 63745 logs.go:278] No container was found matching "kube-scheduler"
I0311 21:28:16.403542 63745 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0311 21:28:16.403596 63745 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0311 21:28:16.450614 63745 cri.go:89] found id: ""
I0311 21:28:16.450634 63745 logs.go:276] 0 containers: []
W0311 21:28:16.450640 63745 logs.go:278] No container was found matching "kube-proxy"
I0311 21:28:16.450647 63745 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0311 21:28:16.450696 63745 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0311 21:28:16.486181 63745 cri.go:89] found id: ""
I0311 21:28:16.486204 63745 logs.go:276] 0 containers: []
W0311 21:28:16.486212 63745 logs.go:278] No container was found matching "kube-controller-manager"
I0311 21:28:16.486218 63745 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0311 21:28:16.486261 63745 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0311 21:28:16.520959 63745 cri.go:89] found id: ""
I0311 21:28:16.520983 63745 logs.go:276] 0 containers: []
W0311 21:28:16.520993 63745 logs.go:278] No container was found matching "kindnet"
I0311 21:28:16.521004 63745 logs.go:123] Gathering logs for kubelet ...
I0311 21:28:16.521019 63745 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0311 21:28:16.570743 63745 logs.go:123] Gathering logs for dmesg ...
I0311 21:28:16.570768 63745 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0311 21:28:16.584567 63745 logs.go:123] Gathering logs for describe nodes ...
I0311 21:28:16.584591 63745 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0311 21:28:16.704504 63745 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0311 21:28:16.704524 63745 logs.go:123] Gathering logs for CRI-O ...
I0311 21:28:16.704537 63745 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0311 21:28:16.797145 63745 logs.go:123] Gathering logs for container status ...
I0311 21:28:16.797179 63745 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0311 21:28:16.855253 63745 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0311 21:28:16.855304 63745 out.go:239] *
*
W0311 21:28:16.855369 63745 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0311 21:28:16.855400 63745 out.go:239] *
*
W0311 21:28:16.856546 63745 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0311 21:28:16.860533 63745 out.go:177]
W0311 21:28:16.861994 63745 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0311 21:28:16.862061 63745 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0311 21:28:16.862092 63745 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0311 21:28:16.864589 63745 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-239315 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-239315 -n old-k8s-version-239315
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-239315 -n old-k8s-version-239315: exit status 6 (234.62869ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0311 21:28:17.145793 69928 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-239315" does not appear in /home/jenkins/minikube-integration/18358-11004/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-239315" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (291.81s)