=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-151788 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-151788 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m43.964482812s)
-- stdout --
* [old-k8s-version-151788] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=19011
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19011-1078924/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19011-1078924/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-151788" primary control-plane node in "old-k8s-version-151788" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0603 13:40:05.639115 1136266 out.go:291] Setting OutFile to fd 1 ...
I0603 13:40:05.639399 1136266 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0603 13:40:05.639410 1136266 out.go:304] Setting ErrFile to fd 2...
I0603 13:40:05.639414 1136266 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0603 13:40:05.639630 1136266 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19011-1078924/.minikube/bin
I0603 13:40:05.640259 1136266 out.go:298] Setting JSON to false
I0603 13:40:05.641895 1136266 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":15753,"bootTime":1717406253,"procs":302,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1060-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0603 13:40:05.641989 1136266 start.go:139] virtualization: kvm guest
I0603 13:40:05.644300 1136266 out.go:177] * [old-k8s-version-151788] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
I0603 13:40:05.645932 1136266 out.go:177] - MINIKUBE_LOCATION=19011
I0603 13:40:05.645869 1136266 notify.go:220] Checking for updates...
I0603 13:40:05.647374 1136266 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0603 13:40:05.648838 1136266 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19011-1078924/kubeconfig
I0603 13:40:05.650428 1136266 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19011-1078924/.minikube
I0603 13:40:05.651880 1136266 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0603 13:40:05.653123 1136266 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0603 13:40:05.655103 1136266 config.go:182] Loaded profile config "bridge-021279": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.1
I0603 13:40:05.655296 1136266 config.go:182] Loaded profile config "enable-default-cni-021279": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.1
I0603 13:40:05.655429 1136266 config.go:182] Loaded profile config "flannel-021279": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.1
I0603 13:40:05.655571 1136266 driver.go:392] Setting default libvirt URI to qemu:///system
I0603 13:40:05.697299 1136266 out.go:177] * Using the kvm2 driver based on user configuration
I0603 13:40:05.698790 1136266 start.go:297] selected driver: kvm2
I0603 13:40:05.698822 1136266 start.go:901] validating driver "kvm2" against <nil>
I0603 13:40:05.698841 1136266 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0603 13:40:05.699741 1136266 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0603 13:40:05.699834 1136266 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19011-1078924/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0603 13:40:05.716529 1136266 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.1
I0603 13:40:05.716595 1136266 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0603 13:40:05.716925 1136266 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0603 13:40:05.717015 1136266 cni.go:84] Creating CNI manager for ""
I0603 13:40:05.717033 1136266 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0603 13:40:05.717051 1136266 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0603 13:40:05.717149 1136266 start.go:340] cluster config:
{Name:old-k8s-version-151788 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1716228441-18934@sha256:628b3f20803bc9c4302fd048087dd36cf2ff5dc9ab0ded395ec3288e2f1d0862 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-151788 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0603 13:40:05.717290 1136266 iso.go:125] acquiring lock: {Name:mka26d6a83f88b83737ccc78b57cc462fbe70fe1 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0603 13:40:05.719456 1136266 out.go:177] * Starting "old-k8s-version-151788" primary control-plane node in "old-k8s-version-151788" cluster
I0603 13:40:05.720968 1136266 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0603 13:40:05.721021 1136266 preload.go:147] Found local preload: /home/jenkins/minikube-integration/19011-1078924/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0603 13:40:05.721047 1136266 cache.go:56] Caching tarball of preloaded images
I0603 13:40:05.721142 1136266 preload.go:173] Found /home/jenkins/minikube-integration/19011-1078924/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0603 13:40:05.721152 1136266 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0603 13:40:05.721242 1136266 profile.go:143] Saving config to /home/jenkins/minikube-integration/19011-1078924/.minikube/profiles/old-k8s-version-151788/config.json ...
I0603 13:40:05.721260 1136266 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19011-1078924/.minikube/profiles/old-k8s-version-151788/config.json: {Name:mkc1c07bf827ca375ec8402d2cd9b4f091ca3c64 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0603 13:40:05.721395 1136266 start.go:360] acquireMachinesLock for old-k8s-version-151788: {Name:mk20baaab39609d00406b78ad309423511e633ec Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0603 13:40:14.574893 1136266 start.go:364] duration metric: took 8.853414626s to acquireMachinesLock for "old-k8s-version-151788"
I0603 13:40:14.574976 1136266 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-151788 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18934/minikube-v1.33.1-1716398070-18934-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1716228441-18934@sha256:628b3f20803bc9c4302fd048087dd36cf2ff5dc9ab0ded395ec3288e2f1d0862 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-151788 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0603 13:40:14.575096 1136266 start.go:125] createHost starting for "" (driver="kvm2")
I0603 13:40:14.577469 1136266 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0603 13:40:14.577662 1136266 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0603 13:40:14.577745 1136266 main.go:141] libmachine: Launching plugin server for driver kvm2
I0603 13:40:14.595004 1136266 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:32987
I0603 13:40:14.595577 1136266 main.go:141] libmachine: () Calling .GetVersion
I0603 13:40:14.596177 1136266 main.go:141] libmachine: Using API Version 1
I0603 13:40:14.596207 1136266 main.go:141] libmachine: () Calling .SetConfigRaw
I0603 13:40:14.596652 1136266 main.go:141] libmachine: () Calling .GetMachineName
I0603 13:40:14.596898 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetMachineName
I0603 13:40:14.597062 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .DriverName
I0603 13:40:14.597246 1136266 start.go:159] libmachine.API.Create for "old-k8s-version-151788" (driver="kvm2")
I0603 13:40:14.597282 1136266 client.go:168] LocalClient.Create starting
I0603 13:40:14.597317 1136266 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19011-1078924/.minikube/certs/ca.pem
I0603 13:40:14.597364 1136266 main.go:141] libmachine: Decoding PEM data...
I0603 13:40:14.597392 1136266 main.go:141] libmachine: Parsing certificate...
I0603 13:40:14.597499 1136266 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19011-1078924/.minikube/certs/cert.pem
I0603 13:40:14.597527 1136266 main.go:141] libmachine: Decoding PEM data...
I0603 13:40:14.597547 1136266 main.go:141] libmachine: Parsing certificate...
I0603 13:40:14.597571 1136266 main.go:141] libmachine: Running pre-create checks...
I0603 13:40:14.597583 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .PreCreateCheck
I0603 13:40:14.598095 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetConfigRaw
I0603 13:40:14.598607 1136266 main.go:141] libmachine: Creating machine...
I0603 13:40:14.598624 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .Create
I0603 13:40:14.598777 1136266 main.go:141] libmachine: (old-k8s-version-151788) Creating KVM machine...
I0603 13:40:14.600396 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | found existing default KVM network
I0603 13:40:14.602271 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | I0603 13:40:14.602075 1136388 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:11:8f:ea} reservation:<nil>}
I0603 13:40:14.604123 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | I0603 13:40:14.604021 1136388 network.go:206] using free private subnet 192.168.50.0/24: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0002b4bc0}
I0603 13:40:14.604188 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | created network xml:
I0603 13:40:14.604228 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | <network>
I0603 13:40:14.604262 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | <name>mk-old-k8s-version-151788</name>
I0603 13:40:14.604284 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | <dns enable='no'/>
I0603 13:40:14.604295 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG |
I0603 13:40:14.604308 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | <ip address='192.168.50.1' netmask='255.255.255.0'>
I0603 13:40:14.604327 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | <dhcp>
I0603 13:40:14.604339 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | <range start='192.168.50.2' end='192.168.50.253'/>
I0603 13:40:14.604368 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | </dhcp>
I0603 13:40:14.604379 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | </ip>
I0603 13:40:14.604389 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG |
I0603 13:40:14.604399 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | </network>
I0603 13:40:14.604409 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG |
I0603 13:40:14.610460 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | trying to create private KVM network mk-old-k8s-version-151788 192.168.50.0/24...
I0603 13:40:14.689775 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | private KVM network mk-old-k8s-version-151788 192.168.50.0/24 created
I0603 13:40:14.689825 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | I0603 13:40:14.689766 1136388 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19011-1078924/.minikube
I0603 13:40:14.689868 1136266 main.go:141] libmachine: (old-k8s-version-151788) Setting up store path in /home/jenkins/minikube-integration/19011-1078924/.minikube/machines/old-k8s-version-151788 ...
I0603 13:40:14.689897 1136266 main.go:141] libmachine: (old-k8s-version-151788) Building disk image from file:///home/jenkins/minikube-integration/19011-1078924/.minikube/cache/iso/amd64/minikube-v1.33.1-1716398070-18934-amd64.iso
I0603 13:40:14.689963 1136266 main.go:141] libmachine: (old-k8s-version-151788) Downloading /home/jenkins/minikube-integration/19011-1078924/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19011-1078924/.minikube/cache/iso/amd64/minikube-v1.33.1-1716398070-18934-amd64.iso...
I0603 13:40:14.981766 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | I0603 13:40:14.981668 1136388 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19011-1078924/.minikube/machines/old-k8s-version-151788/id_rsa...
I0603 13:40:15.107946 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | I0603 13:40:15.107804 1136388 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19011-1078924/.minikube/machines/old-k8s-version-151788/old-k8s-version-151788.rawdisk...
I0603 13:40:15.107982 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | Writing magic tar header
I0603 13:40:15.108003 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | Writing SSH key tar header
I0603 13:40:15.108016 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | I0603 13:40:15.107973 1136388 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19011-1078924/.minikube/machines/old-k8s-version-151788 ...
I0603 13:40:15.108168 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19011-1078924/.minikube/machines/old-k8s-version-151788
I0603 13:40:15.108196 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19011-1078924/.minikube/machines
I0603 13:40:15.108224 1136266 main.go:141] libmachine: (old-k8s-version-151788) Setting executable bit set on /home/jenkins/minikube-integration/19011-1078924/.minikube/machines/old-k8s-version-151788 (perms=drwx------)
I0603 13:40:15.108244 1136266 main.go:141] libmachine: (old-k8s-version-151788) Setting executable bit set on /home/jenkins/minikube-integration/19011-1078924/.minikube/machines (perms=drwxr-xr-x)
I0603 13:40:15.108252 1136266 main.go:141] libmachine: (old-k8s-version-151788) Setting executable bit set on /home/jenkins/minikube-integration/19011-1078924/.minikube (perms=drwxr-xr-x)
I0603 13:40:15.108261 1136266 main.go:141] libmachine: (old-k8s-version-151788) Setting executable bit set on /home/jenkins/minikube-integration/19011-1078924 (perms=drwxrwxr-x)
I0603 13:40:15.108268 1136266 main.go:141] libmachine: (old-k8s-version-151788) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0603 13:40:15.108278 1136266 main.go:141] libmachine: (old-k8s-version-151788) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0603 13:40:15.108283 1136266 main.go:141] libmachine: (old-k8s-version-151788) Creating domain...
I0603 13:40:15.108290 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19011-1078924/.minikube
I0603 13:40:15.108298 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19011-1078924
I0603 13:40:15.108304 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0603 13:40:15.108310 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | Checking permissions on dir: /home/jenkins
I0603 13:40:15.108315 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | Checking permissions on dir: /home
I0603 13:40:15.108322 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | Skipping /home - not owner
I0603 13:40:15.109673 1136266 main.go:141] libmachine: (old-k8s-version-151788) define libvirt domain using xml:
I0603 13:40:15.109697 1136266 main.go:141] libmachine: (old-k8s-version-151788) <domain type='kvm'>
I0603 13:40:15.109707 1136266 main.go:141] libmachine: (old-k8s-version-151788) <name>old-k8s-version-151788</name>
I0603 13:40:15.109720 1136266 main.go:141] libmachine: (old-k8s-version-151788) <memory unit='MiB'>2200</memory>
I0603 13:40:15.109733 1136266 main.go:141] libmachine: (old-k8s-version-151788) <vcpu>2</vcpu>
I0603 13:40:15.109740 1136266 main.go:141] libmachine: (old-k8s-version-151788) <features>
I0603 13:40:15.109749 1136266 main.go:141] libmachine: (old-k8s-version-151788) <acpi/>
I0603 13:40:15.109756 1136266 main.go:141] libmachine: (old-k8s-version-151788) <apic/>
I0603 13:40:15.109789 1136266 main.go:141] libmachine: (old-k8s-version-151788) <pae/>
I0603 13:40:15.109815 1136266 main.go:141] libmachine: (old-k8s-version-151788)
I0603 13:40:15.109838 1136266 main.go:141] libmachine: (old-k8s-version-151788) </features>
I0603 13:40:15.109850 1136266 main.go:141] libmachine: (old-k8s-version-151788) <cpu mode='host-passthrough'>
I0603 13:40:15.109861 1136266 main.go:141] libmachine: (old-k8s-version-151788)
I0603 13:40:15.109867 1136266 main.go:141] libmachine: (old-k8s-version-151788) </cpu>
I0603 13:40:15.109876 1136266 main.go:141] libmachine: (old-k8s-version-151788) <os>
I0603 13:40:15.109883 1136266 main.go:141] libmachine: (old-k8s-version-151788) <type>hvm</type>
I0603 13:40:15.109901 1136266 main.go:141] libmachine: (old-k8s-version-151788) <boot dev='cdrom'/>
I0603 13:40:15.109912 1136266 main.go:141] libmachine: (old-k8s-version-151788) <boot dev='hd'/>
I0603 13:40:15.109924 1136266 main.go:141] libmachine: (old-k8s-version-151788) <bootmenu enable='no'/>
I0603 13:40:15.109934 1136266 main.go:141] libmachine: (old-k8s-version-151788) </os>
I0603 13:40:15.109942 1136266 main.go:141] libmachine: (old-k8s-version-151788) <devices>
I0603 13:40:15.109954 1136266 main.go:141] libmachine: (old-k8s-version-151788) <disk type='file' device='cdrom'>
I0603 13:40:15.109972 1136266 main.go:141] libmachine: (old-k8s-version-151788) <source file='/home/jenkins/minikube-integration/19011-1078924/.minikube/machines/old-k8s-version-151788/boot2docker.iso'/>
I0603 13:40:15.109984 1136266 main.go:141] libmachine: (old-k8s-version-151788) <target dev='hdc' bus='scsi'/>
I0603 13:40:15.110005 1136266 main.go:141] libmachine: (old-k8s-version-151788) <readonly/>
I0603 13:40:15.110017 1136266 main.go:141] libmachine: (old-k8s-version-151788) </disk>
I0603 13:40:15.110026 1136266 main.go:141] libmachine: (old-k8s-version-151788) <disk type='file' device='disk'>
I0603 13:40:15.110040 1136266 main.go:141] libmachine: (old-k8s-version-151788) <driver name='qemu' type='raw' cache='default' io='threads' />
I0603 13:40:15.110057 1136266 main.go:141] libmachine: (old-k8s-version-151788) <source file='/home/jenkins/minikube-integration/19011-1078924/.minikube/machines/old-k8s-version-151788/old-k8s-version-151788.rawdisk'/>
I0603 13:40:15.110068 1136266 main.go:141] libmachine: (old-k8s-version-151788) <target dev='hda' bus='virtio'/>
I0603 13:40:15.110079 1136266 main.go:141] libmachine: (old-k8s-version-151788) </disk>
I0603 13:40:15.110086 1136266 main.go:141] libmachine: (old-k8s-version-151788) <interface type='network'>
I0603 13:40:15.110096 1136266 main.go:141] libmachine: (old-k8s-version-151788) <source network='mk-old-k8s-version-151788'/>
I0603 13:40:15.110106 1136266 main.go:141] libmachine: (old-k8s-version-151788) <model type='virtio'/>
I0603 13:40:15.110115 1136266 main.go:141] libmachine: (old-k8s-version-151788) </interface>
I0603 13:40:15.110127 1136266 main.go:141] libmachine: (old-k8s-version-151788) <interface type='network'>
I0603 13:40:15.110137 1136266 main.go:141] libmachine: (old-k8s-version-151788) <source network='default'/>
I0603 13:40:15.110147 1136266 main.go:141] libmachine: (old-k8s-version-151788) <model type='virtio'/>
I0603 13:40:15.110156 1136266 main.go:141] libmachine: (old-k8s-version-151788) </interface>
I0603 13:40:15.110167 1136266 main.go:141] libmachine: (old-k8s-version-151788) <serial type='pty'>
I0603 13:40:15.110176 1136266 main.go:141] libmachine: (old-k8s-version-151788) <target port='0'/>
I0603 13:40:15.110186 1136266 main.go:141] libmachine: (old-k8s-version-151788) </serial>
I0603 13:40:15.110195 1136266 main.go:141] libmachine: (old-k8s-version-151788) <console type='pty'>
I0603 13:40:15.110207 1136266 main.go:141] libmachine: (old-k8s-version-151788) <target type='serial' port='0'/>
I0603 13:40:15.110217 1136266 main.go:141] libmachine: (old-k8s-version-151788) </console>
I0603 13:40:15.110228 1136266 main.go:141] libmachine: (old-k8s-version-151788) <rng model='virtio'>
I0603 13:40:15.110241 1136266 main.go:141] libmachine: (old-k8s-version-151788) <backend model='random'>/dev/random</backend>
I0603 13:40:15.110251 1136266 main.go:141] libmachine: (old-k8s-version-151788) </rng>
I0603 13:40:15.110259 1136266 main.go:141] libmachine: (old-k8s-version-151788)
I0603 13:40:15.110269 1136266 main.go:141] libmachine: (old-k8s-version-151788)
I0603 13:40:15.110278 1136266 main.go:141] libmachine: (old-k8s-version-151788) </devices>
I0603 13:40:15.110288 1136266 main.go:141] libmachine: (old-k8s-version-151788) </domain>
I0603 13:40:15.110303 1136266 main.go:141] libmachine: (old-k8s-version-151788)
I0603 13:40:15.115616 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined MAC address 52:54:00:d2:91:7e in network default
I0603 13:40:15.116375 1136266 main.go:141] libmachine: (old-k8s-version-151788) Ensuring networks are active...
I0603 13:40:15.116401 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:15.117474 1136266 main.go:141] libmachine: (old-k8s-version-151788) Ensuring network default is active
I0603 13:40:15.117790 1136266 main.go:141] libmachine: (old-k8s-version-151788) Ensuring network mk-old-k8s-version-151788 is active
I0603 13:40:15.118520 1136266 main.go:141] libmachine: (old-k8s-version-151788) Getting domain xml...
I0603 13:40:15.119442 1136266 main.go:141] libmachine: (old-k8s-version-151788) Creating domain...
I0603 13:40:16.531903 1136266 main.go:141] libmachine: (old-k8s-version-151788) Waiting to get IP...
I0603 13:40:16.532649 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:16.533202 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | unable to find current IP address of domain old-k8s-version-151788 in network mk-old-k8s-version-151788
I0603 13:40:16.533227 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | I0603 13:40:16.533154 1136388 retry.go:31] will retry after 294.416071ms: waiting for machine to come up
I0603 13:40:16.830006 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:16.830666 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | unable to find current IP address of domain old-k8s-version-151788 in network mk-old-k8s-version-151788
I0603 13:40:16.830696 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | I0603 13:40:16.830625 1136388 retry.go:31] will retry after 374.015365ms: waiting for machine to come up
I0603 13:40:17.206716 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:17.207924 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | unable to find current IP address of domain old-k8s-version-151788 in network mk-old-k8s-version-151788
I0603 13:40:17.207951 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | I0603 13:40:17.207856 1136388 retry.go:31] will retry after 366.235311ms: waiting for machine to come up
I0603 13:40:17.578092 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:17.582539 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | unable to find current IP address of domain old-k8s-version-151788 in network mk-old-k8s-version-151788
I0603 13:40:17.582566 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | I0603 13:40:17.582451 1136388 retry.go:31] will retry after 553.37394ms: waiting for machine to come up
I0603 13:40:18.137070 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:18.137693 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | unable to find current IP address of domain old-k8s-version-151788 in network mk-old-k8s-version-151788
I0603 13:40:18.137728 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | I0603 13:40:18.137640 1136388 retry.go:31] will retry after 761.980085ms: waiting for machine to come up
I0603 13:40:18.901923 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:18.902635 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | unable to find current IP address of domain old-k8s-version-151788 in network mk-old-k8s-version-151788
I0603 13:40:18.902672 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | I0603 13:40:18.902570 1136388 retry.go:31] will retry after 740.632153ms: waiting for machine to come up
I0603 13:40:19.645291 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:19.646036 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | unable to find current IP address of domain old-k8s-version-151788 in network mk-old-k8s-version-151788
I0603 13:40:19.646059 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | I0603 13:40:19.645973 1136388 retry.go:31] will retry after 988.351766ms: waiting for machine to come up
I0603 13:40:20.636069 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:20.636844 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | unable to find current IP address of domain old-k8s-version-151788 in network mk-old-k8s-version-151788
I0603 13:40:20.636861 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | I0603 13:40:20.636790 1136388 retry.go:31] will retry after 1.38077277s: waiting for machine to come up
I0603 13:40:22.018825 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:22.019431 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | unable to find current IP address of domain old-k8s-version-151788 in network mk-old-k8s-version-151788
I0603 13:40:22.019467 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | I0603 13:40:22.019348 1136388 retry.go:31] will retry after 1.556582694s: waiting for machine to come up
I0603 13:40:23.578094 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:23.578765 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | unable to find current IP address of domain old-k8s-version-151788 in network mk-old-k8s-version-151788
I0603 13:40:23.578806 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | I0603 13:40:23.578680 1136388 retry.go:31] will retry after 1.805943796s: waiting for machine to come up
I0603 13:40:25.386065 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:25.386598 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | unable to find current IP address of domain old-k8s-version-151788 in network mk-old-k8s-version-151788
I0603 13:40:25.386627 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | I0603 13:40:25.386550 1136388 retry.go:31] will retry after 2.57512651s: waiting for machine to come up
I0603 13:40:27.963668 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:27.964276 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | unable to find current IP address of domain old-k8s-version-151788 in network mk-old-k8s-version-151788
I0603 13:40:27.964307 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | I0603 13:40:27.964219 1136388 retry.go:31] will retry after 2.972366952s: waiting for machine to come up
I0603 13:40:30.938564 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:30.939095 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | unable to find current IP address of domain old-k8s-version-151788 in network mk-old-k8s-version-151788
I0603 13:40:30.939124 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | I0603 13:40:30.939035 1136388 retry.go:31] will retry after 3.065653217s: waiting for machine to come up
I0603 13:40:34.007087 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:34.007703 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | unable to find current IP address of domain old-k8s-version-151788 in network mk-old-k8s-version-151788
I0603 13:40:34.007728 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | I0603 13:40:34.007649 1136388 retry.go:31] will retry after 4.388056129s: waiting for machine to come up
I0603 13:40:38.398798 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:38.399383 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has current primary IP address 192.168.50.65 and MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:38.399426 1136266 main.go:141] libmachine: (old-k8s-version-151788) Found IP for machine: 192.168.50.65
I0603 13:40:38.399441 1136266 main.go:141] libmachine: (old-k8s-version-151788) Reserving static IP address...
I0603 13:40:38.400030 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-151788", mac: "52:54:00:56:4e:c1", ip: "192.168.50.65"} in network mk-old-k8s-version-151788
I0603 13:40:38.488070 1136266 main.go:141] libmachine: (old-k8s-version-151788) Reserved static IP address: 192.168.50.65
I0603 13:40:38.488098 1136266 main.go:141] libmachine: (old-k8s-version-151788) Waiting for SSH to be available...
I0603 13:40:38.488118 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | Getting to WaitForSSH function...
I0603 13:40:38.491244 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:38.491607 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | unable to find host DHCP lease matching {name: "", mac: "52:54:00:56:4e:c1", ip: ""} in network mk-old-k8s-version-151788
I0603 13:40:38.491627 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | unable to find defined IP address of network mk-old-k8s-version-151788 interface with MAC address 52:54:00:56:4e:c1
I0603 13:40:38.491919 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | Using SSH client type: external
I0603 13:40:38.491944 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | Using SSH private key: /home/jenkins/minikube-integration/19011-1078924/.minikube/machines/old-k8s-version-151788/id_rsa (-rw-------)
I0603 13:40:38.491971 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@ -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19011-1078924/.minikube/machines/old-k8s-version-151788/id_rsa -p 22] /usr/bin/ssh <nil>}
I0603 13:40:38.491980 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | About to run SSH command:
I0603 13:40:38.491990 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | exit 0
I0603 13:40:38.496067 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | SSH cmd err, output: exit status 255:
I0603 13:40:38.496087 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | Error getting ssh command 'exit 0' : ssh command error:
I0603 13:40:38.496093 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | command : exit 0
I0603 13:40:38.496098 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | err : exit status 255
I0603 13:40:38.496106 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | output :
I0603 13:40:41.497862 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | Getting to WaitForSSH function...
I0603 13:40:41.500650 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:41.501154 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:56:4e:c1", ip: ""} in network mk-old-k8s-version-151788: {Iface:virbr2 ExpiryTime:2024-06-03 14:40:31 +0000 UTC Type:0 Mac:52:54:00:56:4e:c1 Iaid: IPaddr:192.168.50.65 Prefix:24 Hostname:old-k8s-version-151788 Clientid:01:52:54:00:56:4e:c1}
I0603 13:40:41.501185 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined IP address 192.168.50.65 and MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:41.501310 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | Using SSH client type: external
I0603 13:40:41.501337 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | Using SSH private key: /home/jenkins/minikube-integration/19011-1078924/.minikube/machines/old-k8s-version-151788/id_rsa (-rw-------)
I0603 13:40:41.501358 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.50.65 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19011-1078924/.minikube/machines/old-k8s-version-151788/id_rsa -p 22] /usr/bin/ssh <nil>}
I0603 13:40:41.501377 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | About to run SSH command:
I0603 13:40:41.501390 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | exit 0
I0603 13:40:41.634973 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | SSH cmd err, output: <nil>:
I0603 13:40:41.635194 1136266 main.go:141] libmachine: (old-k8s-version-151788) KVM machine creation complete!
I0603 13:40:41.635549 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetConfigRaw
I0603 13:40:41.636215 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .DriverName
I0603 13:40:41.636518 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .DriverName
I0603 13:40:41.636727 1136266 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0603 13:40:41.636745 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetState
I0603 13:40:41.638307 1136266 main.go:141] libmachine: Detecting operating system of created instance...
I0603 13:40:41.638336 1136266 main.go:141] libmachine: Waiting for SSH to be available...
I0603 13:40:41.638345 1136266 main.go:141] libmachine: Getting to WaitForSSH function...
I0603 13:40:41.638363 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetSSHHostname
I0603 13:40:41.641163 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:41.641578 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:56:4e:c1", ip: ""} in network mk-old-k8s-version-151788: {Iface:virbr2 ExpiryTime:2024-06-03 14:40:31 +0000 UTC Type:0 Mac:52:54:00:56:4e:c1 Iaid: IPaddr:192.168.50.65 Prefix:24 Hostname:old-k8s-version-151788 Clientid:01:52:54:00:56:4e:c1}
I0603 13:40:41.641601 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined IP address 192.168.50.65 and MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:41.641810 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetSSHPort
I0603 13:40:41.642026 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetSSHKeyPath
I0603 13:40:41.642200 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetSSHKeyPath
I0603 13:40:41.642441 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetSSHUsername
I0603 13:40:41.642717 1136266 main.go:141] libmachine: Using SSH client type: native
I0603 13:40:41.642909 1136266 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d800] 0x830560 <nil> [] 0s} 192.168.50.65 22 <nil> <nil>}
I0603 13:40:41.642921 1136266 main.go:141] libmachine: About to run SSH command:
exit 0
I0603 13:40:41.755202 1136266 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0603 13:40:41.755230 1136266 main.go:141] libmachine: Detecting the provisioner...
I0603 13:40:41.755240 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetSSHHostname
I0603 13:40:41.758712 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:41.759117 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:56:4e:c1", ip: ""} in network mk-old-k8s-version-151788: {Iface:virbr2 ExpiryTime:2024-06-03 14:40:31 +0000 UTC Type:0 Mac:52:54:00:56:4e:c1 Iaid: IPaddr:192.168.50.65 Prefix:24 Hostname:old-k8s-version-151788 Clientid:01:52:54:00:56:4e:c1}
I0603 13:40:41.759156 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined IP address 192.168.50.65 and MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:41.759391 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetSSHPort
I0603 13:40:41.759596 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetSSHKeyPath
I0603 13:40:41.759786 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetSSHKeyPath
I0603 13:40:41.759920 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetSSHUsername
I0603 13:40:41.760081 1136266 main.go:141] libmachine: Using SSH client type: native
I0603 13:40:41.760283 1136266 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d800] 0x830560 <nil> [] 0s} 192.168.50.65 22 <nil> <nil>}
I0603 13:40:41.760311 1136266 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0603 13:40:41.867506 1136266 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0603 13:40:41.867595 1136266 main.go:141] libmachine: found compatible host: buildroot
I0603 13:40:41.867606 1136266 main.go:141] libmachine: Provisioning with buildroot...
I0603 13:40:41.867614 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetMachineName
I0603 13:40:41.867881 1136266 buildroot.go:166] provisioning hostname "old-k8s-version-151788"
I0603 13:40:41.867916 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetMachineName
I0603 13:40:41.868170 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetSSHHostname
I0603 13:40:41.871769 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:41.872248 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:56:4e:c1", ip: ""} in network mk-old-k8s-version-151788: {Iface:virbr2 ExpiryTime:2024-06-03 14:40:31 +0000 UTC Type:0 Mac:52:54:00:56:4e:c1 Iaid: IPaddr:192.168.50.65 Prefix:24 Hostname:old-k8s-version-151788 Clientid:01:52:54:00:56:4e:c1}
I0603 13:40:41.872274 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined IP address 192.168.50.65 and MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:41.872733 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetSSHPort
I0603 13:40:41.872962 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetSSHKeyPath
I0603 13:40:41.873187 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetSSHKeyPath
I0603 13:40:41.873369 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetSSHUsername
I0603 13:40:41.873608 1136266 main.go:141] libmachine: Using SSH client type: native
I0603 13:40:41.873835 1136266 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d800] 0x830560 <nil> [] 0s} 192.168.50.65 22 <nil> <nil>}
I0603 13:40:41.873856 1136266 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-151788 && echo "old-k8s-version-151788" | sudo tee /etc/hostname
I0603 13:40:42.009952 1136266 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-151788
I0603 13:40:42.009988 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetSSHHostname
I0603 13:40:42.013716 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:42.014293 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:56:4e:c1", ip: ""} in network mk-old-k8s-version-151788: {Iface:virbr2 ExpiryTime:2024-06-03 14:40:31 +0000 UTC Type:0 Mac:52:54:00:56:4e:c1 Iaid: IPaddr:192.168.50.65 Prefix:24 Hostname:old-k8s-version-151788 Clientid:01:52:54:00:56:4e:c1}
I0603 13:40:42.014318 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined IP address 192.168.50.65 and MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:42.014583 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetSSHPort
I0603 13:40:42.014794 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetSSHKeyPath
I0603 13:40:42.015019 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetSSHKeyPath
I0603 13:40:42.015202 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetSSHUsername
I0603 13:40:42.015459 1136266 main.go:141] libmachine: Using SSH client type: native
I0603 13:40:42.015697 1136266 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d800] 0x830560 <nil> [] 0s} 192.168.50.65 22 <nil> <nil>}
I0603 13:40:42.015727 1136266 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-151788' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-151788/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-151788' | sudo tee -a /etc/hosts;
fi
fi
I0603 13:40:42.142695 1136266 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0603 13:40:42.142730 1136266 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19011-1078924/.minikube CaCertPath:/home/jenkins/minikube-integration/19011-1078924/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19011-1078924/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19011-1078924/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19011-1078924/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19011-1078924/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19011-1078924/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19011-1078924/.minikube}
I0603 13:40:42.142752 1136266 buildroot.go:174] setting up certificates
I0603 13:40:42.142771 1136266 provision.go:84] configureAuth start
I0603 13:40:42.142788 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetMachineName
I0603 13:40:42.143129 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetIP
I0603 13:40:42.148413 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:42.149034 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:56:4e:c1", ip: ""} in network mk-old-k8s-version-151788: {Iface:virbr2 ExpiryTime:2024-06-03 14:40:31 +0000 UTC Type:0 Mac:52:54:00:56:4e:c1 Iaid: IPaddr:192.168.50.65 Prefix:24 Hostname:old-k8s-version-151788 Clientid:01:52:54:00:56:4e:c1}
I0603 13:40:42.149065 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined IP address 192.168.50.65 and MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:42.149237 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetSSHHostname
I0603 13:40:42.154658 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:42.155205 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:56:4e:c1", ip: ""} in network mk-old-k8s-version-151788: {Iface:virbr2 ExpiryTime:2024-06-03 14:40:31 +0000 UTC Type:0 Mac:52:54:00:56:4e:c1 Iaid: IPaddr:192.168.50.65 Prefix:24 Hostname:old-k8s-version-151788 Clientid:01:52:54:00:56:4e:c1}
I0603 13:40:42.155220 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined IP address 192.168.50.65 and MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:42.155273 1136266 provision.go:143] copyHostCerts
I0603 13:40:42.155342 1136266 exec_runner.go:144] found /home/jenkins/minikube-integration/19011-1078924/.minikube/ca.pem, removing ...
I0603 13:40:42.155360 1136266 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19011-1078924/.minikube/ca.pem
I0603 13:40:42.155439 1136266 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19011-1078924/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19011-1078924/.minikube/ca.pem (1078 bytes)
I0603 13:40:42.155569 1136266 exec_runner.go:144] found /home/jenkins/minikube-integration/19011-1078924/.minikube/cert.pem, removing ...
I0603 13:40:42.155578 1136266 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19011-1078924/.minikube/cert.pem
I0603 13:40:42.155611 1136266 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19011-1078924/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19011-1078924/.minikube/cert.pem (1123 bytes)
I0603 13:40:42.155701 1136266 exec_runner.go:144] found /home/jenkins/minikube-integration/19011-1078924/.minikube/key.pem, removing ...
I0603 13:40:42.155719 1136266 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19011-1078924/.minikube/key.pem
I0603 13:40:42.155750 1136266 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19011-1078924/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19011-1078924/.minikube/key.pem (1675 bytes)
I0603 13:40:42.155831 1136266 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19011-1078924/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19011-1078924/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19011-1078924/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-151788 san=[127.0.0.1 192.168.50.65 localhost minikube old-k8s-version-151788]
I0603 13:40:42.334654 1136266 provision.go:177] copyRemoteCerts
I0603 13:40:42.334712 1136266 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0603 13:40:42.334740 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetSSHHostname
I0603 13:40:42.338444 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:42.338973 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:56:4e:c1", ip: ""} in network mk-old-k8s-version-151788: {Iface:virbr2 ExpiryTime:2024-06-03 14:40:31 +0000 UTC Type:0 Mac:52:54:00:56:4e:c1 Iaid: IPaddr:192.168.50.65 Prefix:24 Hostname:old-k8s-version-151788 Clientid:01:52:54:00:56:4e:c1}
I0603 13:40:42.339002 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined IP address 192.168.50.65 and MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:42.339192 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetSSHPort
I0603 13:40:42.339464 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetSSHKeyPath
I0603 13:40:42.339652 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetSSHUsername
I0603 13:40:42.339848 1136266 sshutil.go:53] new ssh client: &{IP:192.168.50.65 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19011-1078924/.minikube/machines/old-k8s-version-151788/id_rsa Username:docker}
I0603 13:40:42.426563 1136266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19011-1078924/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0603 13:40:42.458445 1136266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19011-1078924/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0603 13:40:42.490606 1136266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19011-1078924/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0603 13:40:42.519115 1136266 provision.go:87] duration metric: took 376.324051ms to configureAuth
I0603 13:40:42.519144 1136266 buildroot.go:189] setting minikube options for container-runtime
I0603 13:40:42.519376 1136266 config.go:182] Loaded profile config "old-k8s-version-151788": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0603 13:40:42.519521 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetSSHHostname
I0603 13:40:42.522609 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:42.523051 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:56:4e:c1", ip: ""} in network mk-old-k8s-version-151788: {Iface:virbr2 ExpiryTime:2024-06-03 14:40:31 +0000 UTC Type:0 Mac:52:54:00:56:4e:c1 Iaid: IPaddr:192.168.50.65 Prefix:24 Hostname:old-k8s-version-151788 Clientid:01:52:54:00:56:4e:c1}
I0603 13:40:42.523086 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined IP address 192.168.50.65 and MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:42.523318 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetSSHPort
I0603 13:40:42.523520 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetSSHKeyPath
I0603 13:40:42.523709 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetSSHKeyPath
I0603 13:40:42.523864 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetSSHUsername
I0603 13:40:42.524067 1136266 main.go:141] libmachine: Using SSH client type: native
I0603 13:40:42.524306 1136266 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d800] 0x830560 <nil> [] 0s} 192.168.50.65 22 <nil> <nil>}
I0603 13:40:42.524332 1136266 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0603 13:40:42.851069 1136266 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0603 13:40:42.851102 1136266 main.go:141] libmachine: Checking connection to Docker...
I0603 13:40:42.851113 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetURL
I0603 13:40:42.853223 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | Using libvirt version 6000000
I0603 13:40:42.856403 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:42.856857 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:56:4e:c1", ip: ""} in network mk-old-k8s-version-151788: {Iface:virbr2 ExpiryTime:2024-06-03 14:40:31 +0000 UTC Type:0 Mac:52:54:00:56:4e:c1 Iaid: IPaddr:192.168.50.65 Prefix:24 Hostname:old-k8s-version-151788 Clientid:01:52:54:00:56:4e:c1}
I0603 13:40:42.856873 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined IP address 192.168.50.65 and MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:42.857059 1136266 main.go:141] libmachine: Docker is up and running!
I0603 13:40:42.857069 1136266 main.go:141] libmachine: Reticulating splines...
I0603 13:40:42.857087 1136266 client.go:171] duration metric: took 28.259785817s to LocalClient.Create
I0603 13:40:42.857107 1136266 start.go:167] duration metric: took 28.259873955s to libmachine.API.Create "old-k8s-version-151788"
I0603 13:40:42.857115 1136266 start.go:293] postStartSetup for "old-k8s-version-151788" (driver="kvm2")
I0603 13:40:42.857123 1136266 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0603 13:40:42.857143 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .DriverName
I0603 13:40:42.857375 1136266 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0603 13:40:42.857396 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetSSHHostname
I0603 13:40:42.860084 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:42.860472 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:56:4e:c1", ip: ""} in network mk-old-k8s-version-151788: {Iface:virbr2 ExpiryTime:2024-06-03 14:40:31 +0000 UTC Type:0 Mac:52:54:00:56:4e:c1 Iaid: IPaddr:192.168.50.65 Prefix:24 Hostname:old-k8s-version-151788 Clientid:01:52:54:00:56:4e:c1}
I0603 13:40:42.860495 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined IP address 192.168.50.65 and MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:42.860660 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetSSHPort
I0603 13:40:42.860809 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetSSHKeyPath
I0603 13:40:42.860941 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetSSHUsername
I0603 13:40:42.861026 1136266 sshutil.go:53] new ssh client: &{IP:192.168.50.65 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19011-1078924/.minikube/machines/old-k8s-version-151788/id_rsa Username:docker}
I0603 13:40:42.956352 1136266 ssh_runner.go:195] Run: cat /etc/os-release
I0603 13:40:42.961085 1136266 info.go:137] Remote host: Buildroot 2023.02.9
I0603 13:40:42.961108 1136266 filesync.go:126] Scanning /home/jenkins/minikube-integration/19011-1078924/.minikube/addons for local assets ...
I0603 13:40:42.961157 1136266 filesync.go:126] Scanning /home/jenkins/minikube-integration/19011-1078924/.minikube/files for local assets ...
I0603 13:40:42.961255 1136266 filesync.go:149] local asset: /home/jenkins/minikube-integration/19011-1078924/.minikube/files/etc/ssl/certs/10862512.pem -> 10862512.pem in /etc/ssl/certs
I0603 13:40:42.961383 1136266 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0603 13:40:42.972615 1136266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19011-1078924/.minikube/files/etc/ssl/certs/10862512.pem --> /etc/ssl/certs/10862512.pem (1708 bytes)
I0603 13:40:43.010662 1136266 start.go:296] duration metric: took 153.536715ms for postStartSetup
I0603 13:40:43.010720 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetConfigRaw
I0603 13:40:43.011283 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetIP
I0603 13:40:43.014338 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:43.014736 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:56:4e:c1", ip: ""} in network mk-old-k8s-version-151788: {Iface:virbr2 ExpiryTime:2024-06-03 14:40:31 +0000 UTC Type:0 Mac:52:54:00:56:4e:c1 Iaid: IPaddr:192.168.50.65 Prefix:24 Hostname:old-k8s-version-151788 Clientid:01:52:54:00:56:4e:c1}
I0603 13:40:43.014781 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined IP address 192.168.50.65 and MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:43.015047 1136266 profile.go:143] Saving config to /home/jenkins/minikube-integration/19011-1078924/.minikube/profiles/old-k8s-version-151788/config.json ...
I0603 13:40:43.015280 1136266 start.go:128] duration metric: took 28.440169118s to createHost
I0603 13:40:43.015315 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetSSHHostname
I0603 13:40:43.018459 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:43.018765 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:56:4e:c1", ip: ""} in network mk-old-k8s-version-151788: {Iface:virbr2 ExpiryTime:2024-06-03 14:40:31 +0000 UTC Type:0 Mac:52:54:00:56:4e:c1 Iaid: IPaddr:192.168.50.65 Prefix:24 Hostname:old-k8s-version-151788 Clientid:01:52:54:00:56:4e:c1}
I0603 13:40:43.018799 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined IP address 192.168.50.65 and MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:43.018916 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetSSHPort
I0603 13:40:43.019114 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetSSHKeyPath
I0603 13:40:43.019354 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetSSHKeyPath
I0603 13:40:43.019549 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetSSHUsername
I0603 13:40:43.019742 1136266 main.go:141] libmachine: Using SSH client type: native
I0603 13:40:43.019928 1136266 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d800] 0x830560 <nil> [] 0s} 192.168.50.65 22 <nil> <nil>}
I0603 13:40:43.019935 1136266 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0603 13:40:43.136080 1136266 main.go:141] libmachine: SSH cmd err, output: <nil>: 1717422043.122995135
I0603 13:40:43.136109 1136266 fix.go:216] guest clock: 1717422043.122995135
I0603 13:40:43.136118 1136266 fix.go:229] Guest: 2024-06-03 13:40:43.122995135 +0000 UTC Remote: 2024-06-03 13:40:43.015299729 +0000 UTC m=+37.415322568 (delta=107.695406ms)
I0603 13:40:43.136160 1136266 fix.go:200] guest clock delta is within tolerance: 107.695406ms
I0603 13:40:43.136167 1136266 start.go:83] releasing machines lock for "old-k8s-version-151788", held for 28.561229359s
I0603 13:40:43.136192 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .DriverName
I0603 13:40:43.136488 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetIP
I0603 13:40:43.140117 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:43.140509 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:56:4e:c1", ip: ""} in network mk-old-k8s-version-151788: {Iface:virbr2 ExpiryTime:2024-06-03 14:40:31 +0000 UTC Type:0 Mac:52:54:00:56:4e:c1 Iaid: IPaddr:192.168.50.65 Prefix:24 Hostname:old-k8s-version-151788 Clientid:01:52:54:00:56:4e:c1}
I0603 13:40:43.140536 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined IP address 192.168.50.65 and MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:43.140727 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .DriverName
I0603 13:40:43.141286 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .DriverName
I0603 13:40:43.141534 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .DriverName
I0603 13:40:43.141632 1136266 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0603 13:40:43.141683 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetSSHHostname
I0603 13:40:43.141924 1136266 ssh_runner.go:195] Run: cat /version.json
I0603 13:40:43.141945 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetSSHHostname
I0603 13:40:43.145834 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:43.146306 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:56:4e:c1", ip: ""} in network mk-old-k8s-version-151788: {Iface:virbr2 ExpiryTime:2024-06-03 14:40:31 +0000 UTC Type:0 Mac:52:54:00:56:4e:c1 Iaid: IPaddr:192.168.50.65 Prefix:24 Hostname:old-k8s-version-151788 Clientid:01:52:54:00:56:4e:c1}
I0603 13:40:43.146330 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined IP address 192.168.50.65 and MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:43.146418 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetSSHPort
I0603 13:40:43.146593 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetSSHKeyPath
I0603 13:40:43.146716 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetSSHUsername
I0603 13:40:43.146815 1136266 sshutil.go:53] new ssh client: &{IP:192.168.50.65 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19011-1078924/.minikube/machines/old-k8s-version-151788/id_rsa Username:docker}
I0603 13:40:43.147163 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:43.153528 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetSSHPort
I0603 13:40:43.153603 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:56:4e:c1", ip: ""} in network mk-old-k8s-version-151788: {Iface:virbr2 ExpiryTime:2024-06-03 14:40:31 +0000 UTC Type:0 Mac:52:54:00:56:4e:c1 Iaid: IPaddr:192.168.50.65 Prefix:24 Hostname:old-k8s-version-151788 Clientid:01:52:54:00:56:4e:c1}
I0603 13:40:43.153631 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined IP address 192.168.50.65 and MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:43.153772 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetSSHKeyPath
I0603 13:40:43.153971 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetSSHUsername
I0603 13:40:43.154115 1136266 sshutil.go:53] new ssh client: &{IP:192.168.50.65 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19011-1078924/.minikube/machines/old-k8s-version-151788/id_rsa Username:docker}
I0603 13:40:43.241236 1136266 ssh_runner.go:195] Run: systemctl --version
I0603 13:40:43.267771 1136266 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0603 13:40:43.441383 1136266 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0603 13:40:43.448465 1136266 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0603 13:40:43.448554 1136266 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0603 13:40:43.474999 1136266 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0603 13:40:43.475028 1136266 start.go:494] detecting cgroup driver to use...
I0603 13:40:43.475082 1136266 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0603 13:40:43.495957 1136266 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0603 13:40:43.515040 1136266 docker.go:217] disabling cri-docker service (if available) ...
I0603 13:40:43.515104 1136266 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0603 13:40:43.535022 1136266 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0603 13:40:43.554336 1136266 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0603 13:40:43.715606 1136266 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0603 13:40:43.930389 1136266 docker.go:233] disabling docker service ...
I0603 13:40:43.930476 1136266 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0603 13:40:43.955605 1136266 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0603 13:40:43.970613 1136266 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0603 13:40:44.121372 1136266 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0603 13:40:44.291154 1136266 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0603 13:40:44.314650 1136266 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0603 13:40:44.341118 1136266 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0603 13:40:44.341181 1136266 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0603 13:40:44.355167 1136266 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0603 13:40:44.355225 1136266 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0603 13:40:44.369092 1136266 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0603 13:40:44.383371 1136266 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0603 13:40:44.397873 1136266 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0603 13:40:44.411166 1136266 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0603 13:40:44.424159 1136266 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0603 13:40:44.424217 1136266 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0603 13:40:44.438120 1136266 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0603 13:40:44.448972 1136266 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0603 13:40:44.597085 1136266 ssh_runner.go:195] Run: sudo systemctl restart crio
I0603 13:40:44.793895 1136266 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0603 13:40:44.793976 1136266 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0603 13:40:44.803325 1136266 start.go:562] Will wait 60s for crictl version
I0603 13:40:44.803372 1136266 ssh_runner.go:195] Run: which crictl
I0603 13:40:44.809573 1136266 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0603 13:40:44.860879 1136266 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0603 13:40:44.860969 1136266 ssh_runner.go:195] Run: crio --version
I0603 13:40:44.899271 1136266 ssh_runner.go:195] Run: crio --version
I0603 13:40:44.937696 1136266 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0603 13:40:44.938872 1136266 main.go:141] libmachine: (old-k8s-version-151788) Calling .GetIP
I0603 13:40:44.942241 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:44.942614 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:56:4e:c1", ip: ""} in network mk-old-k8s-version-151788: {Iface:virbr2 ExpiryTime:2024-06-03 14:40:31 +0000 UTC Type:0 Mac:52:54:00:56:4e:c1 Iaid: IPaddr:192.168.50.65 Prefix:24 Hostname:old-k8s-version-151788 Clientid:01:52:54:00:56:4e:c1}
I0603 13:40:44.942653 1136266 main.go:141] libmachine: (old-k8s-version-151788) DBG | domain old-k8s-version-151788 has defined IP address 192.168.50.65 and MAC address 52:54:00:56:4e:c1 in network mk-old-k8s-version-151788
I0603 13:40:44.942879 1136266 ssh_runner.go:195] Run: grep 192.168.50.1 host.minikube.internal$ /etc/hosts
I0603 13:40:44.948965 1136266 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.50.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0603 13:40:44.965845 1136266 kubeadm.go:877] updating cluster {Name:old-k8s-version-151788 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18934/minikube-v1.33.1-1716398070-18934-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1716228441-18934@sha256:628b3f20803bc9c4302fd048087dd36cf2ff5dc9ab0ded395ec3288e2f1d0862 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-151788 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.65 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mo
untPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0603 13:40:44.965992 1136266 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0603 13:40:44.966055 1136266 ssh_runner.go:195] Run: sudo crictl images --output json
I0603 13:40:45.009241 1136266 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0603 13:40:45.009453 1136266 ssh_runner.go:195] Run: which lz4
I0603 13:40:45.015238 1136266 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0603 13:40:45.021221 1136266 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0603 13:40:45.021254 1136266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19011-1078924/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0603 13:40:47.345415 1136266 crio.go:462] duration metric: took 2.330199977s to copy over tarball
I0603 13:40:47.345606 1136266 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0603 13:40:50.617534 1136266 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.271873316s)
I0603 13:40:50.617584 1136266 crio.go:469] duration metric: took 3.272121434s to extract the tarball
I0603 13:40:50.617595 1136266 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0603 13:40:50.663999 1136266 ssh_runner.go:195] Run: sudo crictl images --output json
I0603 13:40:50.769141 1136266 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0603 13:40:50.769176 1136266 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0603 13:40:50.769253 1136266 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0603 13:40:50.769257 1136266 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0603 13:40:50.769279 1136266 image.go:134] retrieving image: registry.k8s.io/pause:3.2
I0603 13:40:50.769295 1136266 image.go:134] retrieving image: registry.k8s.io/coredns:1.7.0
I0603 13:40:50.769328 1136266 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0603 13:40:50.769326 1136266 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0603 13:40:50.769337 1136266 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0603 13:40:50.769381 1136266 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0603 13:40:50.771015 1136266 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0603 13:40:50.771031 1136266 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0603 13:40:50.771035 1136266 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0603 13:40:50.771050 1136266 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0603 13:40:50.771019 1136266 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0603 13:40:50.771019 1136266 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0603 13:40:50.771174 1136266 image.go:177] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0603 13:40:50.771238 1136266 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0603 13:40:50.940558 1136266 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0603 13:40:50.963427 1136266 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0603 13:40:50.964630 1136266 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0603 13:40:50.973065 1136266 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0603 13:40:50.980542 1136266 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0603 13:40:50.984322 1136266 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0603 13:40:51.001861 1136266 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0603 13:40:51.007413 1136266 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0603 13:40:51.007492 1136266 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0603 13:40:51.007544 1136266 ssh_runner.go:195] Run: which crictl
I0603 13:40:51.022054 1136266 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0603 13:40:51.148559 1136266 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0603 13:40:51.148610 1136266 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0603 13:40:51.148634 1136266 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0603 13:40:51.148658 1136266 ssh_runner.go:195] Run: which crictl
I0603 13:40:51.148660 1136266 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0603 13:40:51.148688 1136266 ssh_runner.go:195] Run: which crictl
I0603 13:40:51.238597 1136266 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0603 13:40:51.238909 1136266 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0603 13:40:51.238972 1136266 ssh_runner.go:195] Run: which crictl
I0603 13:40:51.239103 1136266 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0603 13:40:51.239130 1136266 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0603 13:40:51.239158 1136266 ssh_runner.go:195] Run: which crictl
I0603 13:40:51.239243 1136266 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0603 13:40:51.239266 1136266 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0603 13:40:51.239292 1136266 ssh_runner.go:195] Run: which crictl
I0603 13:40:51.239363 1136266 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0603 13:40:51.239439 1136266 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0603 13:40:51.239474 1136266 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0603 13:40:51.239500 1136266 ssh_runner.go:195] Run: which crictl
I0603 13:40:51.239573 1136266 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0603 13:40:51.239638 1136266 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0603 13:40:51.338811 1136266 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/19011-1078924/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0603 13:40:51.338865 1136266 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/19011-1078924/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0603 13:40:51.338957 1136266 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0603 13:40:51.339007 1136266 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0603 13:40:51.339017 1136266 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0603 13:40:51.339181 1136266 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0603 13:40:51.339249 1136266 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/19011-1078924/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0603 13:40:51.443841 1136266 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/19011-1078924/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0603 13:40:51.443910 1136266 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/19011-1078924/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0603 13:40:51.443995 1136266 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/19011-1078924/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0603 13:40:51.444016 1136266 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/19011-1078924/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0603 13:40:51.444043 1136266 cache_images.go:92] duration metric: took 674.85194ms to LoadCachedImages
W0603 13:40:51.444118 1136266 out.go:239] X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/19011-1078924/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0: no such file or directory
X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/19011-1078924/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0: no such file or directory
I0603 13:40:51.444131 1136266 kubeadm.go:928] updating node { 192.168.50.65 8443 v1.20.0 crio true true} ...
I0603 13:40:51.444269 1136266 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-151788 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.50.65
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-151788 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0603 13:40:51.444344 1136266 ssh_runner.go:195] Run: crio config
I0603 13:40:51.513067 1136266 cni.go:84] Creating CNI manager for ""
I0603 13:40:51.513094 1136266 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0603 13:40:51.513107 1136266 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0603 13:40:51.513127 1136266 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.50.65 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-151788 NodeName:old-k8s-version-151788 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.50.65"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.50.65 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Stati
cPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0603 13:40:51.513271 1136266 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.50.65
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-151788"
kubeletExtraArgs:
node-ip: 192.168.50.65
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.50.65"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0603 13:40:51.513329 1136266 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0603 13:40:51.525014 1136266 binaries.go:44] Found k8s binaries, skipping transfer
I0603 13:40:51.525091 1136266 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0603 13:40:51.536145 1136266 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (429 bytes)
I0603 13:40:51.554038 1136266 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0603 13:40:51.573474 1136266 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2120 bytes)
I0603 13:40:51.596190 1136266 ssh_runner.go:195] Run: grep 192.168.50.65 control-plane.minikube.internal$ /etc/hosts
I0603 13:40:51.602027 1136266 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.50.65 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0603 13:40:51.615089 1136266 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0603 13:40:51.756470 1136266 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0603 13:40:51.778801 1136266 certs.go:68] Setting up /home/jenkins/minikube-integration/19011-1078924/.minikube/profiles/old-k8s-version-151788 for IP: 192.168.50.65
I0603 13:40:51.778825 1136266 certs.go:194] generating shared ca certs ...
I0603 13:40:51.778846 1136266 certs.go:226] acquiring lock for ca certs: {Name:mkeec5aabce7c9540fcb31b78e4f96c2851d54f9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0603 13:40:51.779019 1136266 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19011-1078924/.minikube/ca.key
I0603 13:40:51.779072 1136266 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19011-1078924/.minikube/proxy-client-ca.key
I0603 13:40:51.779082 1136266 certs.go:256] generating profile certs ...
I0603 13:40:51.779154 1136266 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19011-1078924/.minikube/profiles/old-k8s-version-151788/client.key
I0603 13:40:51.779180 1136266 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19011-1078924/.minikube/profiles/old-k8s-version-151788/client.crt with IP's: []
I0603 13:40:51.989871 1136266 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19011-1078924/.minikube/profiles/old-k8s-version-151788/client.crt ...
I0603 13:40:51.989972 1136266 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19011-1078924/.minikube/profiles/old-k8s-version-151788/client.crt: {Name:mka0f2e1a916b15fe3ccb18f3ba6c6e86f03e8cf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0603 13:40:51.990179 1136266 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19011-1078924/.minikube/profiles/old-k8s-version-151788/client.key ...
I0603 13:40:51.990201 1136266 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19011-1078924/.minikube/profiles/old-k8s-version-151788/client.key: {Name:mk32ef6a7e8deaff614e0f73382e7284354b83be Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0603 13:40:51.990357 1136266 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19011-1078924/.minikube/profiles/old-k8s-version-151788/apiserver.key.9bfe4cc3
I0603 13:40:51.990386 1136266 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19011-1078924/.minikube/profiles/old-k8s-version-151788/apiserver.crt.9bfe4cc3 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.50.65]
I0603 13:40:52.141196 1136266 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19011-1078924/.minikube/profiles/old-k8s-version-151788/apiserver.crt.9bfe4cc3 ...
I0603 13:40:52.141228 1136266 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19011-1078924/.minikube/profiles/old-k8s-version-151788/apiserver.crt.9bfe4cc3: {Name:mk22accb0317bd54f785855274a07060e595c6ca Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0603 13:40:52.151573 1136266 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19011-1078924/.minikube/profiles/old-k8s-version-151788/apiserver.key.9bfe4cc3 ...
I0603 13:40:52.151613 1136266 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19011-1078924/.minikube/profiles/old-k8s-version-151788/apiserver.key.9bfe4cc3: {Name:mk4c9087cd22337fdc13dff8c3b4abb2dfb97b8b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0603 13:40:52.151768 1136266 certs.go:381] copying /home/jenkins/minikube-integration/19011-1078924/.minikube/profiles/old-k8s-version-151788/apiserver.crt.9bfe4cc3 -> /home/jenkins/minikube-integration/19011-1078924/.minikube/profiles/old-k8s-version-151788/apiserver.crt
I0603 13:40:52.151861 1136266 certs.go:385] copying /home/jenkins/minikube-integration/19011-1078924/.minikube/profiles/old-k8s-version-151788/apiserver.key.9bfe4cc3 -> /home/jenkins/minikube-integration/19011-1078924/.minikube/profiles/old-k8s-version-151788/apiserver.key
I0603 13:40:52.151933 1136266 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19011-1078924/.minikube/profiles/old-k8s-version-151788/proxy-client.key
I0603 13:40:52.151956 1136266 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19011-1078924/.minikube/profiles/old-k8s-version-151788/proxy-client.crt with IP's: []
I0603 13:40:52.409096 1136266 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19011-1078924/.minikube/profiles/old-k8s-version-151788/proxy-client.crt ...
I0603 13:40:52.409134 1136266 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19011-1078924/.minikube/profiles/old-k8s-version-151788/proxy-client.crt: {Name:mkcddbd32202e8c262b539accd1e8ac137b95aab Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0603 13:40:52.409317 1136266 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19011-1078924/.minikube/profiles/old-k8s-version-151788/proxy-client.key ...
I0603 13:40:52.409336 1136266 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19011-1078924/.minikube/profiles/old-k8s-version-151788/proxy-client.key: {Name:mk5a7f4487a49c16c160c28d9c2d1b4e77c4af4f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0603 13:40:52.409572 1136266 certs.go:484] found cert: /home/jenkins/minikube-integration/19011-1078924/.minikube/certs/1086251.pem (1338 bytes)
W0603 13:40:52.409627 1136266 certs.go:480] ignoring /home/jenkins/minikube-integration/19011-1078924/.minikube/certs/1086251_empty.pem, impossibly tiny 0 bytes
I0603 13:40:52.409639 1136266 certs.go:484] found cert: /home/jenkins/minikube-integration/19011-1078924/.minikube/certs/ca-key.pem (1679 bytes)
I0603 13:40:52.409672 1136266 certs.go:484] found cert: /home/jenkins/minikube-integration/19011-1078924/.minikube/certs/ca.pem (1078 bytes)
I0603 13:40:52.409704 1136266 certs.go:484] found cert: /home/jenkins/minikube-integration/19011-1078924/.minikube/certs/cert.pem (1123 bytes)
I0603 13:40:52.409735 1136266 certs.go:484] found cert: /home/jenkins/minikube-integration/19011-1078924/.minikube/certs/key.pem (1675 bytes)
I0603 13:40:52.409792 1136266 certs.go:484] found cert: /home/jenkins/minikube-integration/19011-1078924/.minikube/files/etc/ssl/certs/10862512.pem (1708 bytes)
I0603 13:40:52.410446 1136266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19011-1078924/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0603 13:40:52.442650 1136266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19011-1078924/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0603 13:40:52.482353 1136266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19011-1078924/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0603 13:40:52.520067 1136266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19011-1078924/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0603 13:40:52.561582 1136266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19011-1078924/.minikube/profiles/old-k8s-version-151788/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0603 13:40:52.607571 1136266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19011-1078924/.minikube/profiles/old-k8s-version-151788/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0603 13:40:52.650119 1136266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19011-1078924/.minikube/profiles/old-k8s-version-151788/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0603 13:40:52.685380 1136266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19011-1078924/.minikube/profiles/old-k8s-version-151788/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0603 13:40:52.722136 1136266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19011-1078924/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0603 13:40:52.752982 1136266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19011-1078924/.minikube/certs/1086251.pem --> /usr/share/ca-certificates/1086251.pem (1338 bytes)
I0603 13:40:52.793028 1136266 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19011-1078924/.minikube/files/etc/ssl/certs/10862512.pem --> /usr/share/ca-certificates/10862512.pem (1708 bytes)
I0603 13:40:52.833978 1136266 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0603 13:40:52.876008 1136266 ssh_runner.go:195] Run: openssl version
I0603 13:40:52.886873 1136266 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/10862512.pem && ln -fs /usr/share/ca-certificates/10862512.pem /etc/ssl/certs/10862512.pem"
I0603 13:40:52.924787 1136266 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/10862512.pem
I0603 13:40:52.931410 1136266 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jun 3 12:37 /usr/share/ca-certificates/10862512.pem
I0603 13:40:52.931481 1136266 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/10862512.pem
I0603 13:40:52.938409 1136266 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/10862512.pem /etc/ssl/certs/3ec20f2e.0"
I0603 13:40:52.963085 1136266 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0603 13:40:52.977535 1136266 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0603 13:40:52.982820 1136266 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jun 3 12:24 /usr/share/ca-certificates/minikubeCA.pem
I0603 13:40:52.982879 1136266 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0603 13:40:52.991731 1136266 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0603 13:40:53.018045 1136266 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1086251.pem && ln -fs /usr/share/ca-certificates/1086251.pem /etc/ssl/certs/1086251.pem"
I0603 13:40:53.032689 1136266 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1086251.pem
I0603 13:40:53.038595 1136266 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jun 3 12:37 /usr/share/ca-certificates/1086251.pem
I0603 13:40:53.038663 1136266 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1086251.pem
I0603 13:40:53.045063 1136266 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1086251.pem /etc/ssl/certs/51391683.0"
I0603 13:40:53.058149 1136266 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0603 13:40:53.063904 1136266 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0603 13:40:53.063957 1136266 kubeadm.go:391] StartCluster: {Name:old-k8s-version-151788 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18934/minikube-v1.33.1-1716398070-18934-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1716228441-18934@sha256:628b3f20803bc9c4302fd048087dd36cf2ff5dc9ab0ded395ec3288e2f1d0862 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-151788 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.65 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0603 13:40:53.064026 1136266 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0603 13:40:53.064070 1136266 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0603 13:40:53.109957 1136266 cri.go:89] found id: ""
I0603 13:40:53.110029 1136266 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0603 13:40:53.121300 1136266 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0603 13:40:53.131836 1136266 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0603 13:40:53.142085 1136266 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0603 13:40:53.142108 1136266 kubeadm.go:156] found existing configuration files:
I0603 13:40:53.142150 1136266 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0603 13:40:53.152469 1136266 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0603 13:40:53.152534 1136266 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0603 13:40:53.162851 1136266 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0603 13:40:53.172833 1136266 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0603 13:40:53.172887 1136266 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0603 13:40:53.182724 1136266 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0603 13:40:53.192695 1136266 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0603 13:40:53.192756 1136266 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0603 13:40:53.207332 1136266 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0603 13:40:53.217336 1136266 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0603 13:40:53.217401 1136266 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0603 13:40:53.230485 1136266 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0603 13:40:53.358562 1136266 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0603 13:40:53.358640 1136266 kubeadm.go:309] [preflight] Running pre-flight checks
I0603 13:40:53.531356 1136266 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0603 13:40:53.531523 1136266 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0603 13:40:53.531660 1136266 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0603 13:40:53.777284 1136266 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0603 13:40:53.780496 1136266 out.go:204] - Generating certificates and keys ...
I0603 13:40:53.780620 1136266 kubeadm.go:309] [certs] Using existing ca certificate authority
I0603 13:40:53.780713 1136266 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0603 13:40:53.976281 1136266 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key
I0603 13:40:54.211410 1136266 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key
I0603 13:40:54.318760 1136266 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key
I0603 13:40:54.562832 1136266 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key
I0603 13:40:54.657953 1136266 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key
I0603 13:40:54.658196 1136266 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-151788] and IPs [192.168.50.65 127.0.0.1 ::1]
I0603 13:40:54.747092 1136266 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key
I0603 13:40:54.747342 1136266 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-151788] and IPs [192.168.50.65 127.0.0.1 ::1]
I0603 13:40:54.864446 1136266 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key
I0603 13:40:55.064739 1136266 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key
I0603 13:40:55.231890 1136266 kubeadm.go:309] [certs] Generating "sa" key and public key
I0603 13:40:55.232232 1136266 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0603 13:40:55.530283 1136266 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0603 13:40:55.824759 1136266 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0603 13:40:56.038771 1136266 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0603 13:40:56.258826 1136266 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0603 13:40:56.282248 1136266 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0603 13:40:56.283794 1136266 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0603 13:40:56.283876 1136266 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0603 13:40:56.449828 1136266 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0603 13:40:56.451290 1136266 out.go:204] - Booting up control plane ...
I0603 13:40:56.451433 1136266 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0603 13:40:56.462567 1136266 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0603 13:40:56.463731 1136266 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0603 13:40:56.464642 1136266 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0603 13:40:56.468990 1136266 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0603 13:41:36.468361 1136266 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0603 13:41:36.468640 1136266 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0603 13:41:36.468934 1136266 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0603 13:41:41.469442 1136266 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0603 13:41:41.472298 1136266 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0603 13:41:51.471399 1136266 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0603 13:41:51.472239 1136266 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0603 13:42:11.473559 1136266 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0603 13:42:11.473750 1136266 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0603 13:42:51.473475 1136266 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0603 13:42:51.473766 1136266 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0603 13:42:51.473790 1136266 kubeadm.go:309]
I0603 13:42:51.473841 1136266 kubeadm.go:309] Unfortunately, an error has occurred:
I0603 13:42:51.473917 1136266 kubeadm.go:309] timed out waiting for the condition
I0603 13:42:51.473938 1136266 kubeadm.go:309]
I0603 13:42:51.473980 1136266 kubeadm.go:309] This error is likely caused by:
I0603 13:42:51.474031 1136266 kubeadm.go:309] - The kubelet is not running
I0603 13:42:51.474168 1136266 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0603 13:42:51.474179 1136266 kubeadm.go:309]
I0603 13:42:51.474352 1136266 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0603 13:42:51.474407 1136266 kubeadm.go:309] - 'systemctl status kubelet'
I0603 13:42:51.474454 1136266 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0603 13:42:51.474463 1136266 kubeadm.go:309]
I0603 13:42:51.474602 1136266 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0603 13:42:51.474727 1136266 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0603 13:42:51.474737 1136266 kubeadm.go:309]
I0603 13:42:51.474875 1136266 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0603 13:42:51.474999 1136266 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0603 13:42:51.475105 1136266 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0603 13:42:51.475204 1136266 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0603 13:42:51.475217 1136266 kubeadm.go:309]
I0603 13:42:51.475413 1136266 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0603 13:42:51.475558 1136266 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0603 13:42:51.475671 1136266 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
W0603 13:42:51.475816 1136266 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-151788] and IPs [192.168.50.65 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-151788] and IPs [192.168.50.65 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-151788] and IPs [192.168.50.65 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-151788] and IPs [192.168.50.65 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0603 13:42:51.475871 1136266 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0603 13:42:52.543859 1136266 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (1.067955171s)
I0603 13:42:52.543959 1136266 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0603 13:42:52.559213 1136266 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0603 13:42:52.569294 1136266 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0603 13:42:52.569317 1136266 kubeadm.go:156] found existing configuration files:
I0603 13:42:52.569369 1136266 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0603 13:42:52.579202 1136266 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0603 13:42:52.579267 1136266 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0603 13:42:52.588822 1136266 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0603 13:42:52.598381 1136266 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0603 13:42:52.598444 1136266 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0603 13:42:52.608115 1136266 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0603 13:42:52.617439 1136266 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0603 13:42:52.617498 1136266 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0603 13:42:52.627141 1136266 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0603 13:42:52.636434 1136266 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0603 13:42:52.636497 1136266 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0603 13:42:52.646152 1136266 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0603 13:42:52.721613 1136266 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0603 13:42:52.721734 1136266 kubeadm.go:309] [preflight] Running pre-flight checks
I0603 13:42:52.872635 1136266 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0603 13:42:52.872816 1136266 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0603 13:42:52.872948 1136266 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0603 13:42:53.067781 1136266 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0603 13:42:53.069709 1136266 out.go:204] - Generating certificates and keys ...
I0603 13:42:53.069824 1136266 kubeadm.go:309] [certs] Using existing ca certificate authority
I0603 13:42:53.069919 1136266 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0603 13:42:53.070032 1136266 kubeadm.go:309] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0603 13:42:53.070118 1136266 kubeadm.go:309] [certs] Using existing front-proxy-ca certificate authority
I0603 13:42:53.070227 1136266 kubeadm.go:309] [certs] Using existing front-proxy-client certificate and key on disk
I0603 13:42:53.070304 1136266 kubeadm.go:309] [certs] Using existing etcd/ca certificate authority
I0603 13:42:53.070393 1136266 kubeadm.go:309] [certs] Using existing etcd/server certificate and key on disk
I0603 13:42:53.070481 1136266 kubeadm.go:309] [certs] Using existing etcd/peer certificate and key on disk
I0603 13:42:53.070640 1136266 kubeadm.go:309] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0603 13:42:53.070726 1136266 kubeadm.go:309] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0603 13:42:53.070766 1136266 kubeadm.go:309] [certs] Using the existing "sa" key
I0603 13:42:53.070898 1136266 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0603 13:42:53.172465 1136266 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0603 13:42:53.297707 1136266 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0603 13:42:53.502245 1136266 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0603 13:42:53.735761 1136266 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0603 13:42:53.751657 1136266 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0603 13:42:53.754465 1136266 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0603 13:42:53.754693 1136266 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0603 13:42:53.887103 1136266 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0603 13:42:53.888899 1136266 out.go:204] - Booting up control plane ...
I0603 13:42:53.889026 1136266 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0603 13:42:53.891599 1136266 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0603 13:42:53.892959 1136266 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0603 13:42:53.894104 1136266 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0603 13:42:53.898347 1136266 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0603 13:43:33.900738 1136266 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0603 13:43:33.900821 1136266 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0603 13:43:33.901097 1136266 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0603 13:43:38.901110 1136266 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0603 13:43:38.901360 1136266 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0603 13:43:48.901962 1136266 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0603 13:43:48.902220 1136266 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0603 13:44:08.903346 1136266 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0603 13:44:08.903618 1136266 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0603 13:44:48.903069 1136266 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0603 13:44:48.903330 1136266 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0603 13:44:48.903357 1136266 kubeadm.go:309]
I0603 13:44:48.903394 1136266 kubeadm.go:309] Unfortunately, an error has occurred:
I0603 13:44:48.903426 1136266 kubeadm.go:309] timed out waiting for the condition
I0603 13:44:48.903432 1136266 kubeadm.go:309]
I0603 13:44:48.903503 1136266 kubeadm.go:309] This error is likely caused by:
I0603 13:44:48.903571 1136266 kubeadm.go:309] - The kubelet is not running
I0603 13:44:48.903726 1136266 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0603 13:44:48.903737 1136266 kubeadm.go:309]
I0603 13:44:48.903873 1136266 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0603 13:44:48.903927 1136266 kubeadm.go:309] - 'systemctl status kubelet'
I0603 13:44:48.903967 1136266 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0603 13:44:48.903977 1136266 kubeadm.go:309]
I0603 13:44:48.904104 1136266 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0603 13:44:48.904175 1136266 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0603 13:44:48.904179 1136266 kubeadm.go:309]
I0603 13:44:48.904285 1136266 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0603 13:44:48.904388 1136266 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0603 13:44:48.904497 1136266 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0603 13:44:48.904602 1136266 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0603 13:44:48.904614 1136266 kubeadm.go:309]
I0603 13:44:48.905496 1136266 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0603 13:44:48.905667 1136266 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0603 13:44:48.905770 1136266 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
I0603 13:44:48.905863 1136266 kubeadm.go:393] duration metric: took 3m55.841910919s to StartCluster
I0603 13:44:48.905946 1136266 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0603 13:44:48.906016 1136266 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0603 13:44:48.955444 1136266 cri.go:89] found id: ""
I0603 13:44:48.955475 1136266 logs.go:276] 0 containers: []
W0603 13:44:48.955487 1136266 logs.go:278] No container was found matching "kube-apiserver"
I0603 13:44:48.955496 1136266 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0603 13:44:48.955564 1136266 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0603 13:44:48.998120 1136266 cri.go:89] found id: ""
I0603 13:44:48.998153 1136266 logs.go:276] 0 containers: []
W0603 13:44:48.998162 1136266 logs.go:278] No container was found matching "etcd"
I0603 13:44:48.998168 1136266 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0603 13:44:48.998230 1136266 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0603 13:44:49.034437 1136266 cri.go:89] found id: ""
I0603 13:44:49.034473 1136266 logs.go:276] 0 containers: []
W0603 13:44:49.034482 1136266 logs.go:278] No container was found matching "coredns"
I0603 13:44:49.034491 1136266 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0603 13:44:49.034558 1136266 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0603 13:44:49.069020 1136266 cri.go:89] found id: ""
I0603 13:44:49.069049 1136266 logs.go:276] 0 containers: []
W0603 13:44:49.069058 1136266 logs.go:278] No container was found matching "kube-scheduler"
I0603 13:44:49.069065 1136266 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0603 13:44:49.069129 1136266 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0603 13:44:49.102910 1136266 cri.go:89] found id: ""
I0603 13:44:49.102939 1136266 logs.go:276] 0 containers: []
W0603 13:44:49.102948 1136266 logs.go:278] No container was found matching "kube-proxy"
I0603 13:44:49.102954 1136266 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0603 13:44:49.103013 1136266 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0603 13:44:49.150530 1136266 cri.go:89] found id: ""
I0603 13:44:49.150563 1136266 logs.go:276] 0 containers: []
W0603 13:44:49.150572 1136266 logs.go:278] No container was found matching "kube-controller-manager"
I0603 13:44:49.150578 1136266 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0603 13:44:49.150646 1136266 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0603 13:44:49.192479 1136266 cri.go:89] found id: ""
I0603 13:44:49.192520 1136266 logs.go:276] 0 containers: []
W0603 13:44:49.192528 1136266 logs.go:278] No container was found matching "kindnet"
I0603 13:44:49.192538 1136266 logs.go:123] Gathering logs for container status ...
I0603 13:44:49.192553 1136266 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0603 13:44:49.257060 1136266 logs.go:123] Gathering logs for kubelet ...
I0603 13:44:49.257092 1136266 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0603 13:44:49.304728 1136266 logs.go:123] Gathering logs for dmesg ...
I0603 13:44:49.304768 1136266 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0603 13:44:49.319492 1136266 logs.go:123] Gathering logs for describe nodes ...
I0603 13:44:49.319528 1136266 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0603 13:44:49.451752 1136266 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0603 13:44:49.451778 1136266 logs.go:123] Gathering logs for CRI-O ...
I0603 13:44:49.451794 1136266 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
W0603 13:44:49.546259 1136266 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0603 13:44:49.546313 1136266 out.go:239] *
*
W0603 13:44:49.546392 1136266 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0603 13:44:49.546418 1136266 out.go:239] *
*
W0603 13:44:49.547513 1136266 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0603 13:44:49.551493 1136266 out.go:177]
W0603 13:44:49.552927 1136266 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0603 13:44:49.552972 1136266 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0603 13:44:49.552997 1136266 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0603 13:44:49.554476 1136266 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-151788 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-151788 -n old-k8s-version-151788
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-151788 -n old-k8s-version-151788: exit status 6 (239.194929ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0603 13:44:49.844460 1142745 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-151788" does not appear in /home/jenkins/minikube-integration/19011-1078924/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-151788" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (284.27s)