=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:184: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-613355 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:184: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-613355 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (5m0.341103488s)
-- stdout --
* [old-k8s-version-613355] minikube v1.34.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=20090
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/20090-12353/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/20090-12353/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-613355" primary control-plane node in "old-k8s-version-613355" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I1213 20:13:50.645726 69781 out.go:345] Setting OutFile to fd 1 ...
I1213 20:13:50.646075 69781 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1213 20:13:50.646093 69781 out.go:358] Setting ErrFile to fd 2...
I1213 20:13:50.646101 69781 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1213 20:13:50.646520 69781 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20090-12353/.minikube/bin
I1213 20:13:50.647404 69781 out.go:352] Setting JSON to false
I1213 20:13:50.648412 69781 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":6974,"bootTime":1734113857,"procs":299,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1071-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I1213 20:13:50.648510 69781 start.go:139] virtualization: kvm guest
I1213 20:13:50.650178 69781 out.go:177] * [old-k8s-version-613355] minikube v1.34.0 on Ubuntu 20.04 (kvm/amd64)
I1213 20:13:50.651331 69781 notify.go:220] Checking for updates...
I1213 20:13:50.651336 69781 out.go:177] - MINIKUBE_LOCATION=20090
I1213 20:13:50.652521 69781 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1213 20:13:50.653493 69781 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/20090-12353/kubeconfig
I1213 20:13:50.654528 69781 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/20090-12353/.minikube
I1213 20:13:50.655566 69781 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I1213 20:13:50.656504 69781 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I1213 20:13:50.657840 69781 config.go:182] Loaded profile config "bridge-918860": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.2
I1213 20:13:50.657938 69781 config.go:182] Loaded profile config "enable-default-cni-918860": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.2
I1213 20:13:50.658013 69781 config.go:182] Loaded profile config "flannel-918860": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.2
I1213 20:13:50.658083 69781 driver.go:394] Setting default libvirt URI to qemu:///system
I1213 20:13:50.693750 69781 out.go:177] * Using the kvm2 driver based on user configuration
I1213 20:13:50.694957 69781 start.go:297] selected driver: kvm2
I1213 20:13:50.694972 69781 start.go:901] validating driver "kvm2" against <nil>
I1213 20:13:50.694982 69781 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1213 20:13:50.695627 69781 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1213 20:13:50.695702 69781 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/20090-12353/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I1213 20:13:50.710430 69781 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.34.0
I1213 20:13:50.710502 69781 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I1213 20:13:50.710742 69781 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1213 20:13:50.710771 69781 cni.go:84] Creating CNI manager for ""
I1213 20:13:50.710813 69781 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I1213 20:13:50.710821 69781 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I1213 20:13:50.710901 69781 start.go:340] cluster config:
{Name:old-k8s-version-613355 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1734029593-20090@sha256:7b3f6168a578563fb342f21f0c926652b91ba060931e8fbc6c6ade3ac1d26ed9 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-613355 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1213 20:13:50.710997 69781 iso.go:125] acquiring lock: {Name:mkd84f6661a5214d8c2d3a40ad448351a88bfd1b Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1213 20:13:50.712556 69781 out.go:177] * Starting "old-k8s-version-613355" primary control-plane node in "old-k8s-version-613355" cluster
I1213 20:13:50.713572 69781 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I1213 20:13:50.713608 69781 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20090-12353/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I1213 20:13:50.713616 69781 cache.go:56] Caching tarball of preloaded images
I1213 20:13:50.713706 69781 preload.go:172] Found /home/jenkins/minikube-integration/20090-12353/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I1213 20:13:50.713719 69781 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I1213 20:13:50.713802 69781 profile.go:143] Saving config to /home/jenkins/minikube-integration/20090-12353/.minikube/profiles/old-k8s-version-613355/config.json ...
I1213 20:13:50.713818 69781 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20090-12353/.minikube/profiles/old-k8s-version-613355/config.json: {Name:mk8fac007a5a42ed0ca41d6a4b1848eefc6dc864 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1213 20:13:50.713965 69781 start.go:360] acquireMachinesLock for old-k8s-version-613355: {Name:mkc278ae0927dbec7538ca4f7c13001e5f3abc49 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I1213 20:14:20.307479 69781 start.go:364] duration metric: took 29.593491992s to acquireMachinesLock for "old-k8s-version-613355"
I1213 20:14:20.307553 69781 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-613355 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/20090/minikube-v1.34.0-1734029574-20090-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1734029593-20090@sha256:7b3f6168a578563fb342f21f0c926652b91ba060931e8fbc6c6ade3ac1d26ed9 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-613355 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I1213 20:14:20.307675 69781 start.go:125] createHost starting for "" (driver="kvm2")
I1213 20:14:20.309167 69781 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I1213 20:14:20.309367 69781 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I1213 20:14:20.309423 69781 main.go:141] libmachine: Launching plugin server for driver kvm2
I1213 20:14:20.326388 69781 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43187
I1213 20:14:20.326935 69781 main.go:141] libmachine: () Calling .GetVersion
I1213 20:14:20.327629 69781 main.go:141] libmachine: Using API Version 1
I1213 20:14:20.327655 69781 main.go:141] libmachine: () Calling .SetConfigRaw
I1213 20:14:20.328008 69781 main.go:141] libmachine: () Calling .GetMachineName
I1213 20:14:20.328219 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetMachineName
I1213 20:14:20.328373 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .DriverName
I1213 20:14:20.328552 69781 start.go:159] libmachine.API.Create for "old-k8s-version-613355" (driver="kvm2")
I1213 20:14:20.328583 69781 client.go:168] LocalClient.Create starting
I1213 20:14:20.328616 69781 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20090-12353/.minikube/certs/ca.pem
I1213 20:14:20.328650 69781 main.go:141] libmachine: Decoding PEM data...
I1213 20:14:20.328668 69781 main.go:141] libmachine: Parsing certificate...
I1213 20:14:20.328727 69781 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20090-12353/.minikube/certs/cert.pem
I1213 20:14:20.328751 69781 main.go:141] libmachine: Decoding PEM data...
I1213 20:14:20.328767 69781 main.go:141] libmachine: Parsing certificate...
I1213 20:14:20.328789 69781 main.go:141] libmachine: Running pre-create checks...
I1213 20:14:20.328801 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .PreCreateCheck
I1213 20:14:20.329230 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetConfigRaw
I1213 20:14:20.329663 69781 main.go:141] libmachine: Creating machine...
I1213 20:14:20.329680 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .Create
I1213 20:14:20.329809 69781 main.go:141] libmachine: (old-k8s-version-613355) creating KVM machine...
I1213 20:14:20.329828 69781 main.go:141] libmachine: (old-k8s-version-613355) creating network...
I1213 20:14:20.331092 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | found existing default KVM network
I1213 20:14:20.332643 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | I1213 20:14:20.332488 70243 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:40:32:bb} reservation:<nil>}
I1213 20:14:20.333553 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | I1213 20:14:20.333461 70243 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:0c:69:ea} reservation:<nil>}
I1213 20:14:20.334409 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | I1213 20:14:20.334311 70243 network.go:211] skipping subnet 192.168.61.0/24 that is taken: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName:virbr4 IfaceIPv4:192.168.61.1 IfaceMTU:1500 IfaceMAC:52:54:00:d5:ad:f8} reservation:<nil>}
I1213 20:14:20.335419 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | I1213 20:14:20.335355 70243 network.go:206] using free private subnet 192.168.72.0/24: &{IP:192.168.72.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.72.0/24 Gateway:192.168.72.1 ClientMin:192.168.72.2 ClientMax:192.168.72.254 Broadcast:192.168.72.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00033f770}
I1213 20:14:20.335484 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | created network xml:
I1213 20:14:20.335508 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | <network>
I1213 20:14:20.335544 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | <name>mk-old-k8s-version-613355</name>
I1213 20:14:20.335565 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | <dns enable='no'/>
I1213 20:14:20.335572 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG |
I1213 20:14:20.335582 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | <ip address='192.168.72.1' netmask='255.255.255.0'>
I1213 20:14:20.335588 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | <dhcp>
I1213 20:14:20.335599 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | <range start='192.168.72.2' end='192.168.72.253'/>
I1213 20:14:20.335612 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | </dhcp>
I1213 20:14:20.335619 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | </ip>
I1213 20:14:20.335641 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG |
I1213 20:14:20.335653 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | </network>
I1213 20:14:20.335662 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG |
I1213 20:14:20.340606 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | trying to create private KVM network mk-old-k8s-version-613355 192.168.72.0/24...
I1213 20:14:20.410933 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | private KVM network mk-old-k8s-version-613355 192.168.72.0/24 created
I1213 20:14:20.410976 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | I1213 20:14:20.410912 70243 common.go:144] Making disk image using store path: /home/jenkins/minikube-integration/20090-12353/.minikube
I1213 20:14:20.410994 69781 main.go:141] libmachine: (old-k8s-version-613355) setting up store path in /home/jenkins/minikube-integration/20090-12353/.minikube/machines/old-k8s-version-613355 ...
I1213 20:14:20.411012 69781 main.go:141] libmachine: (old-k8s-version-613355) building disk image from file:///home/jenkins/minikube-integration/20090-12353/.minikube/cache/iso/amd64/minikube-v1.34.0-1734029574-20090-amd64.iso
I1213 20:14:20.411034 69781 main.go:141] libmachine: (old-k8s-version-613355) Downloading /home/jenkins/minikube-integration/20090-12353/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/20090-12353/.minikube/cache/iso/amd64/minikube-v1.34.0-1734029574-20090-amd64.iso...
I1213 20:14:20.661548 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | I1213 20:14:20.661431 70243 common.go:151] Creating ssh key: /home/jenkins/minikube-integration/20090-12353/.minikube/machines/old-k8s-version-613355/id_rsa...
I1213 20:14:20.733157 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | I1213 20:14:20.733039 70243 common.go:157] Creating raw disk image: /home/jenkins/minikube-integration/20090-12353/.minikube/machines/old-k8s-version-613355/old-k8s-version-613355.rawdisk...
I1213 20:14:20.733188 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | Writing magic tar header
I1213 20:14:20.733205 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | Writing SSH key tar header
I1213 20:14:20.733218 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | I1213 20:14:20.733155 70243 common.go:171] Fixing permissions on /home/jenkins/minikube-integration/20090-12353/.minikube/machines/old-k8s-version-613355 ...
I1213 20:14:20.733301 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20090-12353/.minikube/machines/old-k8s-version-613355
I1213 20:14:20.733332 69781 main.go:141] libmachine: (old-k8s-version-613355) setting executable bit set on /home/jenkins/minikube-integration/20090-12353/.minikube/machines/old-k8s-version-613355 (perms=drwx------)
I1213 20:14:20.733344 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20090-12353/.minikube/machines
I1213 20:14:20.733359 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20090-12353/.minikube
I1213 20:14:20.733370 69781 main.go:141] libmachine: (old-k8s-version-613355) setting executable bit set on /home/jenkins/minikube-integration/20090-12353/.minikube/machines (perms=drwxr-xr-x)
I1213 20:14:20.733380 69781 main.go:141] libmachine: (old-k8s-version-613355) setting executable bit set on /home/jenkins/minikube-integration/20090-12353/.minikube (perms=drwxr-xr-x)
I1213 20:14:20.733386 69781 main.go:141] libmachine: (old-k8s-version-613355) setting executable bit set on /home/jenkins/minikube-integration/20090-12353 (perms=drwxrwxr-x)
I1213 20:14:20.733410 69781 main.go:141] libmachine: (old-k8s-version-613355) setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I1213 20:14:20.733423 69781 main.go:141] libmachine: (old-k8s-version-613355) setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I1213 20:14:20.733433 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20090-12353
I1213 20:14:20.733448 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | checking permissions on dir: /home/jenkins/minikube-integration
I1213 20:14:20.733457 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | checking permissions on dir: /home/jenkins
I1213 20:14:20.733465 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | checking permissions on dir: /home
I1213 20:14:20.733470 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | skipping /home - not owner
I1213 20:14:20.733484 69781 main.go:141] libmachine: (old-k8s-version-613355) creating domain...
I1213 20:14:20.734528 69781 main.go:141] libmachine: (old-k8s-version-613355) define libvirt domain using xml:
I1213 20:14:20.734547 69781 main.go:141] libmachine: (old-k8s-version-613355) <domain type='kvm'>
I1213 20:14:20.734553 69781 main.go:141] libmachine: (old-k8s-version-613355) <name>old-k8s-version-613355</name>
I1213 20:14:20.734558 69781 main.go:141] libmachine: (old-k8s-version-613355) <memory unit='MiB'>2200</memory>
I1213 20:14:20.734563 69781 main.go:141] libmachine: (old-k8s-version-613355) <vcpu>2</vcpu>
I1213 20:14:20.734580 69781 main.go:141] libmachine: (old-k8s-version-613355) <features>
I1213 20:14:20.734586 69781 main.go:141] libmachine: (old-k8s-version-613355) <acpi/>
I1213 20:14:20.734593 69781 main.go:141] libmachine: (old-k8s-version-613355) <apic/>
I1213 20:14:20.734605 69781 main.go:141] libmachine: (old-k8s-version-613355) <pae/>
I1213 20:14:20.734613 69781 main.go:141] libmachine: (old-k8s-version-613355)
I1213 20:14:20.734622 69781 main.go:141] libmachine: (old-k8s-version-613355) </features>
I1213 20:14:20.734632 69781 main.go:141] libmachine: (old-k8s-version-613355) <cpu mode='host-passthrough'>
I1213 20:14:20.734637 69781 main.go:141] libmachine: (old-k8s-version-613355)
I1213 20:14:20.734644 69781 main.go:141] libmachine: (old-k8s-version-613355) </cpu>
I1213 20:14:20.734649 69781 main.go:141] libmachine: (old-k8s-version-613355) <os>
I1213 20:14:20.734657 69781 main.go:141] libmachine: (old-k8s-version-613355) <type>hvm</type>
I1213 20:14:20.734663 69781 main.go:141] libmachine: (old-k8s-version-613355) <boot dev='cdrom'/>
I1213 20:14:20.734672 69781 main.go:141] libmachine: (old-k8s-version-613355) <boot dev='hd'/>
I1213 20:14:20.734679 69781 main.go:141] libmachine: (old-k8s-version-613355) <bootmenu enable='no'/>
I1213 20:14:20.734694 69781 main.go:141] libmachine: (old-k8s-version-613355) </os>
I1213 20:14:20.734764 69781 main.go:141] libmachine: (old-k8s-version-613355) <devices>
I1213 20:14:20.734799 69781 main.go:141] libmachine: (old-k8s-version-613355) <disk type='file' device='cdrom'>
I1213 20:14:20.734820 69781 main.go:141] libmachine: (old-k8s-version-613355) <source file='/home/jenkins/minikube-integration/20090-12353/.minikube/machines/old-k8s-version-613355/boot2docker.iso'/>
I1213 20:14:20.734836 69781 main.go:141] libmachine: (old-k8s-version-613355) <target dev='hdc' bus='scsi'/>
I1213 20:14:20.734873 69781 main.go:141] libmachine: (old-k8s-version-613355) <readonly/>
I1213 20:14:20.734888 69781 main.go:141] libmachine: (old-k8s-version-613355) </disk>
I1213 20:14:20.734895 69781 main.go:141] libmachine: (old-k8s-version-613355) <disk type='file' device='disk'>
I1213 20:14:20.734916 69781 main.go:141] libmachine: (old-k8s-version-613355) <driver name='qemu' type='raw' cache='default' io='threads' />
I1213 20:14:20.734929 69781 main.go:141] libmachine: (old-k8s-version-613355) <source file='/home/jenkins/minikube-integration/20090-12353/.minikube/machines/old-k8s-version-613355/old-k8s-version-613355.rawdisk'/>
I1213 20:14:20.734937 69781 main.go:141] libmachine: (old-k8s-version-613355) <target dev='hda' bus='virtio'/>
I1213 20:14:20.734942 69781 main.go:141] libmachine: (old-k8s-version-613355) </disk>
I1213 20:14:20.734949 69781 main.go:141] libmachine: (old-k8s-version-613355) <interface type='network'>
I1213 20:14:20.734955 69781 main.go:141] libmachine: (old-k8s-version-613355) <source network='mk-old-k8s-version-613355'/>
I1213 20:14:20.734962 69781 main.go:141] libmachine: (old-k8s-version-613355) <model type='virtio'/>
I1213 20:14:20.734967 69781 main.go:141] libmachine: (old-k8s-version-613355) </interface>
I1213 20:14:20.734972 69781 main.go:141] libmachine: (old-k8s-version-613355) <interface type='network'>
I1213 20:14:20.734978 69781 main.go:141] libmachine: (old-k8s-version-613355) <source network='default'/>
I1213 20:14:20.734986 69781 main.go:141] libmachine: (old-k8s-version-613355) <model type='virtio'/>
I1213 20:14:20.735000 69781 main.go:141] libmachine: (old-k8s-version-613355) </interface>
I1213 20:14:20.735016 69781 main.go:141] libmachine: (old-k8s-version-613355) <serial type='pty'>
I1213 20:14:20.735029 69781 main.go:141] libmachine: (old-k8s-version-613355) <target port='0'/>
I1213 20:14:20.735040 69781 main.go:141] libmachine: (old-k8s-version-613355) </serial>
I1213 20:14:20.735058 69781 main.go:141] libmachine: (old-k8s-version-613355) <console type='pty'>
I1213 20:14:20.735066 69781 main.go:141] libmachine: (old-k8s-version-613355) <target type='serial' port='0'/>
I1213 20:14:20.735082 69781 main.go:141] libmachine: (old-k8s-version-613355) </console>
I1213 20:14:20.735098 69781 main.go:141] libmachine: (old-k8s-version-613355) <rng model='virtio'>
I1213 20:14:20.735111 69781 main.go:141] libmachine: (old-k8s-version-613355) <backend model='random'>/dev/random</backend>
I1213 20:14:20.735122 69781 main.go:141] libmachine: (old-k8s-version-613355) </rng>
I1213 20:14:20.735134 69781 main.go:141] libmachine: (old-k8s-version-613355)
I1213 20:14:20.735144 69781 main.go:141] libmachine: (old-k8s-version-613355)
I1213 20:14:20.735152 69781 main.go:141] libmachine: (old-k8s-version-613355) </devices>
I1213 20:14:20.735161 69781 main.go:141] libmachine: (old-k8s-version-613355) </domain>
I1213 20:14:20.735179 69781 main.go:141] libmachine: (old-k8s-version-613355)
I1213 20:14:20.741763 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has defined MAC address 52:54:00:99:35:cb in network default
I1213 20:14:20.742363 69781 main.go:141] libmachine: (old-k8s-version-613355) starting domain...
I1213 20:14:20.742381 69781 main.go:141] libmachine: (old-k8s-version-613355) ensuring networks are active...
I1213 20:14:20.742401 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has defined MAC address 52:54:00:d3:40:ab in network mk-old-k8s-version-613355
I1213 20:14:20.743076 69781 main.go:141] libmachine: (old-k8s-version-613355) Ensuring network default is active
I1213 20:14:20.743395 69781 main.go:141] libmachine: (old-k8s-version-613355) Ensuring network mk-old-k8s-version-613355 is active
I1213 20:14:20.743871 69781 main.go:141] libmachine: (old-k8s-version-613355) getting domain XML...
I1213 20:14:20.744631 69781 main.go:141] libmachine: (old-k8s-version-613355) creating domain...
I1213 20:14:22.163972 69781 main.go:141] libmachine: (old-k8s-version-613355) waiting for IP...
I1213 20:14:22.164888 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has defined MAC address 52:54:00:d3:40:ab in network mk-old-k8s-version-613355
I1213 20:14:22.165404 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | unable to find current IP address of domain old-k8s-version-613355 in network mk-old-k8s-version-613355
I1213 20:14:22.165442 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | I1213 20:14:22.165395 70243 retry.go:31] will retry after 301.907509ms: waiting for domain to come up
I1213 20:14:22.469268 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has defined MAC address 52:54:00:d3:40:ab in network mk-old-k8s-version-613355
I1213 20:14:22.469995 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | unable to find current IP address of domain old-k8s-version-613355 in network mk-old-k8s-version-613355
I1213 20:14:22.470038 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | I1213 20:14:22.469961 70243 retry.go:31] will retry after 304.728508ms: waiting for domain to come up
I1213 20:14:22.776624 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has defined MAC address 52:54:00:d3:40:ab in network mk-old-k8s-version-613355
I1213 20:14:22.777395 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | unable to find current IP address of domain old-k8s-version-613355 in network mk-old-k8s-version-613355
I1213 20:14:22.777426 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | I1213 20:14:22.777297 70243 retry.go:31] will retry after 414.892936ms: waiting for domain to come up
I1213 20:14:23.194065 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has defined MAC address 52:54:00:d3:40:ab in network mk-old-k8s-version-613355
I1213 20:14:23.194709 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | unable to find current IP address of domain old-k8s-version-613355 in network mk-old-k8s-version-613355
I1213 20:14:23.194748 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | I1213 20:14:23.194674 70243 retry.go:31] will retry after 554.991892ms: waiting for domain to come up
I1213 20:14:23.751706 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has defined MAC address 52:54:00:d3:40:ab in network mk-old-k8s-version-613355
I1213 20:14:23.752395 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | unable to find current IP address of domain old-k8s-version-613355 in network mk-old-k8s-version-613355
I1213 20:14:23.752423 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | I1213 20:14:23.752202 70243 retry.go:31] will retry after 646.215519ms: waiting for domain to come up
I1213 20:14:24.400116 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has defined MAC address 52:54:00:d3:40:ab in network mk-old-k8s-version-613355
I1213 20:14:24.400790 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | unable to find current IP address of domain old-k8s-version-613355 in network mk-old-k8s-version-613355
I1213 20:14:24.400816 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | I1213 20:14:24.400754 70243 retry.go:31] will retry after 708.137637ms: waiting for domain to come up
I1213 20:14:25.110260 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has defined MAC address 52:54:00:d3:40:ab in network mk-old-k8s-version-613355
I1213 20:14:25.110789 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | unable to find current IP address of domain old-k8s-version-613355 in network mk-old-k8s-version-613355
I1213 20:14:25.110821 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | I1213 20:14:25.110780 70243 retry.go:31] will retry after 770.601947ms: waiting for domain to come up
I1213 20:14:25.883075 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has defined MAC address 52:54:00:d3:40:ab in network mk-old-k8s-version-613355
I1213 20:14:25.883606 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | unable to find current IP address of domain old-k8s-version-613355 in network mk-old-k8s-version-613355
I1213 20:14:25.883639 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | I1213 20:14:25.883571 70243 retry.go:31] will retry after 1.423420425s: waiting for domain to come up
I1213 20:14:27.309078 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has defined MAC address 52:54:00:d3:40:ab in network mk-old-k8s-version-613355
I1213 20:14:27.309626 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | unable to find current IP address of domain old-k8s-version-613355 in network mk-old-k8s-version-613355
I1213 20:14:27.309656 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | I1213 20:14:27.309594 70243 retry.go:31] will retry after 1.61608164s: waiting for domain to come up
I1213 20:14:28.927970 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has defined MAC address 52:54:00:d3:40:ab in network mk-old-k8s-version-613355
I1213 20:14:28.928428 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | unable to find current IP address of domain old-k8s-version-613355 in network mk-old-k8s-version-613355
I1213 20:14:28.928452 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | I1213 20:14:28.928417 70243 retry.go:31] will retry after 1.968447499s: waiting for domain to come up
I1213 20:14:30.898890 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has defined MAC address 52:54:00:d3:40:ab in network mk-old-k8s-version-613355
I1213 20:14:30.899450 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | unable to find current IP address of domain old-k8s-version-613355 in network mk-old-k8s-version-613355
I1213 20:14:30.899507 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | I1213 20:14:30.899412 70243 retry.go:31] will retry after 2.582547448s: waiting for domain to come up
I1213 20:14:33.483811 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has defined MAC address 52:54:00:d3:40:ab in network mk-old-k8s-version-613355
I1213 20:14:33.484257 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | unable to find current IP address of domain old-k8s-version-613355 in network mk-old-k8s-version-613355
I1213 20:14:33.484294 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | I1213 20:14:33.484215 70243 retry.go:31] will retry after 3.05474133s: waiting for domain to come up
I1213 20:14:36.540718 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has defined MAC address 52:54:00:d3:40:ab in network mk-old-k8s-version-613355
I1213 20:14:36.541342 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | unable to find current IP address of domain old-k8s-version-613355 in network mk-old-k8s-version-613355
I1213 20:14:36.541375 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | I1213 20:14:36.541291 70243 retry.go:31] will retry after 3.291856231s: waiting for domain to come up
I1213 20:14:39.836294 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has defined MAC address 52:54:00:d3:40:ab in network mk-old-k8s-version-613355
I1213 20:14:39.836878 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | unable to find current IP address of domain old-k8s-version-613355 in network mk-old-k8s-version-613355
I1213 20:14:39.836908 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | I1213 20:14:39.836825 70243 retry.go:31] will retry after 5.052554521s: waiting for domain to come up
I1213 20:14:44.891650 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has defined MAC address 52:54:00:d3:40:ab in network mk-old-k8s-version-613355
I1213 20:14:44.892145 69781 main.go:141] libmachine: (old-k8s-version-613355) found domain IP: 192.168.72.134
I1213 20:14:44.892176 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has current primary IP address 192.168.72.134 and MAC address 52:54:00:d3:40:ab in network mk-old-k8s-version-613355
I1213 20:14:44.892184 69781 main.go:141] libmachine: (old-k8s-version-613355) reserving static IP address...
I1213 20:14:44.892511 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-613355", mac: "52:54:00:d3:40:ab", ip: "192.168.72.134"} in network mk-old-k8s-version-613355
I1213 20:14:44.971013 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | Getting to WaitForSSH function...
I1213 20:14:44.971043 69781 main.go:141] libmachine: (old-k8s-version-613355) reserved static IP address 192.168.72.134 for domain old-k8s-version-613355
I1213 20:14:44.971057 69781 main.go:141] libmachine: (old-k8s-version-613355) waiting for SSH...
I1213 20:14:44.974286 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has defined MAC address 52:54:00:d3:40:ab in network mk-old-k8s-version-613355
I1213 20:14:44.974722 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d3:40:ab", ip: ""} in network mk-old-k8s-version-613355: {Iface:virbr3 ExpiryTime:2024-12-13 21:14:35 +0000 UTC Type:0 Mac:52:54:00:d3:40:ab Iaid: IPaddr:192.168.72.134 Prefix:24 Hostname:minikube Clientid:01:52:54:00:d3:40:ab}
I1213 20:14:44.974763 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has defined IP address 192.168.72.134 and MAC address 52:54:00:d3:40:ab in network mk-old-k8s-version-613355
I1213 20:14:44.975259 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | Using SSH client type: external
I1213 20:14:44.975304 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | Using SSH private key: /home/jenkins/minikube-integration/20090-12353/.minikube/machines/old-k8s-version-613355/id_rsa (-rw-------)
I1213 20:14:44.975338 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.72.134 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/20090-12353/.minikube/machines/old-k8s-version-613355/id_rsa -p 22] /usr/bin/ssh <nil>}
I1213 20:14:44.975353 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | About to run SSH command:
I1213 20:14:44.975368 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | exit 0
I1213 20:14:45.106613 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | SSH cmd err, output: <nil>:
I1213 20:14:45.106922 69781 main.go:141] libmachine: (old-k8s-version-613355) KVM machine creation complete
I1213 20:14:45.107237 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetConfigRaw
I1213 20:14:45.107809 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .DriverName
I1213 20:14:45.108006 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .DriverName
I1213 20:14:45.108172 69781 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I1213 20:14:45.108188 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetState
I1213 20:14:45.109605 69781 main.go:141] libmachine: Detecting operating system of created instance...
I1213 20:14:45.109622 69781 main.go:141] libmachine: Waiting for SSH to be available...
I1213 20:14:45.109629 69781 main.go:141] libmachine: Getting to WaitForSSH function...
I1213 20:14:45.109639 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetSSHHostname
I1213 20:14:45.112464 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has defined MAC address 52:54:00:d3:40:ab in network mk-old-k8s-version-613355
I1213 20:14:45.112821 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d3:40:ab", ip: ""} in network mk-old-k8s-version-613355: {Iface:virbr3 ExpiryTime:2024-12-13 21:14:35 +0000 UTC Type:0 Mac:52:54:00:d3:40:ab Iaid: IPaddr:192.168.72.134 Prefix:24 Hostname:old-k8s-version-613355 Clientid:01:52:54:00:d3:40:ab}
I1213 20:14:45.112852 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has defined IP address 192.168.72.134 and MAC address 52:54:00:d3:40:ab in network mk-old-k8s-version-613355
I1213 20:14:45.113011 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetSSHPort
I1213 20:14:45.113180 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetSSHKeyPath
I1213 20:14:45.113350 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetSSHKeyPath
I1213 20:14:45.113466 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetSSHUsername
I1213 20:14:45.113652 69781 main.go:141] libmachine: Using SSH client type: native
I1213 20:14:45.113891 69781 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x867100] 0x869de0 <nil> [] 0s} 192.168.72.134 22 <nil> <nil>}
I1213 20:14:45.113907 69781 main.go:141] libmachine: About to run SSH command:
exit 0
I1213 20:14:45.226414 69781 main.go:141] libmachine: SSH cmd err, output: <nil>:
I1213 20:14:45.226445 69781 main.go:141] libmachine: Detecting the provisioner...
I1213 20:14:45.226457 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetSSHHostname
I1213 20:14:45.230099 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has defined MAC address 52:54:00:d3:40:ab in network mk-old-k8s-version-613355
I1213 20:14:45.230563 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d3:40:ab", ip: ""} in network mk-old-k8s-version-613355: {Iface:virbr3 ExpiryTime:2024-12-13 21:14:35 +0000 UTC Type:0 Mac:52:54:00:d3:40:ab Iaid: IPaddr:192.168.72.134 Prefix:24 Hostname:old-k8s-version-613355 Clientid:01:52:54:00:d3:40:ab}
I1213 20:14:45.230594 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has defined IP address 192.168.72.134 and MAC address 52:54:00:d3:40:ab in network mk-old-k8s-version-613355
I1213 20:14:45.230732 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetSSHPort
I1213 20:14:45.230993 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetSSHKeyPath
I1213 20:14:45.231159 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetSSHKeyPath
I1213 20:14:45.231345 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetSSHUsername
I1213 20:14:45.231679 69781 main.go:141] libmachine: Using SSH client type: native
I1213 20:14:45.231879 69781 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x867100] 0x869de0 <nil> [] 0s} 192.168.72.134 22 <nil> <nil>}
I1213 20:14:45.231904 69781 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I1213 20:14:45.348589 69781 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I1213 20:14:45.348666 69781 main.go:141] libmachine: found compatible host: buildroot
I1213 20:14:45.348676 69781 main.go:141] libmachine: Provisioning with buildroot...
I1213 20:14:45.348686 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetMachineName
I1213 20:14:45.348920 69781 buildroot.go:166] provisioning hostname "old-k8s-version-613355"
I1213 20:14:45.348950 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetMachineName
I1213 20:14:45.349181 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetSSHHostname
I1213 20:14:45.352052 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has defined MAC address 52:54:00:d3:40:ab in network mk-old-k8s-version-613355
I1213 20:14:45.352446 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d3:40:ab", ip: ""} in network mk-old-k8s-version-613355: {Iface:virbr3 ExpiryTime:2024-12-13 21:14:35 +0000 UTC Type:0 Mac:52:54:00:d3:40:ab Iaid: IPaddr:192.168.72.134 Prefix:24 Hostname:old-k8s-version-613355 Clientid:01:52:54:00:d3:40:ab}
I1213 20:14:45.352486 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has defined IP address 192.168.72.134 and MAC address 52:54:00:d3:40:ab in network mk-old-k8s-version-613355
I1213 20:14:45.352610 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetSSHPort
I1213 20:14:45.352785 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetSSHKeyPath
I1213 20:14:45.352957 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetSSHKeyPath
I1213 20:14:45.353121 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetSSHUsername
I1213 20:14:45.353296 69781 main.go:141] libmachine: Using SSH client type: native
I1213 20:14:45.353499 69781 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x867100] 0x869de0 <nil> [] 0s} 192.168.72.134 22 <nil> <nil>}
I1213 20:14:45.353512 69781 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-613355 && echo "old-k8s-version-613355" | sudo tee /etc/hostname
I1213 20:14:45.481783 69781 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-613355
I1213 20:14:45.481827 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetSSHHostname
I1213 20:14:45.484227 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has defined MAC address 52:54:00:d3:40:ab in network mk-old-k8s-version-613355
I1213 20:14:45.484585 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d3:40:ab", ip: ""} in network mk-old-k8s-version-613355: {Iface:virbr3 ExpiryTime:2024-12-13 21:14:35 +0000 UTC Type:0 Mac:52:54:00:d3:40:ab Iaid: IPaddr:192.168.72.134 Prefix:24 Hostname:old-k8s-version-613355 Clientid:01:52:54:00:d3:40:ab}
I1213 20:14:45.484616 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has defined IP address 192.168.72.134 and MAC address 52:54:00:d3:40:ab in network mk-old-k8s-version-613355
I1213 20:14:45.484782 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetSSHPort
I1213 20:14:45.484957 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetSSHKeyPath
I1213 20:14:45.485104 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetSSHKeyPath
I1213 20:14:45.485242 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetSSHUsername
I1213 20:14:45.485395 69781 main.go:141] libmachine: Using SSH client type: native
I1213 20:14:45.485591 69781 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x867100] 0x869de0 <nil> [] 0s} 192.168.72.134 22 <nil> <nil>}
I1213 20:14:45.485610 69781 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-613355' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-613355/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-613355' | sudo tee -a /etc/hosts;
fi
fi
I1213 20:14:45.608757 69781 main.go:141] libmachine: SSH cmd err, output: <nil>:
I1213 20:14:45.608807 69781 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/20090-12353/.minikube CaCertPath:/home/jenkins/minikube-integration/20090-12353/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20090-12353/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20090-12353/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20090-12353/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20090-12353/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20090-12353/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20090-12353/.minikube}
I1213 20:14:45.608859 69781 buildroot.go:174] setting up certificates
I1213 20:14:45.608877 69781 provision.go:84] configureAuth start
I1213 20:14:45.608897 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetMachineName
I1213 20:14:45.609201 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetIP
I1213 20:14:45.612276 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has defined MAC address 52:54:00:d3:40:ab in network mk-old-k8s-version-613355
I1213 20:14:45.612666 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d3:40:ab", ip: ""} in network mk-old-k8s-version-613355: {Iface:virbr3 ExpiryTime:2024-12-13 21:14:35 +0000 UTC Type:0 Mac:52:54:00:d3:40:ab Iaid: IPaddr:192.168.72.134 Prefix:24 Hostname:old-k8s-version-613355 Clientid:01:52:54:00:d3:40:ab}
I1213 20:14:45.612694 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has defined IP address 192.168.72.134 and MAC address 52:54:00:d3:40:ab in network mk-old-k8s-version-613355
I1213 20:14:45.612848 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetSSHHostname
I1213 20:14:45.615469 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has defined MAC address 52:54:00:d3:40:ab in network mk-old-k8s-version-613355
I1213 20:14:45.615836 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d3:40:ab", ip: ""} in network mk-old-k8s-version-613355: {Iface:virbr3 ExpiryTime:2024-12-13 21:14:35 +0000 UTC Type:0 Mac:52:54:00:d3:40:ab Iaid: IPaddr:192.168.72.134 Prefix:24 Hostname:old-k8s-version-613355 Clientid:01:52:54:00:d3:40:ab}
I1213 20:14:45.615869 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has defined IP address 192.168.72.134 and MAC address 52:54:00:d3:40:ab in network mk-old-k8s-version-613355
I1213 20:14:45.615953 69781 provision.go:143] copyHostCerts
I1213 20:14:45.616016 69781 exec_runner.go:144] found /home/jenkins/minikube-integration/20090-12353/.minikube/ca.pem, removing ...
I1213 20:14:45.616029 69781 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20090-12353/.minikube/ca.pem
I1213 20:14:45.616097 69781 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20090-12353/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20090-12353/.minikube/ca.pem (1082 bytes)
I1213 20:14:45.616192 69781 exec_runner.go:144] found /home/jenkins/minikube-integration/20090-12353/.minikube/cert.pem, removing ...
I1213 20:14:45.616203 69781 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20090-12353/.minikube/cert.pem
I1213 20:14:45.616233 69781 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20090-12353/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20090-12353/.minikube/cert.pem (1123 bytes)
I1213 20:14:45.616296 69781 exec_runner.go:144] found /home/jenkins/minikube-integration/20090-12353/.minikube/key.pem, removing ...
I1213 20:14:45.616308 69781 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20090-12353/.minikube/key.pem
I1213 20:14:45.616337 69781 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20090-12353/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20090-12353/.minikube/key.pem (1675 bytes)
I1213 20:14:45.616397 69781 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20090-12353/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20090-12353/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20090-12353/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-613355 san=[127.0.0.1 192.168.72.134 localhost minikube old-k8s-version-613355]
I1213 20:14:45.660918 69781 provision.go:177] copyRemoteCerts
I1213 20:14:45.660965 69781 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1213 20:14:45.660991 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetSSHHostname
I1213 20:14:45.664108 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has defined MAC address 52:54:00:d3:40:ab in network mk-old-k8s-version-613355
I1213 20:14:45.664447 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d3:40:ab", ip: ""} in network mk-old-k8s-version-613355: {Iface:virbr3 ExpiryTime:2024-12-13 21:14:35 +0000 UTC Type:0 Mac:52:54:00:d3:40:ab Iaid: IPaddr:192.168.72.134 Prefix:24 Hostname:old-k8s-version-613355 Clientid:01:52:54:00:d3:40:ab}
I1213 20:14:45.664474 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has defined IP address 192.168.72.134 and MAC address 52:54:00:d3:40:ab in network mk-old-k8s-version-613355
I1213 20:14:45.664675 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetSSHPort
I1213 20:14:45.664864 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetSSHKeyPath
I1213 20:14:45.665021 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetSSHUsername
I1213 20:14:45.665153 69781 sshutil.go:53] new ssh client: &{IP:192.168.72.134 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20090-12353/.minikube/machines/old-k8s-version-613355/id_rsa Username:docker}
I1213 20:14:45.748864 69781 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20090-12353/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I1213 20:14:45.773308 69781 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20090-12353/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I1213 20:14:45.795801 69781 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20090-12353/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I1213 20:14:45.820540 69781 provision.go:87] duration metric: took 211.64834ms to configureAuth
I1213 20:14:45.820565 69781 buildroot.go:189] setting minikube options for container-runtime
I1213 20:14:45.820726 69781 config.go:182] Loaded profile config "old-k8s-version-613355": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I1213 20:14:45.820804 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetSSHHostname
I1213 20:14:45.823680 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has defined MAC address 52:54:00:d3:40:ab in network mk-old-k8s-version-613355
I1213 20:14:45.824055 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d3:40:ab", ip: ""} in network mk-old-k8s-version-613355: {Iface:virbr3 ExpiryTime:2024-12-13 21:14:35 +0000 UTC Type:0 Mac:52:54:00:d3:40:ab Iaid: IPaddr:192.168.72.134 Prefix:24 Hostname:old-k8s-version-613355 Clientid:01:52:54:00:d3:40:ab}
I1213 20:14:45.824087 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has defined IP address 192.168.72.134 and MAC address 52:54:00:d3:40:ab in network mk-old-k8s-version-613355
I1213 20:14:45.824229 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetSSHPort
I1213 20:14:45.824412 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetSSHKeyPath
I1213 20:14:45.824593 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetSSHKeyPath
I1213 20:14:45.824766 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetSSHUsername
I1213 20:14:45.824957 69781 main.go:141] libmachine: Using SSH client type: native
I1213 20:14:45.825174 69781 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x867100] 0x869de0 <nil> [] 0s} 192.168.72.134 22 <nil> <nil>}
I1213 20:14:45.825194 69781 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I1213 20:14:46.082284 69781 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I1213 20:14:46.082313 69781 main.go:141] libmachine: Checking connection to Docker...
I1213 20:14:46.082324 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetURL
I1213 20:14:46.083767 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | using libvirt version 6000000
I1213 20:14:46.086472 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has defined MAC address 52:54:00:d3:40:ab in network mk-old-k8s-version-613355
I1213 20:14:46.086855 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d3:40:ab", ip: ""} in network mk-old-k8s-version-613355: {Iface:virbr3 ExpiryTime:2024-12-13 21:14:35 +0000 UTC Type:0 Mac:52:54:00:d3:40:ab Iaid: IPaddr:192.168.72.134 Prefix:24 Hostname:old-k8s-version-613355 Clientid:01:52:54:00:d3:40:ab}
I1213 20:14:46.086876 69781 main.go:141] libmachine: Docker is up and running!
I1213 20:14:46.086891 69781 main.go:141] libmachine: Reticulating splines...
I1213 20:14:46.086899 69781 client.go:171] duration metric: took 25.758308181s to LocalClient.Create
I1213 20:14:46.086901 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has defined IP address 192.168.72.134 and MAC address 52:54:00:d3:40:ab in network mk-old-k8s-version-613355
I1213 20:14:46.086914 69781 start.go:167] duration metric: took 25.758365286s to libmachine.API.Create "old-k8s-version-613355"
I1213 20:14:46.086921 69781 start.go:293] postStartSetup for "old-k8s-version-613355" (driver="kvm2")
I1213 20:14:46.086929 69781 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1213 20:14:46.086942 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .DriverName
I1213 20:14:46.087193 69781 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1213 20:14:46.087211 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetSSHHostname
I1213 20:14:46.089807 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has defined MAC address 52:54:00:d3:40:ab in network mk-old-k8s-version-613355
I1213 20:14:46.090249 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d3:40:ab", ip: ""} in network mk-old-k8s-version-613355: {Iface:virbr3 ExpiryTime:2024-12-13 21:14:35 +0000 UTC Type:0 Mac:52:54:00:d3:40:ab Iaid: IPaddr:192.168.72.134 Prefix:24 Hostname:old-k8s-version-613355 Clientid:01:52:54:00:d3:40:ab}
I1213 20:14:46.090280 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has defined IP address 192.168.72.134 and MAC address 52:54:00:d3:40:ab in network mk-old-k8s-version-613355
I1213 20:14:46.090513 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetSSHPort
I1213 20:14:46.090694 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetSSHKeyPath
I1213 20:14:46.090886 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetSSHUsername
I1213 20:14:46.091017 69781 sshutil.go:53] new ssh client: &{IP:192.168.72.134 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20090-12353/.minikube/machines/old-k8s-version-613355/id_rsa Username:docker}
I1213 20:14:46.177062 69781 ssh_runner.go:195] Run: cat /etc/os-release
I1213 20:14:46.181267 69781 info.go:137] Remote host: Buildroot 2023.02.9
I1213 20:14:46.181294 69781 filesync.go:126] Scanning /home/jenkins/minikube-integration/20090-12353/.minikube/addons for local assets ...
I1213 20:14:46.181337 69781 filesync.go:126] Scanning /home/jenkins/minikube-integration/20090-12353/.minikube/files for local assets ...
I1213 20:14:46.181412 69781 filesync.go:149] local asset: /home/jenkins/minikube-integration/20090-12353/.minikube/files/etc/ssl/certs/195442.pem -> 195442.pem in /etc/ssl/certs
I1213 20:14:46.181512 69781 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I1213 20:14:46.191306 69781 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20090-12353/.minikube/files/etc/ssl/certs/195442.pem --> /etc/ssl/certs/195442.pem (1708 bytes)
I1213 20:14:46.214828 69781 start.go:296] duration metric: took 127.896551ms for postStartSetup
I1213 20:14:46.214891 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetConfigRaw
I1213 20:14:46.215418 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetIP
I1213 20:14:46.217785 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has defined MAC address 52:54:00:d3:40:ab in network mk-old-k8s-version-613355
I1213 20:14:46.218133 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d3:40:ab", ip: ""} in network mk-old-k8s-version-613355: {Iface:virbr3 ExpiryTime:2024-12-13 21:14:35 +0000 UTC Type:0 Mac:52:54:00:d3:40:ab Iaid: IPaddr:192.168.72.134 Prefix:24 Hostname:old-k8s-version-613355 Clientid:01:52:54:00:d3:40:ab}
I1213 20:14:46.218159 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has defined IP address 192.168.72.134 and MAC address 52:54:00:d3:40:ab in network mk-old-k8s-version-613355
I1213 20:14:46.218391 69781 profile.go:143] Saving config to /home/jenkins/minikube-integration/20090-12353/.minikube/profiles/old-k8s-version-613355/config.json ...
I1213 20:14:46.218589 69781 start.go:128] duration metric: took 25.910903107s to createHost
I1213 20:14:46.218610 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetSSHHostname
I1213 20:14:46.220684 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has defined MAC address 52:54:00:d3:40:ab in network mk-old-k8s-version-613355
I1213 20:14:46.220984 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d3:40:ab", ip: ""} in network mk-old-k8s-version-613355: {Iface:virbr3 ExpiryTime:2024-12-13 21:14:35 +0000 UTC Type:0 Mac:52:54:00:d3:40:ab Iaid: IPaddr:192.168.72.134 Prefix:24 Hostname:old-k8s-version-613355 Clientid:01:52:54:00:d3:40:ab}
I1213 20:14:46.221010 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has defined IP address 192.168.72.134 and MAC address 52:54:00:d3:40:ab in network mk-old-k8s-version-613355
I1213 20:14:46.221156 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetSSHPort
I1213 20:14:46.221364 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetSSHKeyPath
I1213 20:14:46.221544 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetSSHKeyPath
I1213 20:14:46.221662 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetSSHUsername
I1213 20:14:46.221850 69781 main.go:141] libmachine: Using SSH client type: native
I1213 20:14:46.222054 69781 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x867100] 0x869de0 <nil> [] 0s} 192.168.72.134 22 <nil> <nil>}
I1213 20:14:46.222069 69781 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I1213 20:14:46.331799 69781 main.go:141] libmachine: SSH cmd err, output: <nil>: 1734120886.318380271
I1213 20:14:46.331820 69781 fix.go:216] guest clock: 1734120886.318380271
I1213 20:14:46.331827 69781 fix.go:229] Guest: 2024-12-13 20:14:46.318380271 +0000 UTC Remote: 2024-12-13 20:14:46.218601003 +0000 UTC m=+55.608204193 (delta=99.779268ms)
I1213 20:14:46.331843 69781 fix.go:200] guest clock delta is within tolerance: 99.779268ms
I1213 20:14:46.331848 69781 start.go:83] releasing machines lock for "old-k8s-version-613355", held for 26.024331345s
I1213 20:14:46.331862 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .DriverName
I1213 20:14:46.332058 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetIP
I1213 20:14:46.334711 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has defined MAC address 52:54:00:d3:40:ab in network mk-old-k8s-version-613355
I1213 20:14:46.335190 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d3:40:ab", ip: ""} in network mk-old-k8s-version-613355: {Iface:virbr3 ExpiryTime:2024-12-13 21:14:35 +0000 UTC Type:0 Mac:52:54:00:d3:40:ab Iaid: IPaddr:192.168.72.134 Prefix:24 Hostname:old-k8s-version-613355 Clientid:01:52:54:00:d3:40:ab}
I1213 20:14:46.335216 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has defined IP address 192.168.72.134 and MAC address 52:54:00:d3:40:ab in network mk-old-k8s-version-613355
I1213 20:14:46.335369 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .DriverName
I1213 20:14:46.335917 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .DriverName
I1213 20:14:46.336088 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .DriverName
I1213 20:14:46.336190 69781 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1213 20:14:46.336228 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetSSHHostname
I1213 20:14:46.336328 69781 ssh_runner.go:195] Run: cat /version.json
I1213 20:14:46.336368 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetSSHHostname
I1213 20:14:46.339302 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has defined MAC address 52:54:00:d3:40:ab in network mk-old-k8s-version-613355
I1213 20:14:46.339466 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has defined MAC address 52:54:00:d3:40:ab in network mk-old-k8s-version-613355
I1213 20:14:46.339621 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d3:40:ab", ip: ""} in network mk-old-k8s-version-613355: {Iface:virbr3 ExpiryTime:2024-12-13 21:14:35 +0000 UTC Type:0 Mac:52:54:00:d3:40:ab Iaid: IPaddr:192.168.72.134 Prefix:24 Hostname:old-k8s-version-613355 Clientid:01:52:54:00:d3:40:ab}
I1213 20:14:46.339642 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has defined IP address 192.168.72.134 and MAC address 52:54:00:d3:40:ab in network mk-old-k8s-version-613355
I1213 20:14:46.339860 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d3:40:ab", ip: ""} in network mk-old-k8s-version-613355: {Iface:virbr3 ExpiryTime:2024-12-13 21:14:35 +0000 UTC Type:0 Mac:52:54:00:d3:40:ab Iaid: IPaddr:192.168.72.134 Prefix:24 Hostname:old-k8s-version-613355 Clientid:01:52:54:00:d3:40:ab}
I1213 20:14:46.339885 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has defined IP address 192.168.72.134 and MAC address 52:54:00:d3:40:ab in network mk-old-k8s-version-613355
I1213 20:14:46.339956 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetSSHPort
I1213 20:14:46.340042 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetSSHPort
I1213 20:14:46.340196 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetSSHKeyPath
I1213 20:14:46.340231 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetSSHKeyPath
I1213 20:14:46.340395 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetSSHUsername
I1213 20:14:46.340404 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetSSHUsername
I1213 20:14:46.340549 69781 sshutil.go:53] new ssh client: &{IP:192.168.72.134 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20090-12353/.minikube/machines/old-k8s-version-613355/id_rsa Username:docker}
I1213 20:14:46.340551 69781 sshutil.go:53] new ssh client: &{IP:192.168.72.134 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20090-12353/.minikube/machines/old-k8s-version-613355/id_rsa Username:docker}
I1213 20:14:46.456434 69781 ssh_runner.go:195] Run: systemctl --version
I1213 20:14:46.462401 69781 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I1213 20:14:46.620892 69781 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W1213 20:14:46.627157 69781 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I1213 20:14:46.627236 69781 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1213 20:14:46.642201 69781 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I1213 20:14:46.642223 69781 start.go:495] detecting cgroup driver to use...
I1213 20:14:46.642270 69781 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I1213 20:14:46.659547 69781 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I1213 20:14:46.674449 69781 docker.go:217] disabling cri-docker service (if available) ...
I1213 20:14:46.674504 69781 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I1213 20:14:46.688176 69781 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I1213 20:14:46.701979 69781 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I1213 20:14:46.851325 69781 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I1213 20:14:47.042355 69781 docker.go:233] disabling docker service ...
I1213 20:14:47.042409 69781 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I1213 20:14:47.056038 69781 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I1213 20:14:47.068119 69781 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I1213 20:14:47.201545 69781 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I1213 20:14:47.347917 69781 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I1213 20:14:47.363009 69781 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I1213 20:14:47.384003 69781 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I1213 20:14:47.384165 69781 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I1213 20:14:47.395659 69781 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I1213 20:14:47.395725 69781 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I1213 20:14:47.405877 69781 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I1213 20:14:47.417154 69781 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I1213 20:14:47.428028 69781 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1213 20:14:47.439128 69781 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1213 20:14:47.448700 69781 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I1213 20:14:47.448754 69781 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I1213 20:14:47.461823 69781 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1213 20:14:47.471794 69781 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1213 20:14:47.599775 69781 ssh_runner.go:195] Run: sudo systemctl restart crio
I1213 20:14:47.718838 69781 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I1213 20:14:47.718921 69781 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I1213 20:14:47.725519 69781 start.go:563] Will wait 60s for crictl version
I1213 20:14:47.725578 69781 ssh_runner.go:195] Run: which crictl
I1213 20:14:47.730277 69781 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I1213 20:14:47.776587 69781 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I1213 20:14:47.776662 69781 ssh_runner.go:195] Run: crio --version
I1213 20:14:47.803431 69781 ssh_runner.go:195] Run: crio --version
I1213 20:14:47.835428 69781 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I1213 20:14:47.836675 69781 main.go:141] libmachine: (old-k8s-version-613355) Calling .GetIP
I1213 20:14:47.840409 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has defined MAC address 52:54:00:d3:40:ab in network mk-old-k8s-version-613355
I1213 20:14:47.840738 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d3:40:ab", ip: ""} in network mk-old-k8s-version-613355: {Iface:virbr3 ExpiryTime:2024-12-13 21:14:35 +0000 UTC Type:0 Mac:52:54:00:d3:40:ab Iaid: IPaddr:192.168.72.134 Prefix:24 Hostname:old-k8s-version-613355 Clientid:01:52:54:00:d3:40:ab}
I1213 20:14:47.840766 69781 main.go:141] libmachine: (old-k8s-version-613355) DBG | domain old-k8s-version-613355 has defined IP address 192.168.72.134 and MAC address 52:54:00:d3:40:ab in network mk-old-k8s-version-613355
I1213 20:14:47.841013 69781 ssh_runner.go:195] Run: grep 192.168.72.1 host.minikube.internal$ /etc/hosts
I1213 20:14:47.845430 69781 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.72.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1213 20:14:47.861656 69781 kubeadm.go:883] updating cluster {Name:old-k8s-version-613355 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/20090/minikube-v1.34.0-1734029574-20090-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1734029593-20090@sha256:7b3f6168a578563fb342f21f0c926652b91ba060931e8fbc6c6ade3ac1d26ed9 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-613355 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.134 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] M
ountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I1213 20:14:47.861796 69781 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I1213 20:14:47.861855 69781 ssh_runner.go:195] Run: sudo crictl images --output json
I1213 20:14:47.899204 69781 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I1213 20:14:47.899269 69781 ssh_runner.go:195] Run: which lz4
I1213 20:14:47.903211 69781 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I1213 20:14:47.908706 69781 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I1213 20:14:47.908739 69781 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20090-12353/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I1213 20:14:49.541685 69781 crio.go:462] duration metric: took 1.638506017s to copy over tarball
I1213 20:14:49.541765 69781 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I1213 20:14:52.394887 69781 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.853083755s)
I1213 20:14:52.394921 69781 crio.go:469] duration metric: took 2.853202053s to extract the tarball
I1213 20:14:52.394931 69781 ssh_runner.go:146] rm: /preloaded.tar.lz4
I1213 20:14:52.438998 69781 ssh_runner.go:195] Run: sudo crictl images --output json
I1213 20:14:52.487094 69781 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I1213 20:14:52.487119 69781 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I1213 20:14:52.487216 69781 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I1213 20:14:52.487251 69781 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I1213 20:14:52.487257 69781 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I1213 20:14:52.487216 69781 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I1213 20:14:52.487277 69781 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I1213 20:14:52.487318 69781 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I1213 20:14:52.487319 69781 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I1213 20:14:52.487343 69781 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I1213 20:14:52.488825 69781 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I1213 20:14:52.489231 69781 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I1213 20:14:52.489238 69781 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I1213 20:14:52.489231 69781 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I1213 20:14:52.489315 69781 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I1213 20:14:52.489318 69781 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I1213 20:14:52.489231 69781 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I1213 20:14:52.489388 69781 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I1213 20:14:52.692976 69781 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I1213 20:14:52.733024 69781 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I1213 20:14:52.733074 69781 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I1213 20:14:52.733129 69781 ssh_runner.go:195] Run: which crictl
I1213 20:14:52.733945 69781 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I1213 20:14:52.737479 69781 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I1213 20:14:52.745039 69781 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I1213 20:14:52.745040 69781 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I1213 20:14:52.754446 69781 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I1213 20:14:52.761966 69781 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I1213 20:14:52.774387 69781 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I1213 20:14:52.860282 69781 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I1213 20:14:52.860342 69781 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I1213 20:14:52.860346 69781 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I1213 20:14:52.860386 69781 ssh_runner.go:195] Run: which crictl
I1213 20:14:52.915064 69781 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I1213 20:14:52.915142 69781 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I1213 20:14:52.915195 69781 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I1213 20:14:52.915087 69781 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I1213 20:14:52.915222 69781 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I1213 20:14:52.915228 69781 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I1213 20:14:52.915256 69781 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I1213 20:14:52.915302 69781 ssh_runner.go:195] Run: which crictl
I1213 20:14:52.915314 69781 ssh_runner.go:195] Run: which crictl
I1213 20:14:52.915195 69781 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I1213 20:14:52.915359 69781 ssh_runner.go:195] Run: which crictl
I1213 20:14:52.915260 69781 ssh_runner.go:195] Run: which crictl
I1213 20:14:52.922292 69781 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I1213 20:14:52.922340 69781 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I1213 20:14:52.922377 69781 ssh_runner.go:195] Run: which crictl
I1213 20:14:52.943494 69781 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I1213 20:14:52.943557 69781 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I1213 20:14:52.943599 69781 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I1213 20:14:52.943605 69781 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I1213 20:14:52.943652 69781 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I1213 20:14:52.943657 69781 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I1213 20:14:52.943711 69781 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I1213 20:14:53.100132 69781 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I1213 20:14:53.100206 69781 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I1213 20:14:53.100274 69781 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I1213 20:14:53.103903 69781 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20090-12353/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I1213 20:14:53.104083 69781 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I1213 20:14:53.104113 69781 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I1213 20:14:53.104169 69781 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I1213 20:14:53.222538 69781 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I1213 20:14:53.222561 69781 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I1213 20:14:53.224147 69781 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I1213 20:14:53.241331 69781 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I1213 20:14:53.241360 69781 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I1213 20:14:53.241428 69781 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I1213 20:14:53.342687 69781 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20090-12353/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I1213 20:14:53.344816 69781 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20090-12353/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I1213 20:14:53.344853 69781 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20090-12353/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I1213 20:14:53.356629 69781 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20090-12353/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I1213 20:14:53.370335 69781 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20090-12353/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I1213 20:14:53.370344 69781 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20090-12353/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I1213 20:14:53.728675 69781 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I1213 20:14:53.878504 69781 cache_images.go:92] duration metric: took 1.39136662s to LoadCachedImages
W1213 20:14:53.878622 69781 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20090-12353/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20090-12353/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0: no such file or directory
I1213 20:14:53.878642 69781 kubeadm.go:934] updating node { 192.168.72.134 8443 v1.20.0 crio true true} ...
I1213 20:14:53.878755 69781 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-613355 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.72.134
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-613355 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I1213 20:14:53.878826 69781 ssh_runner.go:195] Run: crio config
I1213 20:14:53.926700 69781 cni.go:84] Creating CNI manager for ""
I1213 20:14:53.926732 69781 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I1213 20:14:53.926753 69781 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I1213 20:14:53.926778 69781 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.72.134 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-613355 NodeName:old-k8s-version-613355 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.72.134"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.72.134 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I1213 20:14:53.926968 69781 kubeadm.go:195] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.72.134
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-613355"
kubeletExtraArgs:
node-ip: 192.168.72.134
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.72.134"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I1213 20:14:53.927039 69781 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I1213 20:14:53.937678 69781 binaries.go:44] Found k8s binaries, skipping transfer
I1213 20:14:53.937743 69781 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I1213 20:14:53.947532 69781 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I1213 20:14:53.966183 69781 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1213 20:14:53.983161 69781 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I1213 20:14:53.999902 69781 ssh_runner.go:195] Run: grep 192.168.72.134 control-plane.minikube.internal$ /etc/hosts
I1213 20:14:54.003707 69781 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.72.134 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1213 20:14:54.015514 69781 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1213 20:14:54.143120 69781 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1213 20:14:54.159910 69781 certs.go:68] Setting up /home/jenkins/minikube-integration/20090-12353/.minikube/profiles/old-k8s-version-613355 for IP: 192.168.72.134
I1213 20:14:54.159938 69781 certs.go:194] generating shared ca certs ...
I1213 20:14:54.159958 69781 certs.go:226] acquiring lock for ca certs: {Name:mka8994129240986519f4b0ac41f1e4e27ada985 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1213 20:14:54.160198 69781 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20090-12353/.minikube/ca.key
I1213 20:14:54.160268 69781 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20090-12353/.minikube/proxy-client-ca.key
I1213 20:14:54.160280 69781 certs.go:256] generating profile certs ...
I1213 20:14:54.160355 69781 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/20090-12353/.minikube/profiles/old-k8s-version-613355/client.key
I1213 20:14:54.160374 69781 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20090-12353/.minikube/profiles/old-k8s-version-613355/client.crt with IP's: []
I1213 20:14:54.270025 69781 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20090-12353/.minikube/profiles/old-k8s-version-613355/client.crt ...
I1213 20:14:54.270056 69781 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20090-12353/.minikube/profiles/old-k8s-version-613355/client.crt: {Name:mk4eae248734cfbc5c03e09f3ea05bf9a32990e9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1213 20:14:54.270243 69781 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20090-12353/.minikube/profiles/old-k8s-version-613355/client.key ...
I1213 20:14:54.270260 69781 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20090-12353/.minikube/profiles/old-k8s-version-613355/client.key: {Name:mkc4f00b27e8570693c6dbfae7f9b195b702bb3c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1213 20:14:54.270364 69781 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20090-12353/.minikube/profiles/old-k8s-version-613355/apiserver.key.60799339
I1213 20:14:54.270384 69781 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20090-12353/.minikube/profiles/old-k8s-version-613355/apiserver.crt.60799339 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.72.134]
I1213 20:14:54.378654 69781 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20090-12353/.minikube/profiles/old-k8s-version-613355/apiserver.crt.60799339 ...
I1213 20:14:54.378685 69781 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20090-12353/.minikube/profiles/old-k8s-version-613355/apiserver.crt.60799339: {Name:mk0d02cc9943e0bee2b8171e219a061673eec0f0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1213 20:14:54.378873 69781 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20090-12353/.minikube/profiles/old-k8s-version-613355/apiserver.key.60799339 ...
I1213 20:14:54.378894 69781 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20090-12353/.minikube/profiles/old-k8s-version-613355/apiserver.key.60799339: {Name:mka8058d0329a8092442d1d1e62a6016006ce9be Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1213 20:14:54.379016 69781 certs.go:381] copying /home/jenkins/minikube-integration/20090-12353/.minikube/profiles/old-k8s-version-613355/apiserver.crt.60799339 -> /home/jenkins/minikube-integration/20090-12353/.minikube/profiles/old-k8s-version-613355/apiserver.crt
I1213 20:14:54.379138 69781 certs.go:385] copying /home/jenkins/minikube-integration/20090-12353/.minikube/profiles/old-k8s-version-613355/apiserver.key.60799339 -> /home/jenkins/minikube-integration/20090-12353/.minikube/profiles/old-k8s-version-613355/apiserver.key
I1213 20:14:54.379232 69781 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/20090-12353/.minikube/profiles/old-k8s-version-613355/proxy-client.key
I1213 20:14:54.379258 69781 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20090-12353/.minikube/profiles/old-k8s-version-613355/proxy-client.crt with IP's: []
I1213 20:14:54.523849 69781 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20090-12353/.minikube/profiles/old-k8s-version-613355/proxy-client.crt ...
I1213 20:14:54.523874 69781 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20090-12353/.minikube/profiles/old-k8s-version-613355/proxy-client.crt: {Name:mke07b82f8baacf097bfc15d324a16db7f0cf7ac Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1213 20:14:54.524043 69781 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20090-12353/.minikube/profiles/old-k8s-version-613355/proxy-client.key ...
I1213 20:14:54.524059 69781 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20090-12353/.minikube/profiles/old-k8s-version-613355/proxy-client.key: {Name:mk507ecb0b83c13d20ca7b63ef5c61102285b74e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1213 20:14:54.524268 69781 certs.go:484] found cert: /home/jenkins/minikube-integration/20090-12353/.minikube/certs/19544.pem (1338 bytes)
W1213 20:14:54.524305 69781 certs.go:480] ignoring /home/jenkins/minikube-integration/20090-12353/.minikube/certs/19544_empty.pem, impossibly tiny 0 bytes
I1213 20:14:54.524315 69781 certs.go:484] found cert: /home/jenkins/minikube-integration/20090-12353/.minikube/certs/ca-key.pem (1679 bytes)
I1213 20:14:54.524338 69781 certs.go:484] found cert: /home/jenkins/minikube-integration/20090-12353/.minikube/certs/ca.pem (1082 bytes)
I1213 20:14:54.524376 69781 certs.go:484] found cert: /home/jenkins/minikube-integration/20090-12353/.minikube/certs/cert.pem (1123 bytes)
I1213 20:14:54.524403 69781 certs.go:484] found cert: /home/jenkins/minikube-integration/20090-12353/.minikube/certs/key.pem (1675 bytes)
I1213 20:14:54.524443 69781 certs.go:484] found cert: /home/jenkins/minikube-integration/20090-12353/.minikube/files/etc/ssl/certs/195442.pem (1708 bytes)
I1213 20:14:54.525017 69781 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20090-12353/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1213 20:14:54.550315 69781 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20090-12353/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I1213 20:14:54.577057 69781 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20090-12353/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1213 20:14:54.599670 69781 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20090-12353/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I1213 20:14:54.621563 69781 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20090-12353/.minikube/profiles/old-k8s-version-613355/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I1213 20:14:54.648533 69781 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20090-12353/.minikube/profiles/old-k8s-version-613355/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I1213 20:14:54.673044 69781 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20090-12353/.minikube/profiles/old-k8s-version-613355/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1213 20:14:54.697616 69781 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20090-12353/.minikube/profiles/old-k8s-version-613355/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I1213 20:14:54.721354 69781 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20090-12353/.minikube/files/etc/ssl/certs/195442.pem --> /usr/share/ca-certificates/195442.pem (1708 bytes)
I1213 20:14:54.742644 69781 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20090-12353/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1213 20:14:54.765755 69781 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20090-12353/.minikube/certs/19544.pem --> /usr/share/ca-certificates/19544.pem (1338 bytes)
I1213 20:14:54.787831 69781 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I1213 20:14:54.803318 69781 ssh_runner.go:195] Run: openssl version
I1213 20:14:54.808811 69781 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/195442.pem && ln -fs /usr/share/ca-certificates/195442.pem /etc/ssl/certs/195442.pem"
I1213 20:14:54.819096 69781 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/195442.pem
I1213 20:14:54.823459 69781 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Dec 13 19:13 /usr/share/ca-certificates/195442.pem
I1213 20:14:54.823512 69781 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/195442.pem
I1213 20:14:54.829085 69781 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/195442.pem /etc/ssl/certs/3ec20f2e.0"
I1213 20:14:54.840497 69781 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1213 20:14:54.850933 69781 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1213 20:14:54.855250 69781 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Dec 13 19:03 /usr/share/ca-certificates/minikubeCA.pem
I1213 20:14:54.855308 69781 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1213 20:14:54.860672 69781 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1213 20:14:54.871493 69781 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/19544.pem && ln -fs /usr/share/ca-certificates/19544.pem /etc/ssl/certs/19544.pem"
I1213 20:14:54.882499 69781 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/19544.pem
I1213 20:14:54.886924 69781 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Dec 13 19:13 /usr/share/ca-certificates/19544.pem
I1213 20:14:54.886972 69781 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/19544.pem
I1213 20:14:54.892328 69781 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/19544.pem /etc/ssl/certs/51391683.0"
I1213 20:14:54.902238 69781 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I1213 20:14:54.905957 69781 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I1213 20:14:54.906028 69781 kubeadm.go:392] StartCluster: {Name:old-k8s-version-613355 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/20090/minikube-v1.34.0-1734029574-20090-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1734029593-20090@sha256:7b3f6168a578563fb342f21f0c926652b91ba060931e8fbc6c6ade3ac1d26ed9 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-613355 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.134 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1213 20:14:54.906095 69781 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I1213 20:14:54.906130 69781 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1213 20:14:54.951157 69781 cri.go:89] found id: ""
I1213 20:14:54.951240 69781 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I1213 20:14:54.961061 69781 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I1213 20:14:54.970489 69781 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I1213 20:14:54.980129 69781 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I1213 20:14:54.980151 69781 kubeadm.go:157] found existing configuration files:
I1213 20:14:54.980203 69781 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I1213 20:14:54.991649 69781 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I1213 20:14:54.991707 69781 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I1213 20:14:55.001720 69781 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I1213 20:14:55.010198 69781 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I1213 20:14:55.010265 69781 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I1213 20:14:55.019090 69781 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I1213 20:14:55.027732 69781 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I1213 20:14:55.027792 69781 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I1213 20:14:55.040649 69781 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I1213 20:14:55.055799 69781 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I1213 20:14:55.055850 69781 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I1213 20:14:55.075925 69781 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I1213 20:14:55.209825 69781 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I1213 20:14:55.209887 69781 kubeadm.go:310] [preflight] Running pre-flight checks
I1213 20:14:55.393056 69781 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I1213 20:14:55.393214 69781 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I1213 20:14:55.393376 69781 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I1213 20:14:55.586332 69781 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I1213 20:14:55.709559 69781 out.go:235] - Generating certificates and keys ...
I1213 20:14:55.709733 69781 kubeadm.go:310] [certs] Using existing ca certificate authority
I1213 20:14:55.709827 69781 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I1213 20:14:55.709926 69781 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I1213 20:14:55.722376 69781 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I1213 20:14:55.944959 69781 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I1213 20:14:56.027873 69781 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I1213 20:14:56.351826 69781 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I1213 20:14:56.352031 69781 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-613355] and IPs [192.168.72.134 127.0.0.1 ::1]
I1213 20:14:56.506682 69781 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I1213 20:14:56.506921 69781 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-613355] and IPs [192.168.72.134 127.0.0.1 ::1]
I1213 20:14:56.745024 69781 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I1213 20:14:57.108544 69781 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I1213 20:14:57.235456 69781 kubeadm.go:310] [certs] Generating "sa" key and public key
I1213 20:14:57.235658 69781 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I1213 20:14:57.312700 69781 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I1213 20:14:57.583106 69781 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I1213 20:14:57.751348 69781 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I1213 20:14:57.902663 69781 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I1213 20:14:57.920467 69781 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I1213 20:14:57.921682 69781 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I1213 20:14:57.921753 69781 kubeadm.go:310] [kubelet-start] Starting the kubelet
I1213 20:14:58.048268 69781 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I1213 20:14:58.050073 69781 out.go:235] - Booting up control plane ...
I1213 20:14:58.050193 69781 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I1213 20:14:58.057571 69781 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I1213 20:14:58.058356 69781 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I1213 20:14:58.059141 69781 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I1213 20:14:58.063193 69781 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I1213 20:15:38.061707 69781 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I1213 20:15:38.062057 69781 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1213 20:15:38.062329 69781 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I1213 20:15:43.062925 69781 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1213 20:15:43.063172 69781 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I1213 20:15:53.063566 69781 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1213 20:15:53.063811 69781 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I1213 20:16:13.064891 69781 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1213 20:16:13.065118 69781 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I1213 20:16:53.065688 69781 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1213 20:16:53.066257 69781 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I1213 20:16:53.066300 69781 kubeadm.go:310]
I1213 20:16:53.066389 69781 kubeadm.go:310] Unfortunately, an error has occurred:
I1213 20:16:53.066488 69781 kubeadm.go:310] timed out waiting for the condition
I1213 20:16:53.066502 69781 kubeadm.go:310]
I1213 20:16:53.066592 69781 kubeadm.go:310] This error is likely caused by:
I1213 20:16:53.066693 69781 kubeadm.go:310] - The kubelet is not running
I1213 20:16:53.066951 69781 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I1213 20:16:53.066964 69781 kubeadm.go:310]
I1213 20:16:53.067205 69781 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I1213 20:16:53.067292 69781 kubeadm.go:310] - 'systemctl status kubelet'
I1213 20:16:53.067398 69781 kubeadm.go:310] - 'journalctl -xeu kubelet'
I1213 20:16:53.067425 69781 kubeadm.go:310]
I1213 20:16:53.067712 69781 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I1213 20:16:53.067930 69781 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I1213 20:16:53.067946 69781 kubeadm.go:310]
I1213 20:16:53.068192 69781 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I1213 20:16:53.068418 69781 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I1213 20:16:53.068579 69781 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I1213 20:16:53.068935 69781 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I1213 20:16:53.068965 69781 kubeadm.go:310]
I1213 20:16:53.069154 69781 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I1213 20:16:53.069411 69781 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I1213 20:16:53.069804 69781 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
W1213 20:16:53.069896 69781 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-613355] and IPs [192.168.72.134 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-613355] and IPs [192.168.72.134 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-613355] and IPs [192.168.72.134 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-613355] and IPs [192.168.72.134 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I1213 20:16:53.069946 69781 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I1213 20:16:53.849083 69781 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1213 20:16:53.862747 69781 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I1213 20:16:53.872033 69781 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I1213 20:16:53.872055 69781 kubeadm.go:157] found existing configuration files:
I1213 20:16:53.872104 69781 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I1213 20:16:53.880753 69781 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I1213 20:16:53.880811 69781 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I1213 20:16:53.889511 69781 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I1213 20:16:53.897751 69781 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I1213 20:16:53.897813 69781 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I1213 20:16:53.907026 69781 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I1213 20:16:53.915439 69781 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I1213 20:16:53.915494 69781 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I1213 20:16:53.925025 69781 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I1213 20:16:53.934075 69781 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I1213 20:16:53.934131 69781 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I1213 20:16:53.943490 69781 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I1213 20:16:54.160157 69781 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I1213 20:18:50.234630 69781 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I1213 20:18:50.234774 69781 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I1213 20:18:50.237133 69781 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I1213 20:18:50.237220 69781 kubeadm.go:310] [preflight] Running pre-flight checks
I1213 20:18:50.237324 69781 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I1213 20:18:50.237448 69781 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I1213 20:18:50.237564 69781 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I1213 20:18:50.237646 69781 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I1213 20:18:50.239582 69781 out.go:235] - Generating certificates and keys ...
I1213 20:18:50.239697 69781 kubeadm.go:310] [certs] Using existing ca certificate authority
I1213 20:18:50.239796 69781 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I1213 20:18:50.239922 69781 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I1213 20:18:50.240021 69781 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I1213 20:18:50.240131 69781 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I1213 20:18:50.240216 69781 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I1213 20:18:50.240315 69781 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I1213 20:18:50.240399 69781 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I1213 20:18:50.240546 69781 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I1213 20:18:50.240664 69781 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I1213 20:18:50.240723 69781 kubeadm.go:310] [certs] Using the existing "sa" key
I1213 20:18:50.240800 69781 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I1213 20:18:50.240872 69781 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I1213 20:18:50.240949 69781 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I1213 20:18:50.241031 69781 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I1213 20:18:50.241111 69781 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I1213 20:18:50.241267 69781 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I1213 20:18:50.241386 69781 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I1213 20:18:50.241446 69781 kubeadm.go:310] [kubelet-start] Starting the kubelet
I1213 20:18:50.241563 69781 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I1213 20:18:50.242921 69781 out.go:235] - Booting up control plane ...
I1213 20:18:50.243047 69781 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I1213 20:18:50.243155 69781 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I1213 20:18:50.243259 69781 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I1213 20:18:50.243387 69781 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I1213 20:18:50.243616 69781 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I1213 20:18:50.243703 69781 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I1213 20:18:50.243803 69781 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1213 20:18:50.244065 69781 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I1213 20:18:50.244177 69781 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1213 20:18:50.244376 69781 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I1213 20:18:50.244473 69781 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1213 20:18:50.244680 69781 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I1213 20:18:50.244789 69781 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1213 20:18:50.245004 69781 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I1213 20:18:50.245085 69781 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I1213 20:18:50.245342 69781 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I1213 20:18:50.245366 69781 kubeadm.go:310]
I1213 20:18:50.245427 69781 kubeadm.go:310] Unfortunately, an error has occurred:
I1213 20:18:50.245482 69781 kubeadm.go:310] timed out waiting for the condition
I1213 20:18:50.245493 69781 kubeadm.go:310]
I1213 20:18:50.245533 69781 kubeadm.go:310] This error is likely caused by:
I1213 20:18:50.245583 69781 kubeadm.go:310] - The kubelet is not running
I1213 20:18:50.245736 69781 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I1213 20:18:50.245756 69781 kubeadm.go:310]
I1213 20:18:50.245874 69781 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I1213 20:18:50.245913 69781 kubeadm.go:310] - 'systemctl status kubelet'
I1213 20:18:50.245946 69781 kubeadm.go:310] - 'journalctl -xeu kubelet'
I1213 20:18:50.245956 69781 kubeadm.go:310]
I1213 20:18:50.246071 69781 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I1213 20:18:50.246186 69781 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I1213 20:18:50.246204 69781 kubeadm.go:310]
I1213 20:18:50.246349 69781 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I1213 20:18:50.246480 69781 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I1213 20:18:50.246584 69781 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I1213 20:18:50.246687 69781 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I1213 20:18:50.246707 69781 kubeadm.go:310]
I1213 20:18:50.246759 69781 kubeadm.go:394] duration metric: took 3m55.340749902s to StartCluster
I1213 20:18:50.246819 69781 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1213 20:18:50.246904 69781 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1213 20:18:50.304101 69781 cri.go:89] found id: ""
I1213 20:18:50.304131 69781 logs.go:282] 0 containers: []
W1213 20:18:50.304142 69781 logs.go:284] No container was found matching "kube-apiserver"
I1213 20:18:50.304149 69781 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1213 20:18:50.304202 69781 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1213 20:18:50.343240 69781 cri.go:89] found id: ""
I1213 20:18:50.343295 69781 logs.go:282] 0 containers: []
W1213 20:18:50.343308 69781 logs.go:284] No container was found matching "etcd"
I1213 20:18:50.343316 69781 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1213 20:18:50.343395 69781 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1213 20:18:50.379163 69781 cri.go:89] found id: ""
I1213 20:18:50.379204 69781 logs.go:282] 0 containers: []
W1213 20:18:50.379214 69781 logs.go:284] No container was found matching "coredns"
I1213 20:18:50.379226 69781 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1213 20:18:50.379293 69781 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1213 20:18:50.414322 69781 cri.go:89] found id: ""
I1213 20:18:50.414356 69781 logs.go:282] 0 containers: []
W1213 20:18:50.414367 69781 logs.go:284] No container was found matching "kube-scheduler"
I1213 20:18:50.414374 69781 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1213 20:18:50.414421 69781 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1213 20:18:50.458116 69781 cri.go:89] found id: ""
I1213 20:18:50.458148 69781 logs.go:282] 0 containers: []
W1213 20:18:50.458158 69781 logs.go:284] No container was found matching "kube-proxy"
I1213 20:18:50.458165 69781 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1213 20:18:50.458228 69781 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1213 20:18:50.497684 69781 cri.go:89] found id: ""
I1213 20:18:50.497715 69781 logs.go:282] 0 containers: []
W1213 20:18:50.497724 69781 logs.go:284] No container was found matching "kube-controller-manager"
I1213 20:18:50.497731 69781 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1213 20:18:50.497788 69781 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1213 20:18:50.536133 69781 cri.go:89] found id: ""
I1213 20:18:50.536162 69781 logs.go:282] 0 containers: []
W1213 20:18:50.536174 69781 logs.go:284] No container was found matching "kindnet"
I1213 20:18:50.536186 69781 logs.go:123] Gathering logs for CRI-O ...
I1213 20:18:50.536201 69781 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1213 20:18:50.660268 69781 logs.go:123] Gathering logs for container status ...
I1213 20:18:50.660307 69781 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1213 20:18:50.710938 69781 logs.go:123] Gathering logs for kubelet ...
I1213 20:18:50.710975 69781 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1213 20:18:50.761913 69781 logs.go:123] Gathering logs for dmesg ...
I1213 20:18:50.761948 69781 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1213 20:18:50.779769 69781 logs.go:123] Gathering logs for describe nodes ...
I1213 20:18:50.779809 69781 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1213 20:18:50.933511 69781 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
W1213 20:18:50.933547 69781 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W1213 20:18:50.933594 69781 out.go:270] *
*
W1213 20:18:50.933664 69781 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W1213 20:18:50.933692 69781 out.go:270] *
*
W1213 20:18:50.934660 69781 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I1213 20:18:50.937346 69781 out.go:201]
W1213 20:18:50.938622 69781 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W1213 20:18:50.938666 69781 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W1213 20:18:50.938696 69781 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I1213 20:18:50.940160 69781 out.go:201]
** /stderr **
start_stop_delete_test.go:186: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-613355 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-613355 -n old-k8s-version-613355
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-613355 -n old-k8s-version-613355: exit status 6 (254.153259ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E1213 20:18:51.238191 77685 status.go:458] kubeconfig endpoint: get endpoint: "old-k8s-version-613355" does not appear in /home/jenkins/minikube-integration/20090-12353/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-613355" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (300.65s)