=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-249342 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-249342 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (5m18.010520678s)
-- stdout --
* [old-k8s-version-249342] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=19265
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19265-12897/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19265-12897/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-249342" primary control-plane node in "old-k8s-version-249342" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0717 01:13:31.856766 55687 out.go:291] Setting OutFile to fd 1 ...
I0717 01:13:31.856850 55687 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0717 01:13:31.856870 55687 out.go:304] Setting ErrFile to fd 2...
I0717 01:13:31.856879 55687 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0717 01:13:31.857115 55687 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19265-12897/.minikube/bin
I0717 01:13:31.857654 55687 out.go:298] Setting JSON to false
I0717 01:13:31.858467 55687 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-13","uptime":6961,"bootTime":1721171851,"procs":186,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1062-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0717 01:13:31.858544 55687 start.go:139] virtualization: kvm guest
I0717 01:13:31.861580 55687 out.go:177] * [old-k8s-version-249342] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
I0717 01:13:31.863239 55687 notify.go:220] Checking for updates...
I0717 01:13:31.864665 55687 out.go:177] - MINIKUBE_LOCATION=19265
I0717 01:13:31.866816 55687 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0717 01:13:31.869106 55687 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19265-12897/kubeconfig
I0717 01:13:31.871171 55687 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19265-12897/.minikube
I0717 01:13:31.873512 55687 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0717 01:13:31.876958 55687 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0717 01:13:31.878361 55687 driver.go:392] Setting default libvirt URI to qemu:///system
I0717 01:13:31.918966 55687 out.go:177] * Using the kvm2 driver based on user configuration
I0717 01:13:31.920115 55687 start.go:297] selected driver: kvm2
I0717 01:13:31.920129 55687 start.go:901] validating driver "kvm2" against <nil>
I0717 01:13:31.920142 55687 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0717 01:13:31.920849 55687 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0717 01:13:31.947538 55687 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19265-12897/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0717 01:13:31.965354 55687 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.1
I0717 01:13:31.965406 55687 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0717 01:13:31.965686 55687 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0717 01:13:31.965728 55687 cni.go:84] Creating CNI manager for ""
I0717 01:13:31.965739 55687 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0717 01:13:31.965751 55687 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0717 01:13:31.965942 55687 start.go:340] cluster config:
{Name:old-k8s-version-249342 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721064868-19249@sha256:f2789f25c9e51cdeb9cef760e15dc838ef08abd5bb1913311c1eabedda231e8c Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-249342 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0717 01:13:31.966086 55687 iso.go:125] acquiring lock: {Name:mk54905fcd116c44dea86fc2fb31112b49cf1464 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0717 01:13:31.967827 55687 out.go:177] * Starting "old-k8s-version-249342" primary control-plane node in "old-k8s-version-249342" cluster
I0717 01:13:31.968949 55687 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0717 01:13:31.968991 55687 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19265-12897/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0717 01:13:31.969004 55687 cache.go:56] Caching tarball of preloaded images
I0717 01:13:31.969089 55687 preload.go:172] Found /home/jenkins/minikube-integration/19265-12897/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0717 01:13:31.969102 55687 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0717 01:13:31.969471 55687 profile.go:143] Saving config to /home/jenkins/minikube-integration/19265-12897/.minikube/profiles/old-k8s-version-249342/config.json ...
I0717 01:13:31.969498 55687 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19265-12897/.minikube/profiles/old-k8s-version-249342/config.json: {Name:mkab53322a0ec8a24a4992198fdf82ca1141cd43 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0717 01:13:31.969644 55687 start.go:360] acquireMachinesLock for old-k8s-version-249342: {Name:mk359f0954ab505b28ed2ad304bec72f6bc026ef Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0717 01:14:20.333452 55687 start.go:364] duration metric: took 48.363766516s to acquireMachinesLock for "old-k8s-version-249342"
I0717 01:14:20.333520 55687 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-249342 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19249/minikube-v1.33.1-1721037971-19249-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721064868-19249@sha256:f2789f25c9e51cdeb9cef760e15dc838ef08abd5bb1913311c1eabedda231e8c Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-249342 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0717 01:14:20.333644 55687 start.go:125] createHost starting for "" (driver="kvm2")
I0717 01:14:20.335425 55687 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0717 01:14:20.335622 55687 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0717 01:14:20.335677 55687 main.go:141] libmachine: Launching plugin server for driver kvm2
I0717 01:14:20.351952 55687 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39339
I0717 01:14:20.352363 55687 main.go:141] libmachine: () Calling .GetVersion
I0717 01:14:20.352960 55687 main.go:141] libmachine: Using API Version 1
I0717 01:14:20.352983 55687 main.go:141] libmachine: () Calling .SetConfigRaw
I0717 01:14:20.353403 55687 main.go:141] libmachine: () Calling .GetMachineName
I0717 01:14:20.353609 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetMachineName
I0717 01:14:20.353783 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .DriverName
I0717 01:14:20.353954 55687 start.go:159] libmachine.API.Create for "old-k8s-version-249342" (driver="kvm2")
I0717 01:14:20.353981 55687 client.go:168] LocalClient.Create starting
I0717 01:14:20.354020 55687 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19265-12897/.minikube/certs/ca.pem
I0717 01:14:20.354056 55687 main.go:141] libmachine: Decoding PEM data...
I0717 01:14:20.354077 55687 main.go:141] libmachine: Parsing certificate...
I0717 01:14:20.354141 55687 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19265-12897/.minikube/certs/cert.pem
I0717 01:14:20.354166 55687 main.go:141] libmachine: Decoding PEM data...
I0717 01:14:20.354188 55687 main.go:141] libmachine: Parsing certificate...
I0717 01:14:20.354214 55687 main.go:141] libmachine: Running pre-create checks...
I0717 01:14:20.354227 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .PreCreateCheck
I0717 01:14:20.354610 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetConfigRaw
I0717 01:14:20.354989 55687 main.go:141] libmachine: Creating machine...
I0717 01:14:20.355004 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .Create
I0717 01:14:20.355146 55687 main.go:141] libmachine: (old-k8s-version-249342) Creating KVM machine...
I0717 01:14:20.356417 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | found existing default KVM network
I0717 01:14:20.357603 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | I0717 01:14:20.357435 58445 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:b2:f4:2a} reservation:<nil>}
I0717 01:14:20.358485 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | I0717 01:14:20.358399 58445 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:dd:40:b1} reservation:<nil>}
I0717 01:14:20.359366 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | I0717 01:14:20.359290 58445 network.go:206] using free private subnet 192.168.61.0/24: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00028ec70}
I0717 01:14:20.359394 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | created network xml:
I0717 01:14:20.359412 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | <network>
I0717 01:14:20.359425 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | <name>mk-old-k8s-version-249342</name>
I0717 01:14:20.359440 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | <dns enable='no'/>
I0717 01:14:20.359712 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG |
I0717 01:14:20.359735 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | <ip address='192.168.61.1' netmask='255.255.255.0'>
I0717 01:14:20.359746 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | <dhcp>
I0717 01:14:20.359763 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | <range start='192.168.61.2' end='192.168.61.253'/>
I0717 01:14:20.359773 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | </dhcp>
I0717 01:14:20.359784 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | </ip>
I0717 01:14:20.359793 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG |
I0717 01:14:20.359804 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | </network>
I0717 01:14:20.359816 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG |
I0717 01:14:20.364536 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | trying to create private KVM network mk-old-k8s-version-249342 192.168.61.0/24...
I0717 01:14:20.432165 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | private KVM network mk-old-k8s-version-249342 192.168.61.0/24 created
I0717 01:14:20.432200 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | I0717 01:14:20.432130 58445 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19265-12897/.minikube
I0717 01:14:20.432216 55687 main.go:141] libmachine: (old-k8s-version-249342) Setting up store path in /home/jenkins/minikube-integration/19265-12897/.minikube/machines/old-k8s-version-249342 ...
I0717 01:14:20.432234 55687 main.go:141] libmachine: (old-k8s-version-249342) Building disk image from file:///home/jenkins/minikube-integration/19265-12897/.minikube/cache/iso/amd64/minikube-v1.33.1-1721037971-19249-amd64.iso
I0717 01:14:20.432373 55687 main.go:141] libmachine: (old-k8s-version-249342) Downloading /home/jenkins/minikube-integration/19265-12897/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19265-12897/.minikube/cache/iso/amd64/minikube-v1.33.1-1721037971-19249-amd64.iso...
I0717 01:14:20.681979 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | I0717 01:14:20.681861 58445 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19265-12897/.minikube/machines/old-k8s-version-249342/id_rsa...
I0717 01:14:20.992922 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | I0717 01:14:20.992830 58445 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19265-12897/.minikube/machines/old-k8s-version-249342/old-k8s-version-249342.rawdisk...
I0717 01:14:20.992948 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | Writing magic tar header
I0717 01:14:20.992960 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | Writing SSH key tar header
I0717 01:14:20.993066 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | I0717 01:14:20.992975 58445 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19265-12897/.minikube/machines/old-k8s-version-249342 ...
I0717 01:14:20.993117 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19265-12897/.minikube/machines/old-k8s-version-249342
I0717 01:14:20.993141 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19265-12897/.minikube/machines
I0717 01:14:20.993153 55687 main.go:141] libmachine: (old-k8s-version-249342) Setting executable bit set on /home/jenkins/minikube-integration/19265-12897/.minikube/machines/old-k8s-version-249342 (perms=drwx------)
I0717 01:14:20.993521 55687 main.go:141] libmachine: (old-k8s-version-249342) Setting executable bit set on /home/jenkins/minikube-integration/19265-12897/.minikube/machines (perms=drwxr-xr-x)
I0717 01:14:20.993551 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19265-12897/.minikube
I0717 01:14:20.993562 55687 main.go:141] libmachine: (old-k8s-version-249342) Setting executable bit set on /home/jenkins/minikube-integration/19265-12897/.minikube (perms=drwxr-xr-x)
I0717 01:14:20.993582 55687 main.go:141] libmachine: (old-k8s-version-249342) Setting executable bit set on /home/jenkins/minikube-integration/19265-12897 (perms=drwxrwxr-x)
I0717 01:14:20.993598 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19265-12897
I0717 01:14:20.993812 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0717 01:14:20.993876 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | Checking permissions on dir: /home/jenkins
I0717 01:14:20.993890 55687 main.go:141] libmachine: (old-k8s-version-249342) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0717 01:14:20.993908 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | Checking permissions on dir: /home
I0717 01:14:20.993943 55687 main.go:141] libmachine: (old-k8s-version-249342) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0717 01:14:20.993984 55687 main.go:141] libmachine: (old-k8s-version-249342) Creating domain...
I0717 01:14:20.993996 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | Skipping /home - not owner
I0717 01:14:20.995011 55687 main.go:141] libmachine: (old-k8s-version-249342) define libvirt domain using xml:
I0717 01:14:20.995032 55687 main.go:141] libmachine: (old-k8s-version-249342) <domain type='kvm'>
I0717 01:14:20.995044 55687 main.go:141] libmachine: (old-k8s-version-249342) <name>old-k8s-version-249342</name>
I0717 01:14:20.995054 55687 main.go:141] libmachine: (old-k8s-version-249342) <memory unit='MiB'>2200</memory>
I0717 01:14:20.995064 55687 main.go:141] libmachine: (old-k8s-version-249342) <vcpu>2</vcpu>
I0717 01:14:20.995071 55687 main.go:141] libmachine: (old-k8s-version-249342) <features>
I0717 01:14:20.995202 55687 main.go:141] libmachine: (old-k8s-version-249342) <acpi/>
I0717 01:14:20.995221 55687 main.go:141] libmachine: (old-k8s-version-249342) <apic/>
I0717 01:14:20.995232 55687 main.go:141] libmachine: (old-k8s-version-249342) <pae/>
I0717 01:14:20.995244 55687 main.go:141] libmachine: (old-k8s-version-249342)
I0717 01:14:20.995254 55687 main.go:141] libmachine: (old-k8s-version-249342) </features>
I0717 01:14:20.995281 55687 main.go:141] libmachine: (old-k8s-version-249342) <cpu mode='host-passthrough'>
I0717 01:14:20.995301 55687 main.go:141] libmachine: (old-k8s-version-249342)
I0717 01:14:20.995311 55687 main.go:141] libmachine: (old-k8s-version-249342) </cpu>
I0717 01:14:20.995320 55687 main.go:141] libmachine: (old-k8s-version-249342) <os>
I0717 01:14:20.995338 55687 main.go:141] libmachine: (old-k8s-version-249342) <type>hvm</type>
I0717 01:14:20.995348 55687 main.go:141] libmachine: (old-k8s-version-249342) <boot dev='cdrom'/>
I0717 01:14:20.995360 55687 main.go:141] libmachine: (old-k8s-version-249342) <boot dev='hd'/>
I0717 01:14:20.995371 55687 main.go:141] libmachine: (old-k8s-version-249342) <bootmenu enable='no'/>
I0717 01:14:20.995379 55687 main.go:141] libmachine: (old-k8s-version-249342) </os>
I0717 01:14:20.995392 55687 main.go:141] libmachine: (old-k8s-version-249342) <devices>
I0717 01:14:20.995419 55687 main.go:141] libmachine: (old-k8s-version-249342) <disk type='file' device='cdrom'>
I0717 01:14:20.995448 55687 main.go:141] libmachine: (old-k8s-version-249342) <source file='/home/jenkins/minikube-integration/19265-12897/.minikube/machines/old-k8s-version-249342/boot2docker.iso'/>
I0717 01:14:20.995472 55687 main.go:141] libmachine: (old-k8s-version-249342) <target dev='hdc' bus='scsi'/>
I0717 01:14:20.995484 55687 main.go:141] libmachine: (old-k8s-version-249342) <readonly/>
I0717 01:14:20.995495 55687 main.go:141] libmachine: (old-k8s-version-249342) </disk>
I0717 01:14:20.995518 55687 main.go:141] libmachine: (old-k8s-version-249342) <disk type='file' device='disk'>
I0717 01:14:20.995535 55687 main.go:141] libmachine: (old-k8s-version-249342) <driver name='qemu' type='raw' cache='default' io='threads' />
I0717 01:14:20.995559 55687 main.go:141] libmachine: (old-k8s-version-249342) <source file='/home/jenkins/minikube-integration/19265-12897/.minikube/machines/old-k8s-version-249342/old-k8s-version-249342.rawdisk'/>
I0717 01:14:20.995573 55687 main.go:141] libmachine: (old-k8s-version-249342) <target dev='hda' bus='virtio'/>
I0717 01:14:20.995585 55687 main.go:141] libmachine: (old-k8s-version-249342) </disk>
I0717 01:14:20.995596 55687 main.go:141] libmachine: (old-k8s-version-249342) <interface type='network'>
I0717 01:14:20.995610 55687 main.go:141] libmachine: (old-k8s-version-249342) <source network='mk-old-k8s-version-249342'/>
I0717 01:14:20.995623 55687 main.go:141] libmachine: (old-k8s-version-249342) <model type='virtio'/>
I0717 01:14:20.995640 55687 main.go:141] libmachine: (old-k8s-version-249342) </interface>
I0717 01:14:20.995654 55687 main.go:141] libmachine: (old-k8s-version-249342) <interface type='network'>
I0717 01:14:20.995667 55687 main.go:141] libmachine: (old-k8s-version-249342) <source network='default'/>
I0717 01:14:20.995679 55687 main.go:141] libmachine: (old-k8s-version-249342) <model type='virtio'/>
I0717 01:14:20.995690 55687 main.go:141] libmachine: (old-k8s-version-249342) </interface>
I0717 01:14:20.995705 55687 main.go:141] libmachine: (old-k8s-version-249342) <serial type='pty'>
I0717 01:14:20.995723 55687 main.go:141] libmachine: (old-k8s-version-249342) <target port='0'/>
I0717 01:14:20.995736 55687 main.go:141] libmachine: (old-k8s-version-249342) </serial>
I0717 01:14:20.995748 55687 main.go:141] libmachine: (old-k8s-version-249342) <console type='pty'>
I0717 01:14:20.995762 55687 main.go:141] libmachine: (old-k8s-version-249342) <target type='serial' port='0'/>
I0717 01:14:20.995774 55687 main.go:141] libmachine: (old-k8s-version-249342) </console>
I0717 01:14:20.995787 55687 main.go:141] libmachine: (old-k8s-version-249342) <rng model='virtio'>
I0717 01:14:20.995805 55687 main.go:141] libmachine: (old-k8s-version-249342) <backend model='random'>/dev/random</backend>
I0717 01:14:20.995823 55687 main.go:141] libmachine: (old-k8s-version-249342) </rng>
I0717 01:14:20.995834 55687 main.go:141] libmachine: (old-k8s-version-249342)
I0717 01:14:20.995844 55687 main.go:141] libmachine: (old-k8s-version-249342)
I0717 01:14:20.995856 55687 main.go:141] libmachine: (old-k8s-version-249342) </devices>
I0717 01:14:20.995868 55687 main.go:141] libmachine: (old-k8s-version-249342) </domain>
I0717 01:14:20.995885 55687 main.go:141] libmachine: (old-k8s-version-249342)
I0717 01:14:21.002375 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has defined MAC address 52:54:00:df:b8:fc in network default
I0717 01:14:21.002981 55687 main.go:141] libmachine: (old-k8s-version-249342) Ensuring networks are active...
I0717 01:14:21.002997 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has defined MAC address 52:54:00:f3:5b:b9 in network mk-old-k8s-version-249342
I0717 01:14:21.003746 55687 main.go:141] libmachine: (old-k8s-version-249342) Ensuring network default is active
I0717 01:14:21.004097 55687 main.go:141] libmachine: (old-k8s-version-249342) Ensuring network mk-old-k8s-version-249342 is active
I0717 01:14:21.004653 55687 main.go:141] libmachine: (old-k8s-version-249342) Getting domain xml...
I0717 01:14:21.005432 55687 main.go:141] libmachine: (old-k8s-version-249342) Creating domain...
I0717 01:14:22.290594 55687 main.go:141] libmachine: (old-k8s-version-249342) Waiting to get IP...
I0717 01:14:22.291489 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has defined MAC address 52:54:00:f3:5b:b9 in network mk-old-k8s-version-249342
I0717 01:14:22.291906 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | unable to find current IP address of domain old-k8s-version-249342 in network mk-old-k8s-version-249342
I0717 01:14:22.291954 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | I0717 01:14:22.291884 58445 retry.go:31] will retry after 304.227969ms: waiting for machine to come up
I0717 01:14:22.598358 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has defined MAC address 52:54:00:f3:5b:b9 in network mk-old-k8s-version-249342
I0717 01:14:22.598912 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | unable to find current IP address of domain old-k8s-version-249342 in network mk-old-k8s-version-249342
I0717 01:14:22.598936 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | I0717 01:14:22.598869 58445 retry.go:31] will retry after 346.643451ms: waiting for machine to come up
I0717 01:14:22.947506 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has defined MAC address 52:54:00:f3:5b:b9 in network mk-old-k8s-version-249342
I0717 01:14:22.947996 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | unable to find current IP address of domain old-k8s-version-249342 in network mk-old-k8s-version-249342
I0717 01:14:22.948021 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | I0717 01:14:22.947927 58445 retry.go:31] will retry after 459.147578ms: waiting for machine to come up
I0717 01:14:23.408605 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has defined MAC address 52:54:00:f3:5b:b9 in network mk-old-k8s-version-249342
I0717 01:14:23.409176 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | unable to find current IP address of domain old-k8s-version-249342 in network mk-old-k8s-version-249342
I0717 01:14:23.409203 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | I0717 01:14:23.409147 58445 retry.go:31] will retry after 570.096886ms: waiting for machine to come up
I0717 01:14:23.980249 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has defined MAC address 52:54:00:f3:5b:b9 in network mk-old-k8s-version-249342
I0717 01:14:23.980798 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | unable to find current IP address of domain old-k8s-version-249342 in network mk-old-k8s-version-249342
I0717 01:14:23.980822 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | I0717 01:14:23.980768 58445 retry.go:31] will retry after 643.263218ms: waiting for machine to come up
I0717 01:14:24.625732 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has defined MAC address 52:54:00:f3:5b:b9 in network mk-old-k8s-version-249342
I0717 01:14:24.626414 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | unable to find current IP address of domain old-k8s-version-249342 in network mk-old-k8s-version-249342
I0717 01:14:24.626439 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | I0717 01:14:24.626378 58445 retry.go:31] will retry after 709.097588ms: waiting for machine to come up
I0717 01:14:25.337450 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has defined MAC address 52:54:00:f3:5b:b9 in network mk-old-k8s-version-249342
I0717 01:14:25.337880 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | unable to find current IP address of domain old-k8s-version-249342 in network mk-old-k8s-version-249342
I0717 01:14:25.337910 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | I0717 01:14:25.337830 58445 retry.go:31] will retry after 777.716698ms: waiting for machine to come up
I0717 01:14:26.116980 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has defined MAC address 52:54:00:f3:5b:b9 in network mk-old-k8s-version-249342
I0717 01:14:26.117361 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | unable to find current IP address of domain old-k8s-version-249342 in network mk-old-k8s-version-249342
I0717 01:14:26.117393 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | I0717 01:14:26.117311 58445 retry.go:31] will retry after 1.042626118s: waiting for machine to come up
I0717 01:14:27.161148 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has defined MAC address 52:54:00:f3:5b:b9 in network mk-old-k8s-version-249342
I0717 01:14:27.161599 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | unable to find current IP address of domain old-k8s-version-249342 in network mk-old-k8s-version-249342
I0717 01:14:27.161631 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | I0717 01:14:27.161554 58445 retry.go:31] will retry after 1.326117277s: waiting for machine to come up
I0717 01:14:28.489933 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has defined MAC address 52:54:00:f3:5b:b9 in network mk-old-k8s-version-249342
I0717 01:14:28.490460 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | unable to find current IP address of domain old-k8s-version-249342 in network mk-old-k8s-version-249342
I0717 01:14:28.490487 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | I0717 01:14:28.490415 58445 retry.go:31] will retry after 2.257564527s: waiting for machine to come up
I0717 01:14:30.749563 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has defined MAC address 52:54:00:f3:5b:b9 in network mk-old-k8s-version-249342
I0717 01:14:30.750079 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | unable to find current IP address of domain old-k8s-version-249342 in network mk-old-k8s-version-249342
I0717 01:14:30.750107 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | I0717 01:14:30.750045 58445 retry.go:31] will retry after 1.939918369s: waiting for machine to come up
I0717 01:14:32.692261 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has defined MAC address 52:54:00:f3:5b:b9 in network mk-old-k8s-version-249342
I0717 01:14:32.692649 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | unable to find current IP address of domain old-k8s-version-249342 in network mk-old-k8s-version-249342
I0717 01:14:32.692688 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | I0717 01:14:32.692601 58445 retry.go:31] will retry after 2.861672699s: waiting for machine to come up
I0717 01:14:35.556129 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has defined MAC address 52:54:00:f3:5b:b9 in network mk-old-k8s-version-249342
I0717 01:14:35.556484 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | unable to find current IP address of domain old-k8s-version-249342 in network mk-old-k8s-version-249342
I0717 01:14:35.556506 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | I0717 01:14:35.556432 58445 retry.go:31] will retry after 2.875372571s: waiting for machine to come up
I0717 01:14:38.435321 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has defined MAC address 52:54:00:f3:5b:b9 in network mk-old-k8s-version-249342
I0717 01:14:38.435736 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | unable to find current IP address of domain old-k8s-version-249342 in network mk-old-k8s-version-249342
I0717 01:14:38.435765 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | I0717 01:14:38.435694 58445 retry.go:31] will retry after 4.687464094s: waiting for machine to come up
I0717 01:14:43.125562 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has defined MAC address 52:54:00:f3:5b:b9 in network mk-old-k8s-version-249342
I0717 01:14:43.126065 55687 main.go:141] libmachine: (old-k8s-version-249342) Found IP for machine: 192.168.61.13
I0717 01:14:43.126111 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has current primary IP address 192.168.61.13 and MAC address 52:54:00:f3:5b:b9 in network mk-old-k8s-version-249342
I0717 01:14:43.126131 55687 main.go:141] libmachine: (old-k8s-version-249342) Reserving static IP address...
I0717 01:14:43.126498 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-249342", mac: "52:54:00:f3:5b:b9", ip: "192.168.61.13"} in network mk-old-k8s-version-249342
I0717 01:14:43.195806 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | Getting to WaitForSSH function...
I0717 01:14:43.195831 55687 main.go:141] libmachine: (old-k8s-version-249342) Reserved static IP address: 192.168.61.13
I0717 01:14:43.195845 55687 main.go:141] libmachine: (old-k8s-version-249342) Waiting for SSH to be available...
I0717 01:14:43.198471 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has defined MAC address 52:54:00:f3:5b:b9 in network mk-old-k8s-version-249342
I0717 01:14:43.198892 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f3:5b:b9", ip: ""} in network mk-old-k8s-version-249342: {Iface:virbr3 ExpiryTime:2024-07-17 02:14:35 +0000 UTC Type:0 Mac:52:54:00:f3:5b:b9 Iaid: IPaddr:192.168.61.13 Prefix:24 Hostname:minikube Clientid:01:52:54:00:f3:5b:b9}
I0717 01:14:43.198923 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has defined IP address 192.168.61.13 and MAC address 52:54:00:f3:5b:b9 in network mk-old-k8s-version-249342
I0717 01:14:43.199175 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | Using SSH client type: external
I0717 01:14:43.199203 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | Using SSH private key: /home/jenkins/minikube-integration/19265-12897/.minikube/machines/old-k8s-version-249342/id_rsa (-rw-------)
I0717 01:14:43.199256 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.61.13 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19265-12897/.minikube/machines/old-k8s-version-249342/id_rsa -p 22] /usr/bin/ssh <nil>}
I0717 01:14:43.199270 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | About to run SSH command:
I0717 01:14:43.199282 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | exit 0
I0717 01:14:43.320542 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | SSH cmd err, output: <nil>:
I0717 01:14:43.320827 55687 main.go:141] libmachine: (old-k8s-version-249342) KVM machine creation complete!
I0717 01:14:43.321101 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetConfigRaw
I0717 01:14:43.321579 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .DriverName
I0717 01:14:43.321756 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .DriverName
I0717 01:14:43.321933 55687 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0717 01:14:43.321948 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetState
I0717 01:14:43.323355 55687 main.go:141] libmachine: Detecting operating system of created instance...
I0717 01:14:43.323368 55687 main.go:141] libmachine: Waiting for SSH to be available...
I0717 01:14:43.323373 55687 main.go:141] libmachine: Getting to WaitForSSH function...
I0717 01:14:43.323379 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetSSHHostname
I0717 01:14:43.325557 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has defined MAC address 52:54:00:f3:5b:b9 in network mk-old-k8s-version-249342
I0717 01:14:43.325900 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f3:5b:b9", ip: ""} in network mk-old-k8s-version-249342: {Iface:virbr3 ExpiryTime:2024-07-17 02:14:35 +0000 UTC Type:0 Mac:52:54:00:f3:5b:b9 Iaid: IPaddr:192.168.61.13 Prefix:24 Hostname:old-k8s-version-249342 Clientid:01:52:54:00:f3:5b:b9}
I0717 01:14:43.325945 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has defined IP address 192.168.61.13 and MAC address 52:54:00:f3:5b:b9 in network mk-old-k8s-version-249342
I0717 01:14:43.326204 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetSSHPort
I0717 01:14:43.326370 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetSSHKeyPath
I0717 01:14:43.326545 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetSSHKeyPath
I0717 01:14:43.326682 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetSSHUsername
I0717 01:14:43.326828 55687 main.go:141] libmachine: Using SSH client type: native
I0717 01:14:43.327024 55687 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da20] 0x830780 <nil> [] 0s} 192.168.61.13 22 <nil> <nil>}
I0717 01:14:43.327039 55687 main.go:141] libmachine: About to run SSH command:
exit 0
I0717 01:14:43.427583 55687 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0717 01:14:43.427604 55687 main.go:141] libmachine: Detecting the provisioner...
I0717 01:14:43.427612 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetSSHHostname
I0717 01:14:43.430440 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has defined MAC address 52:54:00:f3:5b:b9 in network mk-old-k8s-version-249342
I0717 01:14:43.430734 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f3:5b:b9", ip: ""} in network mk-old-k8s-version-249342: {Iface:virbr3 ExpiryTime:2024-07-17 02:14:35 +0000 UTC Type:0 Mac:52:54:00:f3:5b:b9 Iaid: IPaddr:192.168.61.13 Prefix:24 Hostname:old-k8s-version-249342 Clientid:01:52:54:00:f3:5b:b9}
I0717 01:14:43.430768 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has defined IP address 192.168.61.13 and MAC address 52:54:00:f3:5b:b9 in network mk-old-k8s-version-249342
I0717 01:14:43.430933 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetSSHPort
I0717 01:14:43.431110 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetSSHKeyPath
I0717 01:14:43.431293 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetSSHKeyPath
I0717 01:14:43.431414 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetSSHUsername
I0717 01:14:43.431567 55687 main.go:141] libmachine: Using SSH client type: native
I0717 01:14:43.431786 55687 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da20] 0x830780 <nil> [] 0s} 192.168.61.13 22 <nil> <nil>}
I0717 01:14:43.431801 55687 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0717 01:14:43.533610 55687 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0717 01:14:43.533675 55687 main.go:141] libmachine: found compatible host: buildroot
I0717 01:14:43.533687 55687 main.go:141] libmachine: Provisioning with buildroot...
I0717 01:14:43.533700 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetMachineName
I0717 01:14:43.534020 55687 buildroot.go:166] provisioning hostname "old-k8s-version-249342"
I0717 01:14:43.534052 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetMachineName
I0717 01:14:43.534247 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetSSHHostname
I0717 01:14:43.536889 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has defined MAC address 52:54:00:f3:5b:b9 in network mk-old-k8s-version-249342
I0717 01:14:43.537301 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f3:5b:b9", ip: ""} in network mk-old-k8s-version-249342: {Iface:virbr3 ExpiryTime:2024-07-17 02:14:35 +0000 UTC Type:0 Mac:52:54:00:f3:5b:b9 Iaid: IPaddr:192.168.61.13 Prefix:24 Hostname:old-k8s-version-249342 Clientid:01:52:54:00:f3:5b:b9}
I0717 01:14:43.537326 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has defined IP address 192.168.61.13 and MAC address 52:54:00:f3:5b:b9 in network mk-old-k8s-version-249342
I0717 01:14:43.537543 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetSSHPort
I0717 01:14:43.537768 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetSSHKeyPath
I0717 01:14:43.537953 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetSSHKeyPath
I0717 01:14:43.538092 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetSSHUsername
I0717 01:14:43.538274 55687 main.go:141] libmachine: Using SSH client type: native
I0717 01:14:43.538522 55687 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da20] 0x830780 <nil> [] 0s} 192.168.61.13 22 <nil> <nil>}
I0717 01:14:43.538542 55687 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-249342 && echo "old-k8s-version-249342" | sudo tee /etc/hostname
I0717 01:14:43.657709 55687 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-249342
I0717 01:14:43.657733 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetSSHHostname
I0717 01:14:43.660665 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has defined MAC address 52:54:00:f3:5b:b9 in network mk-old-k8s-version-249342
I0717 01:14:43.661035 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f3:5b:b9", ip: ""} in network mk-old-k8s-version-249342: {Iface:virbr3 ExpiryTime:2024-07-17 02:14:35 +0000 UTC Type:0 Mac:52:54:00:f3:5b:b9 Iaid: IPaddr:192.168.61.13 Prefix:24 Hostname:old-k8s-version-249342 Clientid:01:52:54:00:f3:5b:b9}
I0717 01:14:43.661064 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has defined IP address 192.168.61.13 and MAC address 52:54:00:f3:5b:b9 in network mk-old-k8s-version-249342
I0717 01:14:43.661217 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetSSHPort
I0717 01:14:43.661418 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetSSHKeyPath
I0717 01:14:43.661567 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetSSHKeyPath
I0717 01:14:43.661702 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetSSHUsername
I0717 01:14:43.661962 55687 main.go:141] libmachine: Using SSH client type: native
I0717 01:14:43.662136 55687 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da20] 0x830780 <nil> [] 0s} 192.168.61.13 22 <nil> <nil>}
I0717 01:14:43.662154 55687 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-249342' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-249342/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-249342' | sudo tee -a /etc/hosts;
fi
fi
I0717 01:14:43.773499 55687 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0717 01:14:43.773531 55687 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19265-12897/.minikube CaCertPath:/home/jenkins/minikube-integration/19265-12897/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19265-12897/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19265-12897/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19265-12897/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19265-12897/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19265-12897/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19265-12897/.minikube}
I0717 01:14:43.773576 55687 buildroot.go:174] setting up certificates
I0717 01:14:43.773598 55687 provision.go:84] configureAuth start
I0717 01:14:43.773612 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetMachineName
I0717 01:14:43.773887 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetIP
I0717 01:14:43.776481 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has defined MAC address 52:54:00:f3:5b:b9 in network mk-old-k8s-version-249342
I0717 01:14:43.776910 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f3:5b:b9", ip: ""} in network mk-old-k8s-version-249342: {Iface:virbr3 ExpiryTime:2024-07-17 02:14:35 +0000 UTC Type:0 Mac:52:54:00:f3:5b:b9 Iaid: IPaddr:192.168.61.13 Prefix:24 Hostname:old-k8s-version-249342 Clientid:01:52:54:00:f3:5b:b9}
I0717 01:14:43.776938 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has defined IP address 192.168.61.13 and MAC address 52:54:00:f3:5b:b9 in network mk-old-k8s-version-249342
I0717 01:14:43.777034 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetSSHHostname
I0717 01:14:43.779091 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has defined MAC address 52:54:00:f3:5b:b9 in network mk-old-k8s-version-249342
I0717 01:14:43.779391 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f3:5b:b9", ip: ""} in network mk-old-k8s-version-249342: {Iface:virbr3 ExpiryTime:2024-07-17 02:14:35 +0000 UTC Type:0 Mac:52:54:00:f3:5b:b9 Iaid: IPaddr:192.168.61.13 Prefix:24 Hostname:old-k8s-version-249342 Clientid:01:52:54:00:f3:5b:b9}
I0717 01:14:43.779421 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has defined IP address 192.168.61.13 and MAC address 52:54:00:f3:5b:b9 in network mk-old-k8s-version-249342
I0717 01:14:43.779552 55687 provision.go:143] copyHostCerts
I0717 01:14:43.779611 55687 exec_runner.go:144] found /home/jenkins/minikube-integration/19265-12897/.minikube/ca.pem, removing ...
I0717 01:14:43.779623 55687 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19265-12897/.minikube/ca.pem
I0717 01:14:43.779679 55687 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19265-12897/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19265-12897/.minikube/ca.pem (1082 bytes)
I0717 01:14:43.779767 55687 exec_runner.go:144] found /home/jenkins/minikube-integration/19265-12897/.minikube/cert.pem, removing ...
I0717 01:14:43.779776 55687 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19265-12897/.minikube/cert.pem
I0717 01:14:43.779797 55687 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19265-12897/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19265-12897/.minikube/cert.pem (1123 bytes)
I0717 01:14:43.779845 55687 exec_runner.go:144] found /home/jenkins/minikube-integration/19265-12897/.minikube/key.pem, removing ...
I0717 01:14:43.779852 55687 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19265-12897/.minikube/key.pem
I0717 01:14:43.779874 55687 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19265-12897/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19265-12897/.minikube/key.pem (1675 bytes)
I0717 01:14:43.779915 55687 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19265-12897/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19265-12897/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19265-12897/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-249342 san=[127.0.0.1 192.168.61.13 localhost minikube old-k8s-version-249342]
I0717 01:14:43.849018 55687 provision.go:177] copyRemoteCerts
I0717 01:14:43.849070 55687 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0717 01:14:43.849100 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetSSHHostname
I0717 01:14:43.851463 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has defined MAC address 52:54:00:f3:5b:b9 in network mk-old-k8s-version-249342
I0717 01:14:43.851706 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f3:5b:b9", ip: ""} in network mk-old-k8s-version-249342: {Iface:virbr3 ExpiryTime:2024-07-17 02:14:35 +0000 UTC Type:0 Mac:52:54:00:f3:5b:b9 Iaid: IPaddr:192.168.61.13 Prefix:24 Hostname:old-k8s-version-249342 Clientid:01:52:54:00:f3:5b:b9}
I0717 01:14:43.851748 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has defined IP address 192.168.61.13 and MAC address 52:54:00:f3:5b:b9 in network mk-old-k8s-version-249342
I0717 01:14:43.851871 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetSSHPort
I0717 01:14:43.852054 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetSSHKeyPath
I0717 01:14:43.852211 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetSSHUsername
I0717 01:14:43.852345 55687 sshutil.go:53] new ssh client: &{IP:192.168.61.13 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19265-12897/.minikube/machines/old-k8s-version-249342/id_rsa Username:docker}
I0717 01:14:43.934225 55687 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19265-12897/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0717 01:14:43.959759 55687 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19265-12897/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0717 01:14:43.985639 55687 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19265-12897/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0717 01:14:44.012549 55687 provision.go:87] duration metric: took 238.936027ms to configureAuth
I0717 01:14:44.012596 55687 buildroot.go:189] setting minikube options for container-runtime
I0717 01:14:44.012801 55687 config.go:182] Loaded profile config "old-k8s-version-249342": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0717 01:14:44.012898 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetSSHHostname
I0717 01:14:44.015645 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has defined MAC address 52:54:00:f3:5b:b9 in network mk-old-k8s-version-249342
I0717 01:14:44.016046 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f3:5b:b9", ip: ""} in network mk-old-k8s-version-249342: {Iface:virbr3 ExpiryTime:2024-07-17 02:14:35 +0000 UTC Type:0 Mac:52:54:00:f3:5b:b9 Iaid: IPaddr:192.168.61.13 Prefix:24 Hostname:old-k8s-version-249342 Clientid:01:52:54:00:f3:5b:b9}
I0717 01:14:44.016072 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has defined IP address 192.168.61.13 and MAC address 52:54:00:f3:5b:b9 in network mk-old-k8s-version-249342
I0717 01:14:44.016223 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetSSHPort
I0717 01:14:44.016413 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetSSHKeyPath
I0717 01:14:44.016552 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetSSHKeyPath
I0717 01:14:44.016683 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetSSHUsername
I0717 01:14:44.016870 55687 main.go:141] libmachine: Using SSH client type: native
I0717 01:14:44.017062 55687 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da20] 0x830780 <nil> [] 0s} 192.168.61.13 22 <nil> <nil>}
I0717 01:14:44.017085 55687 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0717 01:14:44.276745 55687 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0717 01:14:44.276766 55687 main.go:141] libmachine: Checking connection to Docker...
I0717 01:14:44.276774 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetURL
I0717 01:14:44.278017 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | Using libvirt version 6000000
I0717 01:14:44.279902 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has defined MAC address 52:54:00:f3:5b:b9 in network mk-old-k8s-version-249342
I0717 01:14:44.280367 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f3:5b:b9", ip: ""} in network mk-old-k8s-version-249342: {Iface:virbr3 ExpiryTime:2024-07-17 02:14:35 +0000 UTC Type:0 Mac:52:54:00:f3:5b:b9 Iaid: IPaddr:192.168.61.13 Prefix:24 Hostname:old-k8s-version-249342 Clientid:01:52:54:00:f3:5b:b9}
I0717 01:14:44.280395 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has defined IP address 192.168.61.13 and MAC address 52:54:00:f3:5b:b9 in network mk-old-k8s-version-249342
I0717 01:14:44.280604 55687 main.go:141] libmachine: Docker is up and running!
I0717 01:14:44.280620 55687 main.go:141] libmachine: Reticulating splines...
I0717 01:14:44.280628 55687 client.go:171] duration metric: took 23.926639605s to LocalClient.Create
I0717 01:14:44.280649 55687 start.go:167] duration metric: took 23.926697415s to libmachine.API.Create "old-k8s-version-249342"
I0717 01:14:44.280658 55687 start.go:293] postStartSetup for "old-k8s-version-249342" (driver="kvm2")
I0717 01:14:44.280667 55687 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0717 01:14:44.280687 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .DriverName
I0717 01:14:44.280910 55687 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0717 01:14:44.280934 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetSSHHostname
I0717 01:14:44.283134 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has defined MAC address 52:54:00:f3:5b:b9 in network mk-old-k8s-version-249342
I0717 01:14:44.283415 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f3:5b:b9", ip: ""} in network mk-old-k8s-version-249342: {Iface:virbr3 ExpiryTime:2024-07-17 02:14:35 +0000 UTC Type:0 Mac:52:54:00:f3:5b:b9 Iaid: IPaddr:192.168.61.13 Prefix:24 Hostname:old-k8s-version-249342 Clientid:01:52:54:00:f3:5b:b9}
I0717 01:14:44.283441 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has defined IP address 192.168.61.13 and MAC address 52:54:00:f3:5b:b9 in network mk-old-k8s-version-249342
I0717 01:14:44.283576 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetSSHPort
I0717 01:14:44.283746 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetSSHKeyPath
I0717 01:14:44.283899 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetSSHUsername
I0717 01:14:44.284018 55687 sshutil.go:53] new ssh client: &{IP:192.168.61.13 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19265-12897/.minikube/machines/old-k8s-version-249342/id_rsa Username:docker}
I0717 01:14:44.362811 55687 ssh_runner.go:195] Run: cat /etc/os-release
I0717 01:14:44.366958 55687 info.go:137] Remote host: Buildroot 2023.02.9
I0717 01:14:44.366979 55687 filesync.go:126] Scanning /home/jenkins/minikube-integration/19265-12897/.minikube/addons for local assets ...
I0717 01:14:44.367033 55687 filesync.go:126] Scanning /home/jenkins/minikube-integration/19265-12897/.minikube/files for local assets ...
I0717 01:14:44.367105 55687 filesync.go:149] local asset: /home/jenkins/minikube-integration/19265-12897/.minikube/files/etc/ssl/certs/200682.pem -> 200682.pem in /etc/ssl/certs
I0717 01:14:44.367180 55687 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0717 01:14:44.376456 55687 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19265-12897/.minikube/files/etc/ssl/certs/200682.pem --> /etc/ssl/certs/200682.pem (1708 bytes)
I0717 01:14:44.399892 55687 start.go:296] duration metric: took 119.220991ms for postStartSetup
I0717 01:14:44.399939 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetConfigRaw
I0717 01:14:44.400629 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetIP
I0717 01:14:44.403762 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has defined MAC address 52:54:00:f3:5b:b9 in network mk-old-k8s-version-249342
I0717 01:14:44.404153 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f3:5b:b9", ip: ""} in network mk-old-k8s-version-249342: {Iface:virbr3 ExpiryTime:2024-07-17 02:14:35 +0000 UTC Type:0 Mac:52:54:00:f3:5b:b9 Iaid: IPaddr:192.168.61.13 Prefix:24 Hostname:old-k8s-version-249342 Clientid:01:52:54:00:f3:5b:b9}
I0717 01:14:44.404176 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has defined IP address 192.168.61.13 and MAC address 52:54:00:f3:5b:b9 in network mk-old-k8s-version-249342
I0717 01:14:44.404432 55687 profile.go:143] Saving config to /home/jenkins/minikube-integration/19265-12897/.minikube/profiles/old-k8s-version-249342/config.json ...
I0717 01:14:44.404648 55687 start.go:128] duration metric: took 24.070992233s to createHost
I0717 01:14:44.404674 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetSSHHostname
I0717 01:14:44.406995 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has defined MAC address 52:54:00:f3:5b:b9 in network mk-old-k8s-version-249342
I0717 01:14:44.407362 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f3:5b:b9", ip: ""} in network mk-old-k8s-version-249342: {Iface:virbr3 ExpiryTime:2024-07-17 02:14:35 +0000 UTC Type:0 Mac:52:54:00:f3:5b:b9 Iaid: IPaddr:192.168.61.13 Prefix:24 Hostname:old-k8s-version-249342 Clientid:01:52:54:00:f3:5b:b9}
I0717 01:14:44.407391 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has defined IP address 192.168.61.13 and MAC address 52:54:00:f3:5b:b9 in network mk-old-k8s-version-249342
I0717 01:14:44.407494 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetSSHPort
I0717 01:14:44.407678 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetSSHKeyPath
I0717 01:14:44.407828 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetSSHKeyPath
I0717 01:14:44.408012 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetSSHUsername
I0717 01:14:44.408192 55687 main.go:141] libmachine: Using SSH client type: native
I0717 01:14:44.408350 55687 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da20] 0x830780 <nil> [] 0s} 192.168.61.13 22 <nil> <nil>}
I0717 01:14:44.408365 55687 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0717 01:14:44.509495 55687 main.go:141] libmachine: SSH cmd err, output: <nil>: 1721178884.480448195
I0717 01:14:44.509523 55687 fix.go:216] guest clock: 1721178884.480448195
I0717 01:14:44.509533 55687 fix.go:229] Guest: 2024-07-17 01:14:44.480448195 +0000 UTC Remote: 2024-07-17 01:14:44.404661268 +0000 UTC m=+72.595309457 (delta=75.786927ms)
I0717 01:14:44.509551 55687 fix.go:200] guest clock delta is within tolerance: 75.786927ms
I0717 01:14:44.509555 55687 start.go:83] releasing machines lock for "old-k8s-version-249342", held for 24.176075235s
I0717 01:14:44.509579 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .DriverName
I0717 01:14:44.509892 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetIP
I0717 01:14:44.513234 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has defined MAC address 52:54:00:f3:5b:b9 in network mk-old-k8s-version-249342
I0717 01:14:44.513677 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f3:5b:b9", ip: ""} in network mk-old-k8s-version-249342: {Iface:virbr3 ExpiryTime:2024-07-17 02:14:35 +0000 UTC Type:0 Mac:52:54:00:f3:5b:b9 Iaid: IPaddr:192.168.61.13 Prefix:24 Hostname:old-k8s-version-249342 Clientid:01:52:54:00:f3:5b:b9}
I0717 01:14:44.513713 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has defined IP address 192.168.61.13 and MAC address 52:54:00:f3:5b:b9 in network mk-old-k8s-version-249342
I0717 01:14:44.513885 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .DriverName
I0717 01:14:44.514442 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .DriverName
I0717 01:14:44.514616 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .DriverName
I0717 01:14:44.514702 55687 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0717 01:14:44.514741 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetSSHHostname
I0717 01:14:44.514822 55687 ssh_runner.go:195] Run: cat /version.json
I0717 01:14:44.514845 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetSSHHostname
I0717 01:14:44.517694 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has defined MAC address 52:54:00:f3:5b:b9 in network mk-old-k8s-version-249342
I0717 01:14:44.518059 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f3:5b:b9", ip: ""} in network mk-old-k8s-version-249342: {Iface:virbr3 ExpiryTime:2024-07-17 02:14:35 +0000 UTC Type:0 Mac:52:54:00:f3:5b:b9 Iaid: IPaddr:192.168.61.13 Prefix:24 Hostname:old-k8s-version-249342 Clientid:01:52:54:00:f3:5b:b9}
I0717 01:14:44.518104 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has defined IP address 192.168.61.13 and MAC address 52:54:00:f3:5b:b9 in network mk-old-k8s-version-249342
I0717 01:14:44.518127 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has defined MAC address 52:54:00:f3:5b:b9 in network mk-old-k8s-version-249342
I0717 01:14:44.518360 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetSSHPort
I0717 01:14:44.518497 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f3:5b:b9", ip: ""} in network mk-old-k8s-version-249342: {Iface:virbr3 ExpiryTime:2024-07-17 02:14:35 +0000 UTC Type:0 Mac:52:54:00:f3:5b:b9 Iaid: IPaddr:192.168.61.13 Prefix:24 Hostname:old-k8s-version-249342 Clientid:01:52:54:00:f3:5b:b9}
I0717 01:14:44.518514 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has defined IP address 192.168.61.13 and MAC address 52:54:00:f3:5b:b9 in network mk-old-k8s-version-249342
I0717 01:14:44.518547 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetSSHKeyPath
I0717 01:14:44.518678 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetSSHUsername
I0717 01:14:44.518794 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetSSHPort
I0717 01:14:44.518858 55687 sshutil.go:53] new ssh client: &{IP:192.168.61.13 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19265-12897/.minikube/machines/old-k8s-version-249342/id_rsa Username:docker}
I0717 01:14:44.518944 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetSSHKeyPath
I0717 01:14:44.519090 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetSSHUsername
I0717 01:14:44.519208 55687 sshutil.go:53] new ssh client: &{IP:192.168.61.13 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19265-12897/.minikube/machines/old-k8s-version-249342/id_rsa Username:docker}
I0717 01:14:44.602702 55687 ssh_runner.go:195] Run: systemctl --version
I0717 01:14:44.629407 55687 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0717 01:14:44.788605 55687 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0717 01:14:44.794920 55687 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0717 01:14:44.794993 55687 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0717 01:14:44.811599 55687 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0717 01:14:44.811626 55687 start.go:495] detecting cgroup driver to use...
I0717 01:14:44.811681 55687 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0717 01:14:44.832431 55687 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0717 01:14:44.846755 55687 docker.go:217] disabling cri-docker service (if available) ...
I0717 01:14:44.846811 55687 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0717 01:14:44.862774 55687 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0717 01:14:44.878158 55687 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0717 01:14:45.009328 55687 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0717 01:14:45.187310 55687 docker.go:233] disabling docker service ...
I0717 01:14:45.187370 55687 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0717 01:14:45.204041 55687 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0717 01:14:45.225671 55687 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0717 01:14:45.368019 55687 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0717 01:14:45.494588 55687 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0717 01:14:45.511411 55687 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0717 01:14:45.532311 55687 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0717 01:14:45.532375 55687 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0717 01:14:45.543304 55687 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0717 01:14:45.543373 55687 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0717 01:14:45.554089 55687 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0717 01:14:45.564645 55687 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0717 01:14:45.575695 55687 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0717 01:14:45.586414 55687 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0717 01:14:45.595329 55687 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0717 01:14:45.595382 55687 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0717 01:14:45.608983 55687 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0717 01:14:45.620442 55687 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0717 01:14:45.758706 55687 ssh_runner.go:195] Run: sudo systemctl restart crio
I0717 01:14:45.901295 55687 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0717 01:14:45.901367 55687 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0717 01:14:45.906300 55687 start.go:563] Will wait 60s for crictl version
I0717 01:14:45.906365 55687 ssh_runner.go:195] Run: which crictl
I0717 01:14:45.910229 55687 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0717 01:14:45.949515 55687 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0717 01:14:45.949594 55687 ssh_runner.go:195] Run: crio --version
I0717 01:14:45.979033 55687 ssh_runner.go:195] Run: crio --version
I0717 01:14:46.015438 55687 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0717 01:14:46.016829 55687 main.go:141] libmachine: (old-k8s-version-249342) Calling .GetIP
I0717 01:14:46.019620 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has defined MAC address 52:54:00:f3:5b:b9 in network mk-old-k8s-version-249342
I0717 01:14:46.020008 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f3:5b:b9", ip: ""} in network mk-old-k8s-version-249342: {Iface:virbr3 ExpiryTime:2024-07-17 02:14:35 +0000 UTC Type:0 Mac:52:54:00:f3:5b:b9 Iaid: IPaddr:192.168.61.13 Prefix:24 Hostname:old-k8s-version-249342 Clientid:01:52:54:00:f3:5b:b9}
I0717 01:14:46.020045 55687 main.go:141] libmachine: (old-k8s-version-249342) DBG | domain old-k8s-version-249342 has defined IP address 192.168.61.13 and MAC address 52:54:00:f3:5b:b9 in network mk-old-k8s-version-249342
I0717 01:14:46.020342 55687 ssh_runner.go:195] Run: grep 192.168.61.1 host.minikube.internal$ /etc/hosts
I0717 01:14:46.024863 55687 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.61.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0717 01:14:46.039856 55687 kubeadm.go:883] updating cluster {Name:old-k8s-version-249342 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19249/minikube-v1.33.1-1721037971-19249-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721064868-19249@sha256:f2789f25c9e51cdeb9cef760e15dc838ef08abd5bb1913311c1eabedda231e8c Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-249342 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.13 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mo
untPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0717 01:14:46.039988 55687 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0717 01:14:46.040052 55687 ssh_runner.go:195] Run: sudo crictl images --output json
I0717 01:14:46.080215 55687 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0717 01:14:46.080280 55687 ssh_runner.go:195] Run: which lz4
I0717 01:14:46.086306 55687 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0717 01:14:46.090568 55687 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0717 01:14:46.090598 55687 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19265-12897/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0717 01:14:47.804350 55687 crio.go:462] duration metric: took 1.718080296s to copy over tarball
I0717 01:14:47.804413 55687 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0717 01:14:50.464065 55687 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.659625388s)
I0717 01:14:50.464095 55687 crio.go:469] duration metric: took 2.659719429s to extract the tarball
I0717 01:14:50.464113 55687 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0717 01:14:50.507765 55687 ssh_runner.go:195] Run: sudo crictl images --output json
I0717 01:14:50.553545 55687 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0717 01:14:50.553570 55687 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0717 01:14:50.553631 55687 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0717 01:14:50.553683 55687 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0717 01:14:50.553721 55687 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0717 01:14:50.553743 55687 image.go:134] retrieving image: registry.k8s.io/pause:3.2
I0717 01:14:50.553753 55687 image.go:134] retrieving image: registry.k8s.io/coredns:1.7.0
I0717 01:14:50.553697 55687 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0717 01:14:50.553966 55687 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0717 01:14:50.554113 55687 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0717 01:14:50.555422 55687 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0717 01:14:50.555465 55687 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0717 01:14:50.555418 55687 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0717 01:14:50.555483 55687 image.go:177] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0717 01:14:50.555818 55687 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0717 01:14:50.556045 55687 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0717 01:14:50.557653 55687 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0717 01:14:50.557861 55687 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0717 01:14:50.707517 55687 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0717 01:14:50.714112 55687 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0717 01:14:50.716387 55687 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0717 01:14:50.716836 55687 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0717 01:14:50.717179 55687 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0717 01:14:50.717806 55687 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0717 01:14:50.806756 55687 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0717 01:14:50.842418 55687 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0717 01:14:50.842465 55687 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0717 01:14:50.842516 55687 ssh_runner.go:195] Run: which crictl
I0717 01:14:50.843531 55687 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0717 01:14:50.855988 55687 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0717 01:14:50.856039 55687 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0717 01:14:50.856087 55687 ssh_runner.go:195] Run: which crictl
I0717 01:14:50.886426 55687 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0717 01:14:50.886482 55687 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0717 01:14:50.886486 55687 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0717 01:14:50.886522 55687 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0717 01:14:50.886574 55687 ssh_runner.go:195] Run: which crictl
I0717 01:14:50.886531 55687 ssh_runner.go:195] Run: which crictl
I0717 01:14:50.905650 55687 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0717 01:14:50.905694 55687 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0717 01:14:50.905737 55687 ssh_runner.go:195] Run: which crictl
I0717 01:14:50.905735 55687 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0717 01:14:50.905808 55687 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0717 01:14:50.905872 55687 ssh_runner.go:195] Run: which crictl
I0717 01:14:50.926835 55687 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0717 01:14:50.926904 55687 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0717 01:14:50.926943 55687 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0717 01:14:50.926985 55687 ssh_runner.go:195] Run: which crictl
I0717 01:14:51.058978 55687 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0717 01:14:51.058995 55687 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0717 01:14:51.059018 55687 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0717 01:14:51.059056 55687 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0717 01:14:51.059078 55687 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0717 01:14:51.059117 55687 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19265-12897/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0717 01:14:51.059167 55687 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0717 01:14:51.182357 55687 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19265-12897/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0717 01:14:51.182562 55687 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19265-12897/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0717 01:14:51.192856 55687 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19265-12897/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0717 01:14:51.199079 55687 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19265-12897/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0717 01:14:51.199166 55687 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19265-12897/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0717 01:14:51.199201 55687 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19265-12897/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0717 01:14:51.199384 55687 cache_images.go:92] duration metric: took 645.799066ms to LoadCachedImages
W0717 01:14:51.199496 55687 out.go:239] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19265-12897/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19265-12897/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0: no such file or directory
I0717 01:14:51.199513 55687 kubeadm.go:934] updating node { 192.168.61.13 8443 v1.20.0 crio true true} ...
I0717 01:14:51.199613 55687 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-249342 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.61.13
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-249342 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0717 01:14:51.199721 55687 ssh_runner.go:195] Run: crio config
I0717 01:14:51.252799 55687 cni.go:84] Creating CNI manager for ""
I0717 01:14:51.252822 55687 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0717 01:14:51.252833 55687 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0717 01:14:51.252853 55687 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.61.13 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-249342 NodeName:old-k8s-version-249342 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.61.13"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.61.13 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Stati
cPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0717 01:14:51.252975 55687 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.61.13
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-249342"
kubeletExtraArgs:
node-ip: 192.168.61.13
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.61.13"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0717 01:14:51.253034 55687 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0717 01:14:51.263135 55687 binaries.go:44] Found k8s binaries, skipping transfer
I0717 01:14:51.263196 55687 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0717 01:14:51.272754 55687 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (429 bytes)
I0717 01:14:51.290299 55687 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0717 01:14:51.306688 55687 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2120 bytes)
I0717 01:14:51.323305 55687 ssh_runner.go:195] Run: grep 192.168.61.13 control-plane.minikube.internal$ /etc/hosts
I0717 01:14:51.327364 55687 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.61.13 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0717 01:14:51.340000 55687 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0717 01:14:51.477399 55687 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0717 01:14:51.501538 55687 certs.go:68] Setting up /home/jenkins/minikube-integration/19265-12897/.minikube/profiles/old-k8s-version-249342 for IP: 192.168.61.13
I0717 01:14:51.501557 55687 certs.go:194] generating shared ca certs ...
I0717 01:14:51.501570 55687 certs.go:226] acquiring lock for ca certs: {Name:mkf91c55409ea76cfdc37f3e8e02a9296791b311 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0717 01:14:51.501712 55687 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19265-12897/.minikube/ca.key
I0717 01:14:51.501755 55687 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19265-12897/.minikube/proxy-client-ca.key
I0717 01:14:51.501765 55687 certs.go:256] generating profile certs ...
I0717 01:14:51.501813 55687 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19265-12897/.minikube/profiles/old-k8s-version-249342/client.key
I0717 01:14:51.501826 55687 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19265-12897/.minikube/profiles/old-k8s-version-249342/client.crt with IP's: []
I0717 01:14:51.663553 55687 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19265-12897/.minikube/profiles/old-k8s-version-249342/client.crt ...
I0717 01:14:51.663582 55687 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19265-12897/.minikube/profiles/old-k8s-version-249342/client.crt: {Name:mk50b234ca6aa8d20fc8f116d917da0e35c74c13 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0717 01:14:51.674605 55687 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19265-12897/.minikube/profiles/old-k8s-version-249342/client.key ...
I0717 01:14:51.674638 55687 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19265-12897/.minikube/profiles/old-k8s-version-249342/client.key: {Name:mk8f35621fc744dc05cc3b37aa5a57b75c64bb9c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0717 01:14:51.674803 55687 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19265-12897/.minikube/profiles/old-k8s-version-249342/apiserver.key.e96f0644
I0717 01:14:51.674825 55687 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19265-12897/.minikube/profiles/old-k8s-version-249342/apiserver.crt.e96f0644 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.61.13]
I0717 01:14:51.868191 55687 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19265-12897/.minikube/profiles/old-k8s-version-249342/apiserver.crt.e96f0644 ...
I0717 01:14:51.868227 55687 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19265-12897/.minikube/profiles/old-k8s-version-249342/apiserver.crt.e96f0644: {Name:mkfe8a28afbecabc3ddd89a3505ea6e90f22b9bd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0717 01:14:51.870968 55687 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19265-12897/.minikube/profiles/old-k8s-version-249342/apiserver.key.e96f0644 ...
I0717 01:14:51.870992 55687 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19265-12897/.minikube/profiles/old-k8s-version-249342/apiserver.key.e96f0644: {Name:mk6daf674fb4d6b899a8d204451298c3000594f0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0717 01:14:51.871112 55687 certs.go:381] copying /home/jenkins/minikube-integration/19265-12897/.minikube/profiles/old-k8s-version-249342/apiserver.crt.e96f0644 -> /home/jenkins/minikube-integration/19265-12897/.minikube/profiles/old-k8s-version-249342/apiserver.crt
I0717 01:14:51.871240 55687 certs.go:385] copying /home/jenkins/minikube-integration/19265-12897/.minikube/profiles/old-k8s-version-249342/apiserver.key.e96f0644 -> /home/jenkins/minikube-integration/19265-12897/.minikube/profiles/old-k8s-version-249342/apiserver.key
I0717 01:14:51.871302 55687 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19265-12897/.minikube/profiles/old-k8s-version-249342/proxy-client.key
I0717 01:14:51.871318 55687 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19265-12897/.minikube/profiles/old-k8s-version-249342/proxy-client.crt with IP's: []
I0717 01:14:52.130944 55687 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19265-12897/.minikube/profiles/old-k8s-version-249342/proxy-client.crt ...
I0717 01:14:52.130975 55687 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19265-12897/.minikube/profiles/old-k8s-version-249342/proxy-client.crt: {Name:mkd04f546994813080a3375d437db32002ad3f79 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0717 01:14:52.203181 55687 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19265-12897/.minikube/profiles/old-k8s-version-249342/proxy-client.key ...
I0717 01:14:52.203236 55687 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19265-12897/.minikube/profiles/old-k8s-version-249342/proxy-client.key: {Name:mk30d88fa1a79ec104b7e5dec5e105d38dbb7601 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0717 01:14:52.203520 55687 certs.go:484] found cert: /home/jenkins/minikube-integration/19265-12897/.minikube/certs/20068.pem (1338 bytes)
W0717 01:14:52.203567 55687 certs.go:480] ignoring /home/jenkins/minikube-integration/19265-12897/.minikube/certs/20068_empty.pem, impossibly tiny 0 bytes
I0717 01:14:52.203583 55687 certs.go:484] found cert: /home/jenkins/minikube-integration/19265-12897/.minikube/certs/ca-key.pem (1679 bytes)
I0717 01:14:52.203611 55687 certs.go:484] found cert: /home/jenkins/minikube-integration/19265-12897/.minikube/certs/ca.pem (1082 bytes)
I0717 01:14:52.203639 55687 certs.go:484] found cert: /home/jenkins/minikube-integration/19265-12897/.minikube/certs/cert.pem (1123 bytes)
I0717 01:14:52.203674 55687 certs.go:484] found cert: /home/jenkins/minikube-integration/19265-12897/.minikube/certs/key.pem (1675 bytes)
I0717 01:14:52.203731 55687 certs.go:484] found cert: /home/jenkins/minikube-integration/19265-12897/.minikube/files/etc/ssl/certs/200682.pem (1708 bytes)
I0717 01:14:52.204521 55687 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19265-12897/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0717 01:14:52.236679 55687 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19265-12897/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0717 01:14:52.266887 55687 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19265-12897/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0717 01:14:52.297225 55687 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19265-12897/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0717 01:14:52.327898 55687 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19265-12897/.minikube/profiles/old-k8s-version-249342/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0717 01:14:52.360449 55687 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19265-12897/.minikube/profiles/old-k8s-version-249342/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0717 01:14:52.392545 55687 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19265-12897/.minikube/profiles/old-k8s-version-249342/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0717 01:14:52.431056 55687 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19265-12897/.minikube/profiles/old-k8s-version-249342/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0717 01:14:52.469723 55687 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19265-12897/.minikube/files/etc/ssl/certs/200682.pem --> /usr/share/ca-certificates/200682.pem (1708 bytes)
I0717 01:14:52.497523 55687 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19265-12897/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0717 01:14:52.535894 55687 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19265-12897/.minikube/certs/20068.pem --> /usr/share/ca-certificates/20068.pem (1338 bytes)
I0717 01:14:52.567499 55687 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0717 01:14:52.585023 55687 ssh_runner.go:195] Run: openssl version
I0717 01:14:52.591187 55687 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/200682.pem && ln -fs /usr/share/ca-certificates/200682.pem /etc/ssl/certs/200682.pem"
I0717 01:14:52.602011 55687 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/200682.pem
I0717 01:14:52.607288 55687 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jul 17 00:16 /usr/share/ca-certificates/200682.pem
I0717 01:14:52.607366 55687 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/200682.pem
I0717 01:14:52.614928 55687 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/200682.pem /etc/ssl/certs/3ec20f2e.0"
I0717 01:14:52.626140 55687 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0717 01:14:52.637309 55687 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0717 01:14:52.641885 55687 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jul 17 00:05 /usr/share/ca-certificates/minikubeCA.pem
I0717 01:14:52.641940 55687 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0717 01:14:52.649281 55687 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0717 01:14:52.664425 55687 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/20068.pem && ln -fs /usr/share/ca-certificates/20068.pem /etc/ssl/certs/20068.pem"
I0717 01:14:52.676917 55687 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/20068.pem
I0717 01:14:52.682428 55687 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jul 17 00:16 /usr/share/ca-certificates/20068.pem
I0717 01:14:52.682481 55687 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/20068.pem
I0717 01:14:52.689884 55687 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/20068.pem /etc/ssl/certs/51391683.0"
I0717 01:14:52.702358 55687 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0717 01:14:52.706704 55687 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0717 01:14:52.706756 55687 kubeadm.go:392] StartCluster: {Name:old-k8s-version-249342 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19249/minikube-v1.33.1-1721037971-19249-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721064868-19249@sha256:f2789f25c9e51cdeb9cef760e15dc838ef08abd5bb1913311c1eabedda231e8c Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-249342 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.13 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0717 01:14:52.706842 55687 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0717 01:14:52.706900 55687 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0717 01:14:52.746988 55687 cri.go:89] found id: ""
I0717 01:14:52.747066 55687 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0717 01:14:52.757808 55687 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0717 01:14:52.767695 55687 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0717 01:14:52.777783 55687 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0717 01:14:52.777807 55687 kubeadm.go:157] found existing configuration files:
I0717 01:14:52.777863 55687 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0717 01:14:52.787532 55687 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0717 01:14:52.787596 55687 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0717 01:14:52.799099 55687 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0717 01:14:52.808968 55687 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0717 01:14:52.809036 55687 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0717 01:14:52.819522 55687 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0717 01:14:52.828986 55687 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0717 01:14:52.829048 55687 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0717 01:14:52.839478 55687 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0717 01:14:52.849030 55687 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0717 01:14:52.849097 55687 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0717 01:14:52.860527 55687 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0717 01:14:52.985153 55687 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0717 01:14:52.985466 55687 kubeadm.go:310] [preflight] Running pre-flight checks
I0717 01:14:53.143789 55687 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0717 01:14:53.143986 55687 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0717 01:14:53.144156 55687 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0717 01:14:53.417213 55687 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0717 01:14:53.464175 55687 out.go:204] - Generating certificates and keys ...
I0717 01:14:53.464289 55687 kubeadm.go:310] [certs] Using existing ca certificate authority
I0717 01:14:53.464382 55687 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0717 01:14:53.676180 55687 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0717 01:14:53.821092 55687 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0717 01:14:54.067743 55687 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0717 01:14:54.304922 55687 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0717 01:14:54.387572 55687 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0717 01:14:54.387781 55687 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-249342] and IPs [192.168.61.13 127.0.0.1 ::1]
I0717 01:14:54.511743 55687 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0717 01:14:54.512309 55687 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-249342] and IPs [192.168.61.13 127.0.0.1 ::1]
I0717 01:14:54.617883 55687 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0717 01:14:54.802200 55687 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0717 01:14:55.229352 55687 kubeadm.go:310] [certs] Generating "sa" key and public key
I0717 01:14:55.229567 55687 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0717 01:14:55.490619 55687 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0717 01:14:55.582816 55687 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0717 01:14:55.797204 55687 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0717 01:14:56.161399 55687 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0717 01:14:56.183756 55687 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0717 01:14:56.184772 55687 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0717 01:14:56.184839 55687 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0717 01:14:56.335230 55687 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0717 01:14:56.337928 55687 out.go:204] - Booting up control plane ...
I0717 01:14:56.338046 55687 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0717 01:14:56.353312 55687 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0717 01:14:56.355510 55687 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0717 01:14:56.356728 55687 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0717 01:14:56.361426 55687 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0717 01:15:36.355041 55687 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0717 01:15:36.356035 55687 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0717 01:15:36.356272 55687 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0717 01:15:41.356468 55687 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0717 01:15:41.356715 55687 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0717 01:15:51.355522 55687 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0717 01:15:51.355751 55687 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0717 01:16:11.354941 55687 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0717 01:16:11.355257 55687 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0717 01:16:51.356801 55687 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0717 01:16:51.357084 55687 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0717 01:16:51.357104 55687 kubeadm.go:310]
I0717 01:16:51.357162 55687 kubeadm.go:310] Unfortunately, an error has occurred:
I0717 01:16:51.357240 55687 kubeadm.go:310] timed out waiting for the condition
I0717 01:16:51.357260 55687 kubeadm.go:310]
I0717 01:16:51.357312 55687 kubeadm.go:310] This error is likely caused by:
I0717 01:16:51.357349 55687 kubeadm.go:310] - The kubelet is not running
I0717 01:16:51.357444 55687 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0717 01:16:51.357455 55687 kubeadm.go:310]
I0717 01:16:51.357555 55687 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0717 01:16:51.357605 55687 kubeadm.go:310] - 'systemctl status kubelet'
I0717 01:16:51.357648 55687 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0717 01:16:51.357657 55687 kubeadm.go:310]
I0717 01:16:51.357790 55687 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0717 01:16:51.357891 55687 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0717 01:16:51.357900 55687 kubeadm.go:310]
I0717 01:16:51.358057 55687 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0717 01:16:51.358200 55687 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0717 01:16:51.358308 55687 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0717 01:16:51.358378 55687 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0717 01:16:51.358385 55687 kubeadm.go:310]
I0717 01:16:51.359048 55687 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0717 01:16:51.359120 55687 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0717 01:16:51.359192 55687 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
W0717 01:16:51.359451 55687 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-249342] and IPs [192.168.61.13 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-249342] and IPs [192.168.61.13 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-249342] and IPs [192.168.61.13 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-249342] and IPs [192.168.61.13 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0717 01:16:51.359507 55687 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0717 01:16:51.875761 55687 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0717 01:16:51.894973 55687 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0717 01:16:51.906025 55687 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0717 01:16:51.906042 55687 kubeadm.go:157] found existing configuration files:
I0717 01:16:51.906076 55687 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0717 01:16:51.917092 55687 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0717 01:16:51.917143 55687 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0717 01:16:51.928376 55687 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0717 01:16:51.940906 55687 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0717 01:16:51.940961 55687 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0717 01:16:51.951353 55687 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0717 01:16:51.961836 55687 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0717 01:16:51.961882 55687 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0717 01:16:51.973746 55687 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0717 01:16:51.986732 55687 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0717 01:16:51.986787 55687 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0717 01:16:52.001043 55687 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0717 01:16:52.101083 55687 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0717 01:16:52.101187 55687 kubeadm.go:310] [preflight] Running pre-flight checks
I0717 01:16:52.268844 55687 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0717 01:16:52.269012 55687 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0717 01:16:52.269145 55687 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0717 01:16:52.490853 55687 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0717 01:16:52.493757 55687 out.go:204] - Generating certificates and keys ...
I0717 01:16:52.493846 55687 kubeadm.go:310] [certs] Using existing ca certificate authority
I0717 01:16:52.493935 55687 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0717 01:16:52.494063 55687 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0717 01:16:52.494147 55687 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0717 01:16:52.494274 55687 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0717 01:16:52.494348 55687 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0717 01:16:52.494509 55687 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0717 01:16:52.494587 55687 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0717 01:16:52.494855 55687 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0717 01:16:52.495312 55687 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0717 01:16:52.495374 55687 kubeadm.go:310] [certs] Using the existing "sa" key
I0717 01:16:52.495448 55687 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0717 01:16:52.928466 55687 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0717 01:16:53.262866 55687 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0717 01:16:53.388803 55687 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0717 01:16:53.711732 55687 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0717 01:16:53.729002 55687 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0717 01:16:53.730220 55687 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0717 01:16:53.730309 55687 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0717 01:16:53.896721 55687 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0717 01:16:53.898248 55687 out.go:204] - Booting up control plane ...
I0717 01:16:53.898383 55687 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0717 01:16:53.901808 55687 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0717 01:16:53.903189 55687 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0717 01:16:53.911016 55687 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0717 01:16:53.914754 55687 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0717 01:17:33.918381 55687 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0717 01:17:33.918574 55687 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0717 01:17:33.918763 55687 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0717 01:17:38.919721 55687 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0717 01:17:38.920018 55687 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0717 01:17:48.921177 55687 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0717 01:17:48.921382 55687 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0717 01:18:08.920358 55687 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0717 01:18:08.920633 55687 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0717 01:18:48.919714 55687 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0717 01:18:48.919997 55687 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0717 01:18:48.920018 55687 kubeadm.go:310]
I0717 01:18:48.920068 55687 kubeadm.go:310] Unfortunately, an error has occurred:
I0717 01:18:48.920123 55687 kubeadm.go:310] timed out waiting for the condition
I0717 01:18:48.920141 55687 kubeadm.go:310]
I0717 01:18:48.920193 55687 kubeadm.go:310] This error is likely caused by:
I0717 01:18:48.920270 55687 kubeadm.go:310] - The kubelet is not running
I0717 01:18:48.920439 55687 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0717 01:18:48.920452 55687 kubeadm.go:310]
I0717 01:18:48.920605 55687 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0717 01:18:48.920653 55687 kubeadm.go:310] - 'systemctl status kubelet'
I0717 01:18:48.920699 55687 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0717 01:18:48.920712 55687 kubeadm.go:310]
I0717 01:18:48.920850 55687 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0717 01:18:48.921011 55687 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0717 01:18:48.921030 55687 kubeadm.go:310]
I0717 01:18:48.921181 55687 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0717 01:18:48.921312 55687 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0717 01:18:48.921436 55687 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0717 01:18:48.921539 55687 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0717 01:18:48.921547 55687 kubeadm.go:310]
I0717 01:18:48.922759 55687 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0717 01:18:48.922890 55687 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0717 01:18:48.922990 55687 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0717 01:18:48.923065 55687 kubeadm.go:394] duration metric: took 3m56.216312404s to StartCluster
I0717 01:18:48.923130 55687 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0717 01:18:48.923196 55687 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0717 01:18:48.975778 55687 cri.go:89] found id: ""
I0717 01:18:48.975805 55687 logs.go:276] 0 containers: []
W0717 01:18:48.975815 55687 logs.go:278] No container was found matching "kube-apiserver"
I0717 01:18:48.975823 55687 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0717 01:18:48.975893 55687 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0717 01:18:49.010559 55687 cri.go:89] found id: ""
I0717 01:18:49.010587 55687 logs.go:276] 0 containers: []
W0717 01:18:49.010598 55687 logs.go:278] No container was found matching "etcd"
I0717 01:18:49.010605 55687 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0717 01:18:49.010667 55687 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0717 01:18:49.059439 55687 cri.go:89] found id: ""
I0717 01:18:49.059466 55687 logs.go:276] 0 containers: []
W0717 01:18:49.059476 55687 logs.go:278] No container was found matching "coredns"
I0717 01:18:49.059483 55687 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0717 01:18:49.059544 55687 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0717 01:18:49.105204 55687 cri.go:89] found id: ""
I0717 01:18:49.105237 55687 logs.go:276] 0 containers: []
W0717 01:18:49.105250 55687 logs.go:278] No container was found matching "kube-scheduler"
I0717 01:18:49.105259 55687 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0717 01:18:49.105326 55687 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0717 01:18:49.147165 55687 cri.go:89] found id: ""
I0717 01:18:49.147199 55687 logs.go:276] 0 containers: []
W0717 01:18:49.147212 55687 logs.go:278] No container was found matching "kube-proxy"
I0717 01:18:49.147221 55687 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0717 01:18:49.147294 55687 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0717 01:18:49.189324 55687 cri.go:89] found id: ""
I0717 01:18:49.189348 55687 logs.go:276] 0 containers: []
W0717 01:18:49.189357 55687 logs.go:278] No container was found matching "kube-controller-manager"
I0717 01:18:49.189364 55687 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0717 01:18:49.189429 55687 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0717 01:18:49.231002 55687 cri.go:89] found id: ""
I0717 01:18:49.231034 55687 logs.go:276] 0 containers: []
W0717 01:18:49.231044 55687 logs.go:278] No container was found matching "kindnet"
I0717 01:18:49.231057 55687 logs.go:123] Gathering logs for kubelet ...
I0717 01:18:49.231074 55687 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0717 01:18:49.291265 55687 logs.go:123] Gathering logs for dmesg ...
I0717 01:18:49.291300 55687 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0717 01:18:49.307546 55687 logs.go:123] Gathering logs for describe nodes ...
I0717 01:18:49.307586 55687 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0717 01:18:49.503479 55687 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0717 01:18:49.503504 55687 logs.go:123] Gathering logs for CRI-O ...
I0717 01:18:49.503519 55687 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0717 01:18:49.628872 55687 logs.go:123] Gathering logs for container status ...
I0717 01:18:49.628905 55687 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0717 01:18:49.677815 55687 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0717 01:18:49.677860 55687 out.go:239] *
*
W0717 01:18:49.677939 55687 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0717 01:18:49.677967 55687 out.go:239] *
*
W0717 01:18:49.679025 55687 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0717 01:18:49.794357 55687 out.go:177]
W0717 01:18:49.801330 55687 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0717 01:18:49.801405 55687 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0717 01:18:49.801438 55687 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0717 01:18:49.806865 55687 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-249342 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-249342 -n old-k8s-version-249342
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-249342 -n old-k8s-version-249342: exit status 6 (286.37187ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0717 01:18:50.145323 62951 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-249342" does not appear in /home/jenkins/minikube-integration/19265-12897/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-249342" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (318.37s)