=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-744025 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-744025 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m42.441387191s)
-- stdout --
* [old-k8s-version-744025] minikube v1.34.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=19672
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19672-8777/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19672-8777/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-744025" primary control-plane node in "old-k8s-version-744025" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0920 18:07:52.227294 68107 out.go:345] Setting OutFile to fd 1 ...
I0920 18:07:52.227588 68107 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0920 18:07:52.227600 68107 out.go:358] Setting ErrFile to fd 2...
I0920 18:07:52.227607 68107 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0920 18:07:52.227860 68107 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19672-8777/.minikube/bin
I0920 18:07:52.229003 68107 out.go:352] Setting JSON to false
I0920 18:07:52.230113 68107 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":6615,"bootTime":1726849057,"procs":302,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1069-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0920 18:07:52.230207 68107 start.go:139] virtualization: kvm guest
I0920 18:07:52.231862 68107 out.go:177] * [old-k8s-version-744025] minikube v1.34.0 on Ubuntu 20.04 (kvm/amd64)
I0920 18:07:52.233390 68107 out.go:177] - MINIKUBE_LOCATION=19672
I0920 18:07:52.233389 68107 notify.go:220] Checking for updates...
I0920 18:07:52.235710 68107 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0920 18:07:52.236978 68107 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19672-8777/kubeconfig
I0920 18:07:52.238105 68107 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19672-8777/.minikube
I0920 18:07:52.239178 68107 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0920 18:07:52.240301 68107 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0920 18:07:52.242005 68107 config.go:182] Loaded profile config "bridge-833505": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1
I0920 18:07:52.242163 68107 config.go:182] Loaded profile config "enable-default-cni-833505": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1
I0920 18:07:52.242299 68107 config.go:182] Loaded profile config "flannel-833505": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1
I0920 18:07:52.242427 68107 driver.go:394] Setting default libvirt URI to qemu:///system
I0920 18:07:52.288110 68107 out.go:177] * Using the kvm2 driver based on user configuration
I0920 18:07:52.289389 68107 start.go:297] selected driver: kvm2
I0920 18:07:52.289419 68107 start.go:901] validating driver "kvm2" against <nil>
I0920 18:07:52.289437 68107 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0920 18:07:52.290301 68107 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0920 18:07:52.290407 68107 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19672-8777/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0920 18:07:52.307807 68107 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.34.0
I0920 18:07:52.307856 68107 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0920 18:07:52.308105 68107 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0920 18:07:52.308146 68107 cni.go:84] Creating CNI manager for ""
I0920 18:07:52.308194 68107 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0920 18:07:52.308204 68107 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0920 18:07:52.308281 68107 start.go:340] cluster config:
{Name:old-k8s-version-744025 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-744025 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0920 18:07:52.308418 68107 iso.go:125] acquiring lock: {Name:mkba95ef0488e46f622333e9f317f43def93040b Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0920 18:07:52.310154 68107 out.go:177] * Starting "old-k8s-version-744025" primary control-plane node in "old-k8s-version-744025" cluster
I0920 18:07:52.311420 68107 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0920 18:07:52.311463 68107 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19672-8777/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0920 18:07:52.311472 68107 cache.go:56] Caching tarball of preloaded images
I0920 18:07:52.311587 68107 preload.go:172] Found /home/jenkins/minikube-integration/19672-8777/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0920 18:07:52.311602 68107 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0920 18:07:52.311704 68107 profile.go:143] Saving config to /home/jenkins/minikube-integration/19672-8777/.minikube/profiles/old-k8s-version-744025/config.json ...
I0920 18:07:52.311724 68107 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19672-8777/.minikube/profiles/old-k8s-version-744025/config.json: {Name:mk5459942e9de021fc633369bb14dee06e01c8fe Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 18:07:52.311891 68107 start.go:360] acquireMachinesLock for old-k8s-version-744025: {Name:mkfeedb385cf08b5d2aa00913e85815d02a180c2 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0920 18:08:00.714614 68107 start.go:364] duration metric: took 8.402696233s to acquireMachinesLock for "old-k8s-version-744025"
I0920 18:08:00.714707 68107 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-744025 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19672/minikube-v1.34.0-1726784654-19672-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-744025 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0920 18:08:00.714826 68107 start.go:125] createHost starting for "" (driver="kvm2")
I0920 18:08:00.717251 68107 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0920 18:08:00.717436 68107 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0920 18:08:00.717477 68107 main.go:141] libmachine: Launching plugin server for driver kvm2
I0920 18:08:00.737875 68107 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36133
I0920 18:08:00.738462 68107 main.go:141] libmachine: () Calling .GetVersion
I0920 18:08:00.739070 68107 main.go:141] libmachine: Using API Version 1
I0920 18:08:00.739096 68107 main.go:141] libmachine: () Calling .SetConfigRaw
I0920 18:08:00.739522 68107 main.go:141] libmachine: () Calling .GetMachineName
I0920 18:08:00.739707 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetMachineName
I0920 18:08:00.739868 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .DriverName
I0920 18:08:00.740006 68107 start.go:159] libmachine.API.Create for "old-k8s-version-744025" (driver="kvm2")
I0920 18:08:00.740044 68107 client.go:168] LocalClient.Create starting
I0920 18:08:00.740077 68107 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19672-8777/.minikube/certs/ca.pem
I0920 18:08:00.740143 68107 main.go:141] libmachine: Decoding PEM data...
I0920 18:08:00.740165 68107 main.go:141] libmachine: Parsing certificate...
I0920 18:08:00.740238 68107 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19672-8777/.minikube/certs/cert.pem
I0920 18:08:00.740271 68107 main.go:141] libmachine: Decoding PEM data...
I0920 18:08:00.740292 68107 main.go:141] libmachine: Parsing certificate...
I0920 18:08:00.740320 68107 main.go:141] libmachine: Running pre-create checks...
I0920 18:08:00.740332 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .PreCreateCheck
I0920 18:08:00.740667 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetConfigRaw
I0920 18:08:00.741102 68107 main.go:141] libmachine: Creating machine...
I0920 18:08:00.741119 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .Create
I0920 18:08:00.741288 68107 main.go:141] libmachine: (old-k8s-version-744025) Creating KVM machine...
I0920 18:08:00.742606 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | found existing default KVM network
I0920 18:08:00.744798 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | I0920 18:08:00.744605 68219 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0002097f0}
I0920 18:08:00.744826 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | created network xml:
I0920 18:08:00.744838 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | <network>
I0920 18:08:00.744849 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | <name>mk-old-k8s-version-744025</name>
I0920 18:08:00.744857 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | <dns enable='no'/>
I0920 18:08:00.744863 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG |
I0920 18:08:00.744877 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | <ip address='192.168.39.1' netmask='255.255.255.0'>
I0920 18:08:00.744887 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | <dhcp>
I0920 18:08:00.744895 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | <range start='192.168.39.2' end='192.168.39.253'/>
I0920 18:08:00.744908 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | </dhcp>
I0920 18:08:00.744924 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | </ip>
I0920 18:08:00.744937 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG |
I0920 18:08:00.744945 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | </network>
I0920 18:08:00.744960 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG |
I0920 18:08:00.750996 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | trying to create private KVM network mk-old-k8s-version-744025 192.168.39.0/24...
I0920 18:08:00.835045 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | private KVM network mk-old-k8s-version-744025 192.168.39.0/24 created
I0920 18:08:00.835076 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | I0920 18:08:00.834983 68219 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19672-8777/.minikube
I0920 18:08:00.835100 68107 main.go:141] libmachine: (old-k8s-version-744025) Setting up store path in /home/jenkins/minikube-integration/19672-8777/.minikube/machines/old-k8s-version-744025 ...
I0920 18:08:00.835111 68107 main.go:141] libmachine: (old-k8s-version-744025) Building disk image from file:///home/jenkins/minikube-integration/19672-8777/.minikube/cache/iso/amd64/minikube-v1.34.0-1726784654-19672-amd64.iso
I0920 18:08:00.835128 68107 main.go:141] libmachine: (old-k8s-version-744025) Downloading /home/jenkins/minikube-integration/19672-8777/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19672-8777/.minikube/cache/iso/amd64/minikube-v1.34.0-1726784654-19672-amd64.iso...
I0920 18:08:01.143582 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | I0920 18:08:01.143415 68219 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19672-8777/.minikube/machines/old-k8s-version-744025/id_rsa...
I0920 18:08:01.246082 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | I0920 18:08:01.245937 68219 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19672-8777/.minikube/machines/old-k8s-version-744025/old-k8s-version-744025.rawdisk...
I0920 18:08:01.246124 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | Writing magic tar header
I0920 18:08:01.246152 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | Writing SSH key tar header
I0920 18:08:01.246186 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | I0920 18:08:01.246108 68219 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19672-8777/.minikube/machines/old-k8s-version-744025 ...
I0920 18:08:01.246265 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19672-8777/.minikube/machines/old-k8s-version-744025
I0920 18:08:01.246295 68107 main.go:141] libmachine: (old-k8s-version-744025) Setting executable bit set on /home/jenkins/minikube-integration/19672-8777/.minikube/machines/old-k8s-version-744025 (perms=drwx------)
I0920 18:08:01.246313 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19672-8777/.minikube/machines
I0920 18:08:01.246329 68107 main.go:141] libmachine: (old-k8s-version-744025) Setting executable bit set on /home/jenkins/minikube-integration/19672-8777/.minikube/machines (perms=drwxr-xr-x)
I0920 18:08:01.246338 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19672-8777/.minikube
I0920 18:08:01.246352 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19672-8777
I0920 18:08:01.246364 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0920 18:08:01.246375 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | Checking permissions on dir: /home/jenkins
I0920 18:08:01.246386 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | Checking permissions on dir: /home
I0920 18:08:01.246397 68107 main.go:141] libmachine: (old-k8s-version-744025) Setting executable bit set on /home/jenkins/minikube-integration/19672-8777/.minikube (perms=drwxr-xr-x)
I0920 18:08:01.246413 68107 main.go:141] libmachine: (old-k8s-version-744025) Setting executable bit set on /home/jenkins/minikube-integration/19672-8777 (perms=drwxrwxr-x)
I0920 18:08:01.246425 68107 main.go:141] libmachine: (old-k8s-version-744025) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0920 18:08:01.246435 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | Skipping /home - not owner
I0920 18:08:01.246451 68107 main.go:141] libmachine: (old-k8s-version-744025) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0920 18:08:01.246469 68107 main.go:141] libmachine: (old-k8s-version-744025) Creating domain...
I0920 18:08:01.247794 68107 main.go:141] libmachine: (old-k8s-version-744025) define libvirt domain using xml:
I0920 18:08:01.247815 68107 main.go:141] libmachine: (old-k8s-version-744025) <domain type='kvm'>
I0920 18:08:01.247822 68107 main.go:141] libmachine: (old-k8s-version-744025) <name>old-k8s-version-744025</name>
I0920 18:08:01.247829 68107 main.go:141] libmachine: (old-k8s-version-744025) <memory unit='MiB'>2200</memory>
I0920 18:08:01.247837 68107 main.go:141] libmachine: (old-k8s-version-744025) <vcpu>2</vcpu>
I0920 18:08:01.247844 68107 main.go:141] libmachine: (old-k8s-version-744025) <features>
I0920 18:08:01.247851 68107 main.go:141] libmachine: (old-k8s-version-744025) <acpi/>
I0920 18:08:01.247858 68107 main.go:141] libmachine: (old-k8s-version-744025) <apic/>
I0920 18:08:01.247871 68107 main.go:141] libmachine: (old-k8s-version-744025) <pae/>
I0920 18:08:01.247880 68107 main.go:141] libmachine: (old-k8s-version-744025)
I0920 18:08:01.247891 68107 main.go:141] libmachine: (old-k8s-version-744025) </features>
I0920 18:08:01.247898 68107 main.go:141] libmachine: (old-k8s-version-744025) <cpu mode='host-passthrough'>
I0920 18:08:01.247927 68107 main.go:141] libmachine: (old-k8s-version-744025)
I0920 18:08:01.247953 68107 main.go:141] libmachine: (old-k8s-version-744025) </cpu>
I0920 18:08:01.247965 68107 main.go:141] libmachine: (old-k8s-version-744025) <os>
I0920 18:08:01.247980 68107 main.go:141] libmachine: (old-k8s-version-744025) <type>hvm</type>
I0920 18:08:01.247994 68107 main.go:141] libmachine: (old-k8s-version-744025) <boot dev='cdrom'/>
I0920 18:08:01.248004 68107 main.go:141] libmachine: (old-k8s-version-744025) <boot dev='hd'/>
I0920 18:08:01.248015 68107 main.go:141] libmachine: (old-k8s-version-744025) <bootmenu enable='no'/>
I0920 18:08:01.248025 68107 main.go:141] libmachine: (old-k8s-version-744025) </os>
I0920 18:08:01.248036 68107 main.go:141] libmachine: (old-k8s-version-744025) <devices>
I0920 18:08:01.248047 68107 main.go:141] libmachine: (old-k8s-version-744025) <disk type='file' device='cdrom'>
I0920 18:08:01.248068 68107 main.go:141] libmachine: (old-k8s-version-744025) <source file='/home/jenkins/minikube-integration/19672-8777/.minikube/machines/old-k8s-version-744025/boot2docker.iso'/>
I0920 18:08:01.248085 68107 main.go:141] libmachine: (old-k8s-version-744025) <target dev='hdc' bus='scsi'/>
I0920 18:08:01.248097 68107 main.go:141] libmachine: (old-k8s-version-744025) <readonly/>
I0920 18:08:01.248104 68107 main.go:141] libmachine: (old-k8s-version-744025) </disk>
I0920 18:08:01.248117 68107 main.go:141] libmachine: (old-k8s-version-744025) <disk type='file' device='disk'>
I0920 18:08:01.248134 68107 main.go:141] libmachine: (old-k8s-version-744025) <driver name='qemu' type='raw' cache='default' io='threads' />
I0920 18:08:01.248254 68107 main.go:141] libmachine: (old-k8s-version-744025) <source file='/home/jenkins/minikube-integration/19672-8777/.minikube/machines/old-k8s-version-744025/old-k8s-version-744025.rawdisk'/>
I0920 18:08:01.248313 68107 main.go:141] libmachine: (old-k8s-version-744025) <target dev='hda' bus='virtio'/>
I0920 18:08:01.248327 68107 main.go:141] libmachine: (old-k8s-version-744025) </disk>
I0920 18:08:01.248341 68107 main.go:141] libmachine: (old-k8s-version-744025) <interface type='network'>
I0920 18:08:01.248364 68107 main.go:141] libmachine: (old-k8s-version-744025) <source network='mk-old-k8s-version-744025'/>
I0920 18:08:01.248385 68107 main.go:141] libmachine: (old-k8s-version-744025) <model type='virtio'/>
I0920 18:08:01.248398 68107 main.go:141] libmachine: (old-k8s-version-744025) </interface>
I0920 18:08:01.248408 68107 main.go:141] libmachine: (old-k8s-version-744025) <interface type='network'>
I0920 18:08:01.248418 68107 main.go:141] libmachine: (old-k8s-version-744025) <source network='default'/>
I0920 18:08:01.248430 68107 main.go:141] libmachine: (old-k8s-version-744025) <model type='virtio'/>
I0920 18:08:01.248443 68107 main.go:141] libmachine: (old-k8s-version-744025) </interface>
I0920 18:08:01.248454 68107 main.go:141] libmachine: (old-k8s-version-744025) <serial type='pty'>
I0920 18:08:01.248466 68107 main.go:141] libmachine: (old-k8s-version-744025) <target port='0'/>
I0920 18:08:01.248478 68107 main.go:141] libmachine: (old-k8s-version-744025) </serial>
I0920 18:08:01.248487 68107 main.go:141] libmachine: (old-k8s-version-744025) <console type='pty'>
I0920 18:08:01.248499 68107 main.go:141] libmachine: (old-k8s-version-744025) <target type='serial' port='0'/>
I0920 18:08:01.248525 68107 main.go:141] libmachine: (old-k8s-version-744025) </console>
I0920 18:08:01.248543 68107 main.go:141] libmachine: (old-k8s-version-744025) <rng model='virtio'>
I0920 18:08:01.248560 68107 main.go:141] libmachine: (old-k8s-version-744025) <backend model='random'>/dev/random</backend>
I0920 18:08:01.248570 68107 main.go:141] libmachine: (old-k8s-version-744025) </rng>
I0920 18:08:01.248579 68107 main.go:141] libmachine: (old-k8s-version-744025)
I0920 18:08:01.248588 68107 main.go:141] libmachine: (old-k8s-version-744025)
I0920 18:08:01.248596 68107 main.go:141] libmachine: (old-k8s-version-744025) </devices>
I0920 18:08:01.248605 68107 main.go:141] libmachine: (old-k8s-version-744025) </domain>
I0920 18:08:01.248622 68107 main.go:141] libmachine: (old-k8s-version-744025)
I0920 18:08:01.253530 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined MAC address 52:54:00:3c:24:35 in network default
I0920 18:08:01.254366 68107 main.go:141] libmachine: (old-k8s-version-744025) Ensuring networks are active...
I0920 18:08:01.254388 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:01.255166 68107 main.go:141] libmachine: (old-k8s-version-744025) Ensuring network default is active
I0920 18:08:01.255531 68107 main.go:141] libmachine: (old-k8s-version-744025) Ensuring network mk-old-k8s-version-744025 is active
I0920 18:08:01.256185 68107 main.go:141] libmachine: (old-k8s-version-744025) Getting domain xml...
I0920 18:08:01.257017 68107 main.go:141] libmachine: (old-k8s-version-744025) Creating domain...
I0920 18:08:02.743516 68107 main.go:141] libmachine: (old-k8s-version-744025) Waiting to get IP...
I0920 18:08:02.744371 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:02.744952 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | unable to find current IP address of domain old-k8s-version-744025 in network mk-old-k8s-version-744025
I0920 18:08:02.744977 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | I0920 18:08:02.744926 68219 retry.go:31] will retry after 205.228708ms: waiting for machine to come up
I0920 18:08:02.951576 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:02.952300 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | unable to find current IP address of domain old-k8s-version-744025 in network mk-old-k8s-version-744025
I0920 18:08:02.952335 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | I0920 18:08:02.952260 68219 retry.go:31] will retry after 328.061361ms: waiting for machine to come up
I0920 18:08:03.282860 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:03.283436 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | unable to find current IP address of domain old-k8s-version-744025 in network mk-old-k8s-version-744025
I0920 18:08:03.283487 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | I0920 18:08:03.283419 68219 retry.go:31] will retry after 473.577756ms: waiting for machine to come up
I0920 18:08:03.759694 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:03.760432 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | unable to find current IP address of domain old-k8s-version-744025 in network mk-old-k8s-version-744025
I0920 18:08:03.760462 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | I0920 18:08:03.760410 68219 retry.go:31] will retry after 424.087579ms: waiting for machine to come up
I0920 18:08:04.185726 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:04.186272 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | unable to find current IP address of domain old-k8s-version-744025 in network mk-old-k8s-version-744025
I0920 18:08:04.186292 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | I0920 18:08:04.186222 68219 retry.go:31] will retry after 494.865814ms: waiting for machine to come up
I0920 18:08:04.683040 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:04.683584 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | unable to find current IP address of domain old-k8s-version-744025 in network mk-old-k8s-version-744025
I0920 18:08:04.683613 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | I0920 18:08:04.683534 68219 retry.go:31] will retry after 902.50779ms: waiting for machine to come up
I0920 18:08:05.588408 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:05.589078 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | unable to find current IP address of domain old-k8s-version-744025 in network mk-old-k8s-version-744025
I0920 18:08:05.589127 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | I0920 18:08:05.589010 68219 retry.go:31] will retry after 808.61449ms: waiting for machine to come up
I0920 18:08:06.399828 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:06.400455 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | unable to find current IP address of domain old-k8s-version-744025 in network mk-old-k8s-version-744025
I0920 18:08:06.400481 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | I0920 18:08:06.400408 68219 retry.go:31] will retry after 985.683822ms: waiting for machine to come up
I0920 18:08:07.387295 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:07.387746 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | unable to find current IP address of domain old-k8s-version-744025 in network mk-old-k8s-version-744025
I0920 18:08:07.387775 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | I0920 18:08:07.387699 68219 retry.go:31] will retry after 1.188066061s: waiting for machine to come up
I0920 18:08:08.577356 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:08.577875 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | unable to find current IP address of domain old-k8s-version-744025 in network mk-old-k8s-version-744025
I0920 18:08:08.577902 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | I0920 18:08:08.577807 68219 retry.go:31] will retry after 2.088949257s: waiting for machine to come up
I0920 18:08:10.668368 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:10.668859 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | unable to find current IP address of domain old-k8s-version-744025 in network mk-old-k8s-version-744025
I0920 18:08:10.668892 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | I0920 18:08:10.668800 68219 retry.go:31] will retry after 1.909463117s: waiting for machine to come up
I0920 18:08:12.580366 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:12.580958 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | unable to find current IP address of domain old-k8s-version-744025 in network mk-old-k8s-version-744025
I0920 18:08:12.580979 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | I0920 18:08:12.580933 68219 retry.go:31] will retry after 3.239902762s: waiting for machine to come up
I0920 18:08:15.822485 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:15.823020 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | unable to find current IP address of domain old-k8s-version-744025 in network mk-old-k8s-version-744025
I0920 18:08:15.823040 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | I0920 18:08:15.822982 68219 retry.go:31] will retry after 4.304304382s: waiting for machine to come up
I0920 18:08:20.131666 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:20.132160 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | unable to find current IP address of domain old-k8s-version-744025 in network mk-old-k8s-version-744025
I0920 18:08:20.132187 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | I0920 18:08:20.132111 68219 retry.go:31] will retry after 4.313878888s: waiting for machine to come up
I0920 18:08:24.447393 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:24.448145 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has current primary IP address 192.168.39.207 and MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:24.448175 68107 main.go:141] libmachine: (old-k8s-version-744025) Found IP for machine: 192.168.39.207
I0920 18:08:24.448190 68107 main.go:141] libmachine: (old-k8s-version-744025) Reserving static IP address...
I0920 18:08:24.448555 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-744025", mac: "52:54:00:e5:57:41", ip: "192.168.39.207"} in network mk-old-k8s-version-744025
I0920 18:08:24.542400 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | Getting to WaitForSSH function...
I0920 18:08:24.542432 68107 main.go:141] libmachine: (old-k8s-version-744025) Reserved static IP address: 192.168.39.207
I0920 18:08:24.542446 68107 main.go:141] libmachine: (old-k8s-version-744025) Waiting for SSH to be available...
I0920 18:08:24.546074 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:24.546393 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | unable to find host DHCP lease matching {name: "", mac: "52:54:00:e5:57:41", ip: ""} in network mk-old-k8s-version-744025
I0920 18:08:24.546417 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | unable to find defined IP address of network mk-old-k8s-version-744025 interface with MAC address 52:54:00:e5:57:41
I0920 18:08:24.546585 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | Using SSH client type: external
I0920 18:08:24.546610 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | Using SSH private key: /home/jenkins/minikube-integration/19672-8777/.minikube/machines/old-k8s-version-744025/id_rsa (-rw-------)
I0920 18:08:24.546679 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@ -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19672-8777/.minikube/machines/old-k8s-version-744025/id_rsa -p 22] /usr/bin/ssh <nil>}
I0920 18:08:24.546694 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | About to run SSH command:
I0920 18:08:24.546716 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | exit 0
I0920 18:08:24.551728 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | SSH cmd err, output: exit status 255:
I0920 18:08:24.551758 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | Error getting ssh command 'exit 0' : ssh command error:
I0920 18:08:24.551768 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | command : exit 0
I0920 18:08:24.551776 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | err : exit status 255
I0920 18:08:24.551786 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | output :
I0920 18:08:27.552598 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | Getting to WaitForSSH function...
I0920 18:08:27.555491 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:27.555924 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e5:57:41", ip: ""} in network mk-old-k8s-version-744025: {Iface:virbr1 ExpiryTime:2024-09-20 19:08:17 +0000 UTC Type:0 Mac:52:54:00:e5:57:41 Iaid: IPaddr:192.168.39.207 Prefix:24 Hostname:old-k8s-version-744025 Clientid:01:52:54:00:e5:57:41}
I0920 18:08:27.555947 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined IP address 192.168.39.207 and MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:27.556084 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | Using SSH client type: external
I0920 18:08:27.556126 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | Using SSH private key: /home/jenkins/minikube-integration/19672-8777/.minikube/machines/old-k8s-version-744025/id_rsa (-rw-------)
I0920 18:08:27.556174 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.207 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19672-8777/.minikube/machines/old-k8s-version-744025/id_rsa -p 22] /usr/bin/ssh <nil>}
I0920 18:08:27.556189 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | About to run SSH command:
I0920 18:08:27.556202 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | exit 0
I0920 18:08:27.685987 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | SSH cmd err, output: <nil>:
I0920 18:08:27.686194 68107 main.go:141] libmachine: (old-k8s-version-744025) KVM machine creation complete!
I0920 18:08:27.686525 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetConfigRaw
I0920 18:08:27.687088 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .DriverName
I0920 18:08:27.687317 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .DriverName
I0920 18:08:27.687446 68107 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0920 18:08:27.687471 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetState
I0920 18:08:27.688851 68107 main.go:141] libmachine: Detecting operating system of created instance...
I0920 18:08:27.688863 68107 main.go:141] libmachine: Waiting for SSH to be available...
I0920 18:08:27.688868 68107 main.go:141] libmachine: Getting to WaitForSSH function...
I0920 18:08:27.688873 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetSSHHostname
I0920 18:08:27.691501 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:27.691950 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e5:57:41", ip: ""} in network mk-old-k8s-version-744025: {Iface:virbr1 ExpiryTime:2024-09-20 19:08:17 +0000 UTC Type:0 Mac:52:54:00:e5:57:41 Iaid: IPaddr:192.168.39.207 Prefix:24 Hostname:old-k8s-version-744025 Clientid:01:52:54:00:e5:57:41}
I0920 18:08:27.691980 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined IP address 192.168.39.207 and MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:27.692099 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetSSHPort
I0920 18:08:27.692301 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetSSHKeyPath
I0920 18:08:27.692510 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetSSHKeyPath
I0920 18:08:27.692627 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetSSHUsername
I0920 18:08:27.692786 68107 main.go:141] libmachine: Using SSH client type: native
I0920 18:08:27.693017 68107 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil> [] 0s} 192.168.39.207 22 <nil> <nil>}
I0920 18:08:27.693036 68107 main.go:141] libmachine: About to run SSH command:
exit 0
I0920 18:08:27.797463 68107 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0920 18:08:27.797487 68107 main.go:141] libmachine: Detecting the provisioner...
I0920 18:08:27.797499 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetSSHHostname
I0920 18:08:27.800583 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:27.800981 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e5:57:41", ip: ""} in network mk-old-k8s-version-744025: {Iface:virbr1 ExpiryTime:2024-09-20 19:08:17 +0000 UTC Type:0 Mac:52:54:00:e5:57:41 Iaid: IPaddr:192.168.39.207 Prefix:24 Hostname:old-k8s-version-744025 Clientid:01:52:54:00:e5:57:41}
I0920 18:08:27.801020 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined IP address 192.168.39.207 and MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:27.801195 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetSSHPort
I0920 18:08:27.801383 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetSSHKeyPath
I0920 18:08:27.801578 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetSSHKeyPath
I0920 18:08:27.801737 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetSSHUsername
I0920 18:08:27.801911 68107 main.go:141] libmachine: Using SSH client type: native
I0920 18:08:27.802141 68107 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil> [] 0s} 192.168.39.207 22 <nil> <nil>}
I0920 18:08:27.802158 68107 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0920 18:08:27.915046 68107 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0920 18:08:27.915130 68107 main.go:141] libmachine: found compatible host: buildroot
I0920 18:08:27.915140 68107 main.go:141] libmachine: Provisioning with buildroot...
I0920 18:08:27.915148 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetMachineName
I0920 18:08:27.915372 68107 buildroot.go:166] provisioning hostname "old-k8s-version-744025"
I0920 18:08:27.915396 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetMachineName
I0920 18:08:27.915597 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetSSHHostname
I0920 18:08:27.918657 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:27.919253 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e5:57:41", ip: ""} in network mk-old-k8s-version-744025: {Iface:virbr1 ExpiryTime:2024-09-20 19:08:17 +0000 UTC Type:0 Mac:52:54:00:e5:57:41 Iaid: IPaddr:192.168.39.207 Prefix:24 Hostname:old-k8s-version-744025 Clientid:01:52:54:00:e5:57:41}
I0920 18:08:27.919282 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined IP address 192.168.39.207 and MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:27.919442 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetSSHPort
I0920 18:08:27.919655 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetSSHKeyPath
I0920 18:08:27.919833 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetSSHKeyPath
I0920 18:08:27.919981 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetSSHUsername
I0920 18:08:27.920175 68107 main.go:141] libmachine: Using SSH client type: native
I0920 18:08:27.920381 68107 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil> [] 0s} 192.168.39.207 22 <nil> <nil>}
I0920 18:08:27.920398 68107 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-744025 && echo "old-k8s-version-744025" | sudo tee /etc/hostname
I0920 18:08:28.045120 68107 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-744025
I0920 18:08:28.045156 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetSSHHostname
I0920 18:08:28.048091 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:28.048445 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e5:57:41", ip: ""} in network mk-old-k8s-version-744025: {Iface:virbr1 ExpiryTime:2024-09-20 19:08:17 +0000 UTC Type:0 Mac:52:54:00:e5:57:41 Iaid: IPaddr:192.168.39.207 Prefix:24 Hostname:old-k8s-version-744025 Clientid:01:52:54:00:e5:57:41}
I0920 18:08:28.048466 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined IP address 192.168.39.207 and MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:28.048700 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetSSHPort
I0920 18:08:28.048889 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetSSHKeyPath
I0920 18:08:28.049058 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetSSHKeyPath
I0920 18:08:28.049213 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetSSHUsername
I0920 18:08:28.049395 68107 main.go:141] libmachine: Using SSH client type: native
I0920 18:08:28.049574 68107 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil> [] 0s} 192.168.39.207 22 <nil> <nil>}
I0920 18:08:28.049596 68107 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-744025' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-744025/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-744025' | sudo tee -a /etc/hosts;
fi
fi
I0920 18:08:28.172049 68107 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0920 18:08:28.172082 68107 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19672-8777/.minikube CaCertPath:/home/jenkins/minikube-integration/19672-8777/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19672-8777/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19672-8777/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19672-8777/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19672-8777/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19672-8777/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19672-8777/.minikube}
I0920 18:08:28.172142 68107 buildroot.go:174] setting up certificates
I0920 18:08:28.172156 68107 provision.go:84] configureAuth start
I0920 18:08:28.172167 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetMachineName
I0920 18:08:28.172417 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetIP
I0920 18:08:28.175092 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:28.175514 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e5:57:41", ip: ""} in network mk-old-k8s-version-744025: {Iface:virbr1 ExpiryTime:2024-09-20 19:08:17 +0000 UTC Type:0 Mac:52:54:00:e5:57:41 Iaid: IPaddr:192.168.39.207 Prefix:24 Hostname:old-k8s-version-744025 Clientid:01:52:54:00:e5:57:41}
I0920 18:08:28.175541 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined IP address 192.168.39.207 and MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:28.175665 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetSSHHostname
I0920 18:08:28.178389 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:28.178731 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e5:57:41", ip: ""} in network mk-old-k8s-version-744025: {Iface:virbr1 ExpiryTime:2024-09-20 19:08:17 +0000 UTC Type:0 Mac:52:54:00:e5:57:41 Iaid: IPaddr:192.168.39.207 Prefix:24 Hostname:old-k8s-version-744025 Clientid:01:52:54:00:e5:57:41}
I0920 18:08:28.178756 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined IP address 192.168.39.207 and MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:28.178968 68107 provision.go:143] copyHostCerts
I0920 18:08:28.179043 68107 exec_runner.go:144] found /home/jenkins/minikube-integration/19672-8777/.minikube/cert.pem, removing ...
I0920 18:08:28.179062 68107 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19672-8777/.minikube/cert.pem
I0920 18:08:28.179135 68107 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19672-8777/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19672-8777/.minikube/cert.pem (1123 bytes)
I0920 18:08:28.179276 68107 exec_runner.go:144] found /home/jenkins/minikube-integration/19672-8777/.minikube/key.pem, removing ...
I0920 18:08:28.179285 68107 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19672-8777/.minikube/key.pem
I0920 18:08:28.179315 68107 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19672-8777/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19672-8777/.minikube/key.pem (1675 bytes)
I0920 18:08:28.179420 68107 exec_runner.go:144] found /home/jenkins/minikube-integration/19672-8777/.minikube/ca.pem, removing ...
I0920 18:08:28.179430 68107 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19672-8777/.minikube/ca.pem
I0920 18:08:28.179463 68107 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19672-8777/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19672-8777/.minikube/ca.pem (1082 bytes)
I0920 18:08:28.179542 68107 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19672-8777/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19672-8777/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19672-8777/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-744025 san=[127.0.0.1 192.168.39.207 localhost minikube old-k8s-version-744025]
I0920 18:08:28.512200 68107 provision.go:177] copyRemoteCerts
I0920 18:08:28.512258 68107 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0920 18:08:28.512280 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetSSHHostname
I0920 18:08:28.515009 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:28.515415 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e5:57:41", ip: ""} in network mk-old-k8s-version-744025: {Iface:virbr1 ExpiryTime:2024-09-20 19:08:17 +0000 UTC Type:0 Mac:52:54:00:e5:57:41 Iaid: IPaddr:192.168.39.207 Prefix:24 Hostname:old-k8s-version-744025 Clientid:01:52:54:00:e5:57:41}
I0920 18:08:28.515444 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined IP address 192.168.39.207 and MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:28.515639 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetSSHPort
I0920 18:08:28.515865 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetSSHKeyPath
I0920 18:08:28.516141 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetSSHUsername
I0920 18:08:28.516315 68107 sshutil.go:53] new ssh client: &{IP:192.168.39.207 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19672-8777/.minikube/machines/old-k8s-version-744025/id_rsa Username:docker}
I0920 18:08:28.600101 68107 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-8777/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0920 18:08:28.628168 68107 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-8777/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0920 18:08:28.654554 68107 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-8777/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0920 18:08:28.681672 68107 provision.go:87] duration metric: took 509.504039ms to configureAuth
I0920 18:08:28.681705 68107 buildroot.go:189] setting minikube options for container-runtime
I0920 18:08:28.681918 68107 config.go:182] Loaded profile config "old-k8s-version-744025": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0920 18:08:28.681989 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetSSHHostname
I0920 18:08:28.684885 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:28.685377 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e5:57:41", ip: ""} in network mk-old-k8s-version-744025: {Iface:virbr1 ExpiryTime:2024-09-20 19:08:17 +0000 UTC Type:0 Mac:52:54:00:e5:57:41 Iaid: IPaddr:192.168.39.207 Prefix:24 Hostname:old-k8s-version-744025 Clientid:01:52:54:00:e5:57:41}
I0920 18:08:28.685410 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined IP address 192.168.39.207 and MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:28.685595 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetSSHPort
I0920 18:08:28.685792 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetSSHKeyPath
I0920 18:08:28.685956 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetSSHKeyPath
I0920 18:08:28.686106 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetSSHUsername
I0920 18:08:28.686268 68107 main.go:141] libmachine: Using SSH client type: native
I0920 18:08:28.686455 68107 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil> [] 0s} 192.168.39.207 22 <nil> <nil>}
I0920 18:08:28.686477 68107 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0920 18:08:28.945781 68107 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0920 18:08:28.945807 68107 main.go:141] libmachine: Checking connection to Docker...
I0920 18:08:28.945816 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetURL
I0920 18:08:28.947093 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | Using libvirt version 6000000
I0920 18:08:28.949507 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:28.949941 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e5:57:41", ip: ""} in network mk-old-k8s-version-744025: {Iface:virbr1 ExpiryTime:2024-09-20 19:08:17 +0000 UTC Type:0 Mac:52:54:00:e5:57:41 Iaid: IPaddr:192.168.39.207 Prefix:24 Hostname:old-k8s-version-744025 Clientid:01:52:54:00:e5:57:41}
I0920 18:08:28.949969 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined IP address 192.168.39.207 and MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:28.950131 68107 main.go:141] libmachine: Docker is up and running!
I0920 18:08:28.950146 68107 main.go:141] libmachine: Reticulating splines...
I0920 18:08:28.950154 68107 client.go:171] duration metric: took 28.210101936s to LocalClient.Create
I0920 18:08:28.950182 68107 start.go:167] duration metric: took 28.210177602s to libmachine.API.Create "old-k8s-version-744025"
I0920 18:08:28.950190 68107 start.go:293] postStartSetup for "old-k8s-version-744025" (driver="kvm2")
I0920 18:08:28.950199 68107 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0920 18:08:28.950225 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .DriverName
I0920 18:08:28.950440 68107 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0920 18:08:28.950467 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetSSHHostname
I0920 18:08:28.952521 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:28.952894 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e5:57:41", ip: ""} in network mk-old-k8s-version-744025: {Iface:virbr1 ExpiryTime:2024-09-20 19:08:17 +0000 UTC Type:0 Mac:52:54:00:e5:57:41 Iaid: IPaddr:192.168.39.207 Prefix:24 Hostname:old-k8s-version-744025 Clientid:01:52:54:00:e5:57:41}
I0920 18:08:28.952928 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined IP address 192.168.39.207 and MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:28.953042 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetSSHPort
I0920 18:08:28.953188 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetSSHKeyPath
I0920 18:08:28.953362 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetSSHUsername
I0920 18:08:28.953498 68107 sshutil.go:53] new ssh client: &{IP:192.168.39.207 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19672-8777/.minikube/machines/old-k8s-version-744025/id_rsa Username:docker}
I0920 18:08:29.042049 68107 ssh_runner.go:195] Run: cat /etc/os-release
I0920 18:08:29.046985 68107 info.go:137] Remote host: Buildroot 2023.02.9
I0920 18:08:29.047012 68107 filesync.go:126] Scanning /home/jenkins/minikube-integration/19672-8777/.minikube/addons for local assets ...
I0920 18:08:29.047067 68107 filesync.go:126] Scanning /home/jenkins/minikube-integration/19672-8777/.minikube/files for local assets ...
I0920 18:08:29.047153 68107 filesync.go:149] local asset: /home/jenkins/minikube-integration/19672-8777/.minikube/files/etc/ssl/certs/159732.pem -> 159732.pem in /etc/ssl/certs
I0920 18:08:29.047247 68107 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0920 18:08:29.057309 68107 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-8777/.minikube/files/etc/ssl/certs/159732.pem --> /etc/ssl/certs/159732.pem (1708 bytes)
I0920 18:08:29.084017 68107 start.go:296] duration metric: took 133.813095ms for postStartSetup
I0920 18:08:29.084078 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetConfigRaw
I0920 18:08:29.084688 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetIP
I0920 18:08:29.087621 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:29.088043 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e5:57:41", ip: ""} in network mk-old-k8s-version-744025: {Iface:virbr1 ExpiryTime:2024-09-20 19:08:17 +0000 UTC Type:0 Mac:52:54:00:e5:57:41 Iaid: IPaddr:192.168.39.207 Prefix:24 Hostname:old-k8s-version-744025 Clientid:01:52:54:00:e5:57:41}
I0920 18:08:29.088066 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined IP address 192.168.39.207 and MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:29.088315 68107 profile.go:143] Saving config to /home/jenkins/minikube-integration/19672-8777/.minikube/profiles/old-k8s-version-744025/config.json ...
I0920 18:08:29.088548 68107 start.go:128] duration metric: took 28.373697144s to createHost
I0920 18:08:29.088579 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetSSHHostname
I0920 18:08:29.090868 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:29.091152 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e5:57:41", ip: ""} in network mk-old-k8s-version-744025: {Iface:virbr1 ExpiryTime:2024-09-20 19:08:17 +0000 UTC Type:0 Mac:52:54:00:e5:57:41 Iaid: IPaddr:192.168.39.207 Prefix:24 Hostname:old-k8s-version-744025 Clientid:01:52:54:00:e5:57:41}
I0920 18:08:29.091180 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined IP address 192.168.39.207 and MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:29.091318 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetSSHPort
I0920 18:08:29.091481 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetSSHKeyPath
I0920 18:08:29.091607 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetSSHKeyPath
I0920 18:08:29.091784 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetSSHUsername
I0920 18:08:29.091913 68107 main.go:141] libmachine: Using SSH client type: native
I0920 18:08:29.092065 68107 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil> [] 0s} 192.168.39.207 22 <nil> <nil>}
I0920 18:08:29.092070 68107 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0920 18:08:29.202587 68107 main.go:141] libmachine: SSH cmd err, output: <nil>: 1726855709.188676025
I0920 18:08:29.202614 68107 fix.go:216] guest clock: 1726855709.188676025
I0920 18:08:29.202624 68107 fix.go:229] Guest: 2024-09-20 18:08:29.188676025 +0000 UTC Remote: 2024-09-20 18:08:29.088568596 +0000 UTC m=+36.902191149 (delta=100.107429ms)
I0920 18:08:29.202661 68107 fix.go:200] guest clock delta is within tolerance: 100.107429ms
I0920 18:08:29.202669 68107 start.go:83] releasing machines lock for "old-k8s-version-744025", held for 28.488006746s
I0920 18:08:29.202694 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .DriverName
I0920 18:08:29.203036 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetIP
I0920 18:08:29.206028 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:29.206419 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e5:57:41", ip: ""} in network mk-old-k8s-version-744025: {Iface:virbr1 ExpiryTime:2024-09-20 19:08:17 +0000 UTC Type:0 Mac:52:54:00:e5:57:41 Iaid: IPaddr:192.168.39.207 Prefix:24 Hostname:old-k8s-version-744025 Clientid:01:52:54:00:e5:57:41}
I0920 18:08:29.206468 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined IP address 192.168.39.207 and MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:29.206585 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .DriverName
I0920 18:08:29.207102 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .DriverName
I0920 18:08:29.207287 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .DriverName
I0920 18:08:29.207374 68107 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0920 18:08:29.207420 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetSSHHostname
I0920 18:08:29.207571 68107 ssh_runner.go:195] Run: cat /version.json
I0920 18:08:29.207599 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetSSHHostname
I0920 18:08:29.210232 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:29.210732 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e5:57:41", ip: ""} in network mk-old-k8s-version-744025: {Iface:virbr1 ExpiryTime:2024-09-20 19:08:17 +0000 UTC Type:0 Mac:52:54:00:e5:57:41 Iaid: IPaddr:192.168.39.207 Prefix:24 Hostname:old-k8s-version-744025 Clientid:01:52:54:00:e5:57:41}
I0920 18:08:29.210762 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined IP address 192.168.39.207 and MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:29.214114 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetSSHPort
I0920 18:08:29.214308 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetSSHKeyPath
I0920 18:08:29.214469 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetSSHUsername
I0920 18:08:29.214640 68107 sshutil.go:53] new ssh client: &{IP:192.168.39.207 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19672-8777/.minikube/machines/old-k8s-version-744025/id_rsa Username:docker}
I0920 18:08:29.220135 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:29.220552 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e5:57:41", ip: ""} in network mk-old-k8s-version-744025: {Iface:virbr1 ExpiryTime:2024-09-20 19:08:17 +0000 UTC Type:0 Mac:52:54:00:e5:57:41 Iaid: IPaddr:192.168.39.207 Prefix:24 Hostname:old-k8s-version-744025 Clientid:01:52:54:00:e5:57:41}
I0920 18:08:29.220581 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined IP address 192.168.39.207 and MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:29.220796 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetSSHPort
I0920 18:08:29.220984 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetSSHKeyPath
I0920 18:08:29.221139 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetSSHUsername
I0920 18:08:29.221284 68107 sshutil.go:53] new ssh client: &{IP:192.168.39.207 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19672-8777/.minikube/machines/old-k8s-version-744025/id_rsa Username:docker}
I0920 18:08:29.332787 68107 ssh_runner.go:195] Run: systemctl --version
I0920 18:08:29.340942 68107 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0920 18:08:29.501080 68107 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0920 18:08:29.509173 68107 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0920 18:08:29.509246 68107 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0920 18:08:29.527367 68107 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0920 18:08:29.527387 68107 start.go:495] detecting cgroup driver to use...
I0920 18:08:29.527438 68107 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0920 18:08:29.546450 68107 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0920 18:08:29.562332 68107 docker.go:217] disabling cri-docker service (if available) ...
I0920 18:08:29.562396 68107 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0920 18:08:29.577973 68107 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0920 18:08:29.593106 68107 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0920 18:08:29.749167 68107 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0920 18:08:29.953364 68107 docker.go:233] disabling docker service ...
I0920 18:08:29.953442 68107 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0920 18:08:29.971446 68107 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0920 18:08:29.991048 68107 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0920 18:08:30.165349 68107 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0920 18:08:30.324854 68107 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0920 18:08:30.340622 68107 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0920 18:08:30.361143 68107 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0920 18:08:30.361216 68107 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0920 18:08:30.373611 68107 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0920 18:08:30.373694 68107 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0920 18:08:30.385148 68107 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0920 18:08:30.396278 68107 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0920 18:08:30.408942 68107 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0920 18:08:30.422493 68107 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0920 18:08:30.433938 68107 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0920 18:08:30.433998 68107 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0920 18:08:30.456521 68107 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0920 18:08:30.475039 68107 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0920 18:08:30.604060 68107 ssh_runner.go:195] Run: sudo systemctl restart crio
I0920 18:08:30.723220 68107 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0920 18:08:30.723276 68107 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0920 18:08:30.728409 68107 start.go:563] Will wait 60s for crictl version
I0920 18:08:30.728475 68107 ssh_runner.go:195] Run: which crictl
I0920 18:08:30.732890 68107 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0920 18:08:30.771272 68107 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0920 18:08:30.771368 68107 ssh_runner.go:195] Run: crio --version
I0920 18:08:30.802380 68107 ssh_runner.go:195] Run: crio --version
I0920 18:08:30.833266 68107 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0920 18:08:30.834310 68107 main.go:141] libmachine: (old-k8s-version-744025) Calling .GetIP
I0920 18:08:30.837039 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:30.837399 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e5:57:41", ip: ""} in network mk-old-k8s-version-744025: {Iface:virbr1 ExpiryTime:2024-09-20 19:08:17 +0000 UTC Type:0 Mac:52:54:00:e5:57:41 Iaid: IPaddr:192.168.39.207 Prefix:24 Hostname:old-k8s-version-744025 Clientid:01:52:54:00:e5:57:41}
I0920 18:08:30.837438 68107 main.go:141] libmachine: (old-k8s-version-744025) DBG | domain old-k8s-version-744025 has defined IP address 192.168.39.207 and MAC address 52:54:00:e5:57:41 in network mk-old-k8s-version-744025
I0920 18:08:30.837675 68107 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I0920 18:08:30.841962 68107 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0920 18:08:30.855121 68107 kubeadm.go:883] updating cluster {Name:old-k8s-version-744025 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19672/minikube-v1.34.0-1726784654-19672-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-744025 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.207 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] M
ountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0920 18:08:30.855233 68107 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0920 18:08:30.855306 68107 ssh_runner.go:195] Run: sudo crictl images --output json
I0920 18:08:30.892870 68107 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0920 18:08:30.892969 68107 ssh_runner.go:195] Run: which lz4
I0920 18:08:30.897177 68107 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0920 18:08:30.902074 68107 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0920 18:08:30.902104 68107 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-8777/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0920 18:08:32.684139 68107 crio.go:462] duration metric: took 1.786999535s to copy over tarball
I0920 18:08:32.684228 68107 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0920 18:08:35.912536 68107 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.228274171s)
I0920 18:08:35.912559 68107 crio.go:469] duration metric: took 3.228392097s to extract the tarball
I0920 18:08:35.912571 68107 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0920 18:08:35.959829 68107 ssh_runner.go:195] Run: sudo crictl images --output json
I0920 18:08:36.117687 68107 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0920 18:08:36.117714 68107 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0920 18:08:36.117804 68107 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0920 18:08:36.117830 68107 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0920 18:08:36.117860 68107 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0920 18:08:36.117854 68107 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0920 18:08:36.117878 68107 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0920 18:08:36.117814 68107 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0920 18:08:36.117805 68107 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0920 18:08:36.117805 68107 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0920 18:08:36.119241 68107 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0920 18:08:36.119399 68107 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0920 18:08:36.119602 68107 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0920 18:08:36.119966 68107 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0920 18:08:36.119983 68107 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0920 18:08:36.120006 68107 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0920 18:08:36.120044 68107 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0920 18:08:36.119966 68107 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0920 18:08:36.366624 68107 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0920 18:08:36.412948 68107 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0920 18:08:36.413005 68107 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0920 18:08:36.413054 68107 ssh_runner.go:195] Run: which crictl
I0920 18:08:36.417322 68107 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0920 18:08:36.441425 68107 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0920 18:08:36.444029 68107 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0920 18:08:36.444868 68107 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0920 18:08:36.455229 68107 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0920 18:08:36.462739 68107 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0920 18:08:36.482385 68107 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0920 18:08:36.510692 68107 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0920 18:08:36.636058 68107 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0920 18:08:36.636104 68107 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0920 18:08:36.636132 68107 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0920 18:08:36.636167 68107 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0920 18:08:36.636183 68107 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0920 18:08:36.636196 68107 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0920 18:08:36.636218 68107 ssh_runner.go:195] Run: which crictl
I0920 18:08:36.636232 68107 ssh_runner.go:195] Run: which crictl
I0920 18:08:36.636257 68107 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0920 18:08:36.636150 68107 ssh_runner.go:195] Run: which crictl
I0920 18:08:36.636288 68107 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0920 18:08:36.636308 68107 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0920 18:08:36.636332 68107 ssh_runner.go:195] Run: which crictl
I0920 18:08:36.660197 68107 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0920 18:08:36.660254 68107 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0920 18:08:36.660263 68107 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0920 18:08:36.660295 68107 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0920 18:08:36.660317 68107 ssh_runner.go:195] Run: which crictl
I0920 18:08:36.660342 68107 ssh_runner.go:195] Run: which crictl
I0920 18:08:36.686764 68107 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0920 18:08:36.686821 68107 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0920 18:08:36.686847 68107 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0920 18:08:36.686935 68107 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0920 18:08:36.686949 68107 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19672-8777/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0920 18:08:36.686986 68107 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0920 18:08:36.687002 68107 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0920 18:08:36.825614 68107 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0920 18:08:36.825681 68107 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0920 18:08:36.825705 68107 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0920 18:08:36.825804 68107 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0920 18:08:36.825963 68107 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0920 18:08:36.830070 68107 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0920 18:08:36.972774 68107 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0920 18:08:37.008642 68107 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0920 18:08:37.008746 68107 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0920 18:08:37.008644 68107 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0920 18:08:37.008697 68107 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0920 18:08:37.008908 68107 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0920 18:08:37.039202 68107 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19672-8777/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0920 18:08:37.114037 68107 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19672-8777/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0920 18:08:37.129973 68107 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19672-8777/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0920 18:08:37.137502 68107 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19672-8777/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0920 18:08:37.137769 68107 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19672-8777/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0920 18:08:37.142681 68107 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19672-8777/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0920 18:08:37.376052 68107 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0920 18:08:37.522406 68107 cache_images.go:92] duration metric: took 1.404671469s to LoadCachedImages
W0920 18:08:37.522492 68107 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19672-8777/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19672-8777/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2: no such file or directory
I0920 18:08:37.522511 68107 kubeadm.go:934] updating node { 192.168.39.207 8443 v1.20.0 crio true true} ...
I0920 18:08:37.522626 68107 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-744025 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.39.207
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-744025 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0920 18:08:37.522687 68107 ssh_runner.go:195] Run: crio config
I0920 18:08:37.576585 68107 cni.go:84] Creating CNI manager for ""
I0920 18:08:37.576613 68107 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0920 18:08:37.576625 68107 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0920 18:08:37.576648 68107 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.207 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-744025 NodeName:old-k8s-version-744025 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.207"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.207 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0920 18:08:37.576823 68107 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.39.207
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-744025"
kubeletExtraArgs:
node-ip: 192.168.39.207
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.39.207"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0920 18:08:37.576908 68107 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0920 18:08:37.588487 68107 binaries.go:44] Found k8s binaries, skipping transfer
I0920 18:08:37.588580 68107 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0920 18:08:37.599040 68107 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0920 18:08:37.618476 68107 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0920 18:08:37.639363 68107 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0920 18:08:37.667266 68107 ssh_runner.go:195] Run: grep 192.168.39.207 control-plane.minikube.internal$ /etc/hosts
I0920 18:08:37.675181 68107 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.207 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0920 18:08:37.694240 68107 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0920 18:08:37.867643 68107 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0920 18:08:37.892246 68107 certs.go:68] Setting up /home/jenkins/minikube-integration/19672-8777/.minikube/profiles/old-k8s-version-744025 for IP: 192.168.39.207
I0920 18:08:37.892265 68107 certs.go:194] generating shared ca certs ...
I0920 18:08:37.892280 68107 certs.go:226] acquiring lock for ca certs: {Name:mkc7ef6c737c6bdc3fdd9dcff8f57029c020d8f7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 18:08:37.892433 68107 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19672-8777/.minikube/ca.key
I0920 18:08:37.892504 68107 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19672-8777/.minikube/proxy-client-ca.key
I0920 18:08:37.892516 68107 certs.go:256] generating profile certs ...
I0920 18:08:37.892588 68107 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19672-8777/.minikube/profiles/old-k8s-version-744025/client.key
I0920 18:08:37.892606 68107 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19672-8777/.minikube/profiles/old-k8s-version-744025/client.crt with IP's: []
I0920 18:08:38.124952 68107 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19672-8777/.minikube/profiles/old-k8s-version-744025/client.crt ...
I0920 18:08:38.124994 68107 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19672-8777/.minikube/profiles/old-k8s-version-744025/client.crt: {Name:mked2213d0697b94174256667a4e94da5a2c8a92 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 18:08:38.125339 68107 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19672-8777/.minikube/profiles/old-k8s-version-744025/client.key ...
I0920 18:08:38.125376 68107 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19672-8777/.minikube/profiles/old-k8s-version-744025/client.key: {Name:mk65eb0c240ebd1aec10f5dc62413d0b006298d5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 18:08:38.125523 68107 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19672-8777/.minikube/profiles/old-k8s-version-744025/apiserver.key.3105b99d
I0920 18:08:38.125549 68107 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19672-8777/.minikube/profiles/old-k8s-version-744025/apiserver.crt.3105b99d with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.207]
I0920 18:08:38.242420 68107 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19672-8777/.minikube/profiles/old-k8s-version-744025/apiserver.crt.3105b99d ...
I0920 18:08:38.242470 68107 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19672-8777/.minikube/profiles/old-k8s-version-744025/apiserver.crt.3105b99d: {Name:mkf44f7d93f09e9108cf48b884f9bf2605366c21 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 18:08:38.242743 68107 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19672-8777/.minikube/profiles/old-k8s-version-744025/apiserver.key.3105b99d ...
I0920 18:08:38.242765 68107 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19672-8777/.minikube/profiles/old-k8s-version-744025/apiserver.key.3105b99d: {Name:mkbd9ff14fe5e7fde002b982965fd0dc1df71095 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 18:08:38.242865 68107 certs.go:381] copying /home/jenkins/minikube-integration/19672-8777/.minikube/profiles/old-k8s-version-744025/apiserver.crt.3105b99d -> /home/jenkins/minikube-integration/19672-8777/.minikube/profiles/old-k8s-version-744025/apiserver.crt
I0920 18:08:38.242932 68107 certs.go:385] copying /home/jenkins/minikube-integration/19672-8777/.minikube/profiles/old-k8s-version-744025/apiserver.key.3105b99d -> /home/jenkins/minikube-integration/19672-8777/.minikube/profiles/old-k8s-version-744025/apiserver.key
I0920 18:08:38.242986 68107 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19672-8777/.minikube/profiles/old-k8s-version-744025/proxy-client.key
I0920 18:08:38.243004 68107 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19672-8777/.minikube/profiles/old-k8s-version-744025/proxy-client.crt with IP's: []
I0920 18:08:38.357765 68107 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19672-8777/.minikube/profiles/old-k8s-version-744025/proxy-client.crt ...
I0920 18:08:38.357811 68107 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19672-8777/.minikube/profiles/old-k8s-version-744025/proxy-client.crt: {Name:mk2d0f00e42d451c568da7c65958f4b4da51d102 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 18:08:38.358099 68107 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19672-8777/.minikube/profiles/old-k8s-version-744025/proxy-client.key ...
I0920 18:08:38.358122 68107 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19672-8777/.minikube/profiles/old-k8s-version-744025/proxy-client.key: {Name:mkd23143bd5d9aef58152b199a90f4853a04f875 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 18:08:38.358418 68107 certs.go:484] found cert: /home/jenkins/minikube-integration/19672-8777/.minikube/certs/15973.pem (1338 bytes)
W0920 18:08:38.358471 68107 certs.go:480] ignoring /home/jenkins/minikube-integration/19672-8777/.minikube/certs/15973_empty.pem, impossibly tiny 0 bytes
I0920 18:08:38.358486 68107 certs.go:484] found cert: /home/jenkins/minikube-integration/19672-8777/.minikube/certs/ca-key.pem (1675 bytes)
I0920 18:08:38.358517 68107 certs.go:484] found cert: /home/jenkins/minikube-integration/19672-8777/.minikube/certs/ca.pem (1082 bytes)
I0920 18:08:38.358549 68107 certs.go:484] found cert: /home/jenkins/minikube-integration/19672-8777/.minikube/certs/cert.pem (1123 bytes)
I0920 18:08:38.358579 68107 certs.go:484] found cert: /home/jenkins/minikube-integration/19672-8777/.minikube/certs/key.pem (1675 bytes)
I0920 18:08:38.358632 68107 certs.go:484] found cert: /home/jenkins/minikube-integration/19672-8777/.minikube/files/etc/ssl/certs/159732.pem (1708 bytes)
I0920 18:08:38.359573 68107 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-8777/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0920 18:08:38.390142 68107 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-8777/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0920 18:08:38.415440 68107 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-8777/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0920 18:08:38.444294 68107 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-8777/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0920 18:08:38.475543 68107 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-8777/.minikube/profiles/old-k8s-version-744025/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0920 18:08:38.503851 68107 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-8777/.minikube/profiles/old-k8s-version-744025/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0920 18:08:38.533592 68107 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-8777/.minikube/profiles/old-k8s-version-744025/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0920 18:08:38.562021 68107 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-8777/.minikube/profiles/old-k8s-version-744025/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0920 18:08:38.589737 68107 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-8777/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0920 18:08:38.617322 68107 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-8777/.minikube/certs/15973.pem --> /usr/share/ca-certificates/15973.pem (1338 bytes)
I0920 18:08:38.643804 68107 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-8777/.minikube/files/etc/ssl/certs/159732.pem --> /usr/share/ca-certificates/159732.pem (1708 bytes)
I0920 18:08:38.668703 68107 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0920 18:08:38.686615 68107 ssh_runner.go:195] Run: openssl version
I0920 18:08:38.692555 68107 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0920 18:08:38.702863 68107 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0920 18:08:38.707534 68107 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 20 16:44 /usr/share/ca-certificates/minikubeCA.pem
I0920 18:08:38.707583 68107 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0920 18:08:38.713323 68107 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0920 18:08:38.725327 68107 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/15973.pem && ln -fs /usr/share/ca-certificates/15973.pem /etc/ssl/certs/15973.pem"
I0920 18:08:38.737273 68107 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/15973.pem
I0920 18:08:38.742658 68107 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 20 17:04 /usr/share/ca-certificates/15973.pem
I0920 18:08:38.742722 68107 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/15973.pem
I0920 18:08:38.748745 68107 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/15973.pem /etc/ssl/certs/51391683.0"
I0920 18:08:38.762654 68107 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/159732.pem && ln -fs /usr/share/ca-certificates/159732.pem /etc/ssl/certs/159732.pem"
I0920 18:08:38.774745 68107 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/159732.pem
I0920 18:08:38.779404 68107 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 20 17:04 /usr/share/ca-certificates/159732.pem
I0920 18:08:38.779461 68107 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/159732.pem
I0920 18:08:38.785425 68107 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/159732.pem /etc/ssl/certs/3ec20f2e.0"
I0920 18:08:38.796660 68107 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0920 18:08:38.800751 68107 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0920 18:08:38.800812 68107 kubeadm.go:392] StartCluster: {Name:old-k8s-version-744025 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19672/minikube-v1.34.0-1726784654-19672-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-744025 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.207 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0920 18:08:38.800920 68107 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0920 18:08:38.800971 68107 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0920 18:08:38.848846 68107 cri.go:89] found id: ""
I0920 18:08:38.848922 68107 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0920 18:08:38.860694 68107 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0920 18:08:38.871719 68107 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0920 18:08:38.882959 68107 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0920 18:08:38.882979 68107 kubeadm.go:157] found existing configuration files:
I0920 18:08:38.883033 68107 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0920 18:08:38.893714 68107 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0920 18:08:38.893789 68107 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0920 18:08:38.904055 68107 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0920 18:08:38.915573 68107 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0920 18:08:38.915651 68107 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0920 18:08:38.926241 68107 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0920 18:08:38.940262 68107 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0920 18:08:38.940334 68107 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0920 18:08:38.951999 68107 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0920 18:08:38.963597 68107 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0920 18:08:38.963670 68107 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0920 18:08:38.977754 68107 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0920 18:08:39.116196 68107 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0920 18:08:39.116272 68107 kubeadm.go:310] [preflight] Running pre-flight checks
I0920 18:08:39.273231 68107 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0920 18:08:39.273387 68107 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0920 18:08:39.273531 68107 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0920 18:08:39.475010 68107 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0920 18:08:39.477944 68107 out.go:235] - Generating certificates and keys ...
I0920 18:08:39.478045 68107 kubeadm.go:310] [certs] Using existing ca certificate authority
I0920 18:08:39.478126 68107 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0920 18:08:39.570238 68107 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0920 18:08:39.731375 68107 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0920 18:08:39.925125 68107 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0920 18:08:40.081817 68107 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0920 18:08:40.292253 68107 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0920 18:08:40.292503 68107 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-744025] and IPs [192.168.39.207 127.0.0.1 ::1]
I0920 18:08:40.417567 68107 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0920 18:08:40.417748 68107 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-744025] and IPs [192.168.39.207 127.0.0.1 ::1]
I0920 18:08:40.600720 68107 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0920 18:08:40.683240 68107 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0920 18:08:41.029081 68107 kubeadm.go:310] [certs] Generating "sa" key and public key
I0920 18:08:41.030728 68107 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0920 18:08:41.110986 68107 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0920 18:08:41.328529 68107 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0920 18:08:41.490462 68107 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0920 18:08:41.709825 68107 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0920 18:08:41.730234 68107 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0920 18:08:41.731749 68107 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0920 18:08:41.731811 68107 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0920 18:08:41.871000 68107 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0920 18:08:41.872894 68107 out.go:235] - Booting up control plane ...
I0920 18:08:41.873018 68107 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0920 18:08:41.883333 68107 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0920 18:08:41.884549 68107 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0920 18:08:41.885395 68107 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0920 18:08:41.890353 68107 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0920 18:09:21.884708 68107 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0920 18:09:21.885162 68107 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0920 18:09:21.885425 68107 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0920 18:09:26.885869 68107 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0920 18:09:26.886070 68107 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0920 18:09:36.886548 68107 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0920 18:09:36.886801 68107 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0920 18:09:56.887660 68107 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0920 18:09:56.887890 68107 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0920 18:10:36.891262 68107 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0920 18:10:36.891564 68107 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0920 18:10:36.891591 68107 kubeadm.go:310]
I0920 18:10:36.891659 68107 kubeadm.go:310] Unfortunately, an error has occurred:
I0920 18:10:36.891714 68107 kubeadm.go:310] timed out waiting for the condition
I0920 18:10:36.891725 68107 kubeadm.go:310]
I0920 18:10:36.891775 68107 kubeadm.go:310] This error is likely caused by:
I0920 18:10:36.891833 68107 kubeadm.go:310] - The kubelet is not running
I0920 18:10:36.891981 68107 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0920 18:10:36.891992 68107 kubeadm.go:310]
I0920 18:10:36.892128 68107 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0920 18:10:36.892177 68107 kubeadm.go:310] - 'systemctl status kubelet'
I0920 18:10:36.892419 68107 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0920 18:10:36.892434 68107 kubeadm.go:310]
I0920 18:10:36.892579 68107 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0920 18:10:36.892698 68107 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0920 18:10:36.892711 68107 kubeadm.go:310]
I0920 18:10:36.892959 68107 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0920 18:10:36.893079 68107 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0920 18:10:36.893187 68107 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0920 18:10:36.893277 68107 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0920 18:10:36.893289 68107 kubeadm.go:310]
I0920 18:10:36.893565 68107 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0920 18:10:36.893695 68107 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0920 18:10:36.893807 68107 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
W0920 18:10:36.893963 68107 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-744025] and IPs [192.168.39.207 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-744025] and IPs [192.168.39.207 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-744025] and IPs [192.168.39.207 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-744025] and IPs [192.168.39.207 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0920 18:10:36.894021 68107 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0920 18:10:37.588688 68107 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0920 18:10:37.604600 68107 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0920 18:10:37.615869 68107 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0920 18:10:37.615897 68107 kubeadm.go:157] found existing configuration files:
I0920 18:10:37.615964 68107 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0920 18:10:37.626773 68107 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0920 18:10:37.626867 68107 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0920 18:10:37.637097 68107 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0920 18:10:37.647090 68107 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0920 18:10:37.647149 68107 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0920 18:10:37.658217 68107 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0920 18:10:37.669249 68107 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0920 18:10:37.669320 68107 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0920 18:10:37.680303 68107 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0920 18:10:37.690079 68107 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0920 18:10:37.690151 68107 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0920 18:10:37.700409 68107 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0920 18:10:37.777186 68107 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0920 18:10:37.777305 68107 kubeadm.go:310] [preflight] Running pre-flight checks
I0920 18:10:37.930742 68107 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0920 18:10:37.930901 68107 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0920 18:10:37.931016 68107 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0920 18:10:38.128283 68107 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0920 18:10:38.130192 68107 out.go:235] - Generating certificates and keys ...
I0920 18:10:38.130309 68107 kubeadm.go:310] [certs] Using existing ca certificate authority
I0920 18:10:38.130402 68107 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0920 18:10:38.130540 68107 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0920 18:10:38.130638 68107 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0920 18:10:38.130731 68107 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0920 18:10:38.130807 68107 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0920 18:10:38.130898 68107 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0920 18:10:38.131280 68107 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0920 18:10:38.131772 68107 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0920 18:10:38.132096 68107 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0920 18:10:38.132167 68107 kubeadm.go:310] [certs] Using the existing "sa" key
I0920 18:10:38.132259 68107 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0920 18:10:38.306799 68107 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0920 18:10:38.483123 68107 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0920 18:10:38.576487 68107 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0920 18:10:38.754374 68107 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0920 18:10:38.775109 68107 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0920 18:10:38.776208 68107 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0920 18:10:38.776297 68107 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0920 18:10:38.939188 68107 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0920 18:10:38.940965 68107 out.go:235] - Booting up control plane ...
I0920 18:10:38.941091 68107 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0920 18:10:38.946126 68107 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0920 18:10:38.947314 68107 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0920 18:10:38.948252 68107 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0920 18:10:38.964237 68107 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0920 18:11:18.967209 68107 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0920 18:11:18.967621 68107 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0920 18:11:18.967905 68107 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0920 18:11:23.968401 68107 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0920 18:11:23.968633 68107 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0920 18:11:33.969437 68107 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0920 18:11:33.969635 68107 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0920 18:11:53.970787 68107 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0920 18:11:53.971018 68107 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0920 18:12:33.970548 68107 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0920 18:12:33.970780 68107 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0920 18:12:33.970790 68107 kubeadm.go:310]
I0920 18:12:33.970826 68107 kubeadm.go:310] Unfortunately, an error has occurred:
I0920 18:12:33.970893 68107 kubeadm.go:310] timed out waiting for the condition
I0920 18:12:33.970915 68107 kubeadm.go:310]
I0920 18:12:33.970964 68107 kubeadm.go:310] This error is likely caused by:
I0920 18:12:33.971015 68107 kubeadm.go:310] - The kubelet is not running
I0920 18:12:33.971164 68107 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0920 18:12:33.971175 68107 kubeadm.go:310]
I0920 18:12:33.971261 68107 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0920 18:12:33.971296 68107 kubeadm.go:310] - 'systemctl status kubelet'
I0920 18:12:33.971325 68107 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0920 18:12:33.971332 68107 kubeadm.go:310]
I0920 18:12:33.971419 68107 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0920 18:12:33.971492 68107 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0920 18:12:33.971499 68107 kubeadm.go:310]
I0920 18:12:33.971610 68107 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0920 18:12:33.971686 68107 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0920 18:12:33.971810 68107 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0920 18:12:33.971966 68107 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0920 18:12:33.971990 68107 kubeadm.go:310]
I0920 18:12:33.972984 68107 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0920 18:12:33.973065 68107 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0920 18:12:33.973122 68107 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0920 18:12:33.973199 68107 kubeadm.go:394] duration metric: took 3m55.172393049s to StartCluster
I0920 18:12:33.973260 68107 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0920 18:12:33.973317 68107 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0920 18:12:34.017922 68107 cri.go:89] found id: ""
I0920 18:12:34.017949 68107 logs.go:276] 0 containers: []
W0920 18:12:34.017961 68107 logs.go:278] No container was found matching "kube-apiserver"
I0920 18:12:34.017971 68107 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0920 18:12:34.018029 68107 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0920 18:12:34.051472 68107 cri.go:89] found id: ""
I0920 18:12:34.051499 68107 logs.go:276] 0 containers: []
W0920 18:12:34.051507 68107 logs.go:278] No container was found matching "etcd"
I0920 18:12:34.051514 68107 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0920 18:12:34.051571 68107 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0920 18:12:34.084877 68107 cri.go:89] found id: ""
I0920 18:12:34.084902 68107 logs.go:276] 0 containers: []
W0920 18:12:34.084912 68107 logs.go:278] No container was found matching "coredns"
I0920 18:12:34.084919 68107 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0920 18:12:34.084979 68107 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0920 18:12:34.118862 68107 cri.go:89] found id: ""
I0920 18:12:34.118889 68107 logs.go:276] 0 containers: []
W0920 18:12:34.118898 68107 logs.go:278] No container was found matching "kube-scheduler"
I0920 18:12:34.118904 68107 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0920 18:12:34.118963 68107 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0920 18:12:34.152506 68107 cri.go:89] found id: ""
I0920 18:12:34.152534 68107 logs.go:276] 0 containers: []
W0920 18:12:34.152542 68107 logs.go:278] No container was found matching "kube-proxy"
I0920 18:12:34.152547 68107 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0920 18:12:34.152606 68107 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0920 18:12:34.186897 68107 cri.go:89] found id: ""
I0920 18:12:34.186926 68107 logs.go:276] 0 containers: []
W0920 18:12:34.186934 68107 logs.go:278] No container was found matching "kube-controller-manager"
I0920 18:12:34.186941 68107 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0920 18:12:34.186988 68107 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0920 18:12:34.235985 68107 cri.go:89] found id: ""
I0920 18:12:34.236016 68107 logs.go:276] 0 containers: []
W0920 18:12:34.236027 68107 logs.go:278] No container was found matching "kindnet"
I0920 18:12:34.236038 68107 logs.go:123] Gathering logs for kubelet ...
I0920 18:12:34.236054 68107 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0920 18:12:34.302847 68107 logs.go:123] Gathering logs for dmesg ...
I0920 18:12:34.302884 68107 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0920 18:12:34.319841 68107 logs.go:123] Gathering logs for describe nodes ...
I0920 18:12:34.319865 68107 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0920 18:12:34.449400 68107 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0920 18:12:34.449428 68107 logs.go:123] Gathering logs for CRI-O ...
I0920 18:12:34.449448 68107 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0920 18:12:34.565713 68107 logs.go:123] Gathering logs for container status ...
I0920 18:12:34.565761 68107 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0920 18:12:34.611138 68107 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0920 18:12:34.611185 68107 out.go:270] *
*
W0920 18:12:34.611229 68107 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0920 18:12:34.611245 68107 out.go:270] *
*
W0920 18:12:34.612024 68107 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0920 18:12:34.615031 68107 out.go:201]
W0920 18:12:34.616446 68107 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0920 18:12:34.616497 68107 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0920 18:12:34.616522 68107 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0920 18:12:34.618381 68107 out.go:201]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-744025 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-744025 -n old-k8s-version-744025
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-744025 -n old-k8s-version-744025: exit status 6 (226.792257ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0920 18:12:34.895514 74621 status.go:451] kubeconfig endpoint: get endpoint: "old-k8s-version-744025" does not appear in /home/jenkins/minikube-integration/19672-8777/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-744025" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (282.73s)