=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-275462 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-275462 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m56.429274835s)
-- stdout --
* [old-k8s-version-275462] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=19360
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19360-1093692/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19360-1093692/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-275462" primary control-plane node in "old-k8s-version-275462" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0731 21:18:16.490368 1142911 out.go:291] Setting OutFile to fd 1 ...
I0731 21:18:16.490480 1142911 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0731 21:18:16.490490 1142911 out.go:304] Setting ErrFile to fd 2...
I0731 21:18:16.490496 1142911 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0731 21:18:16.490699 1142911 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19360-1093692/.minikube/bin
I0731 21:18:16.491336 1142911 out.go:298] Setting JSON to false
I0731 21:18:16.492508 1142911 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-2","uptime":18047,"bootTime":1722442649,"procs":209,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1065-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0731 21:18:16.492576 1142911 start.go:139] virtualization: kvm guest
I0731 21:18:16.494714 1142911 out.go:177] * [old-k8s-version-275462] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
I0731 21:18:16.496016 1142911 notify.go:220] Checking for updates...
I0731 21:18:16.496039 1142911 out.go:177] - MINIKUBE_LOCATION=19360
I0731 21:18:16.497221 1142911 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0731 21:18:16.498362 1142911 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19360-1093692/kubeconfig
I0731 21:18:16.499512 1142911 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19360-1093692/.minikube
I0731 21:18:16.500708 1142911 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0731 21:18:16.502037 1142911 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0731 21:18:16.503576 1142911 config.go:182] Loaded profile config "cert-expiration-238338": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3
I0731 21:18:16.503669 1142911 config.go:182] Loaded profile config "kubernetes-upgrade-202332": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0731 21:18:16.503754 1142911 config.go:182] Loaded profile config "stopped-upgrade-140201": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.24.1
I0731 21:18:16.503865 1142911 driver.go:392] Setting default libvirt URI to qemu:///system
I0731 21:18:16.542965 1142911 out.go:177] * Using the kvm2 driver based on user configuration
I0731 21:18:16.544277 1142911 start.go:297] selected driver: kvm2
I0731 21:18:16.544297 1142911 start.go:901] validating driver "kvm2" against <nil>
I0731 21:18:16.544311 1142911 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0731 21:18:16.545120 1142911 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0731 21:18:16.545216 1142911 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19360-1093692/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0731 21:18:16.561820 1142911 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.1
I0731 21:18:16.561910 1142911 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0731 21:18:16.562129 1142911 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0731 21:18:16.562176 1142911 cni.go:84] Creating CNI manager for ""
I0731 21:18:16.562186 1142911 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0731 21:18:16.562194 1142911 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0731 21:18:16.562265 1142911 start.go:340] cluster config:
{Name:old-k8s-version-275462 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-275462 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0731 21:18:16.562376 1142911 iso.go:125] acquiring lock: {Name:mk34d446687dcc517f35c24f3b1478074e0450ed Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0731 21:18:16.564033 1142911 out.go:177] * Starting "old-k8s-version-275462" primary control-plane node in "old-k8s-version-275462" cluster
I0731 21:18:16.565167 1142911 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0731 21:18:16.565217 1142911 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19360-1093692/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0731 21:18:16.565233 1142911 cache.go:56] Caching tarball of preloaded images
I0731 21:18:16.565354 1142911 preload.go:172] Found /home/jenkins/minikube-integration/19360-1093692/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0731 21:18:16.565369 1142911 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0731 21:18:16.565491 1142911 profile.go:143] Saving config to /home/jenkins/minikube-integration/19360-1093692/.minikube/profiles/old-k8s-version-275462/config.json ...
I0731 21:18:16.565517 1142911 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19360-1093692/.minikube/profiles/old-k8s-version-275462/config.json: {Name:mk1a846e46c0a90a434dfed9f52cde42ac5e726f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0731 21:18:16.565681 1142911 start.go:360] acquireMachinesLock for old-k8s-version-275462: {Name:mke8ecf618b640d6b41bac344518efaa0b5a0542 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0731 21:18:43.868645 1142911 start.go:364] duration metric: took 27.302907414s to acquireMachinesLock for "old-k8s-version-275462"
I0731 21:18:43.868781 1142911 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-275462 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19339/minikube-v1.33.1-1722248113-19339-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-275462 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0731 21:18:43.868931 1142911 start.go:125] createHost starting for "" (driver="kvm2")
I0731 21:18:43.871694 1142911 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0731 21:18:43.871929 1142911 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0731 21:18:43.872010 1142911 main.go:141] libmachine: Launching plugin server for driver kvm2
I0731 21:18:43.893067 1142911 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33303
I0731 21:18:43.893691 1142911 main.go:141] libmachine: () Calling .GetVersion
I0731 21:18:43.894355 1142911 main.go:141] libmachine: Using API Version 1
I0731 21:18:43.894387 1142911 main.go:141] libmachine: () Calling .SetConfigRaw
I0731 21:18:43.894774 1142911 main.go:141] libmachine: () Calling .GetMachineName
I0731 21:18:43.894998 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetMachineName
I0731 21:18:43.895160 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .DriverName
I0731 21:18:43.895329 1142911 start.go:159] libmachine.API.Create for "old-k8s-version-275462" (driver="kvm2")
I0731 21:18:43.895369 1142911 client.go:168] LocalClient.Create starting
I0731 21:18:43.895411 1142911 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19360-1093692/.minikube/certs/ca.pem
I0731 21:18:43.895460 1142911 main.go:141] libmachine: Decoding PEM data...
I0731 21:18:43.895486 1142911 main.go:141] libmachine: Parsing certificate...
I0731 21:18:43.895561 1142911 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19360-1093692/.minikube/certs/cert.pem
I0731 21:18:43.895592 1142911 main.go:141] libmachine: Decoding PEM data...
I0731 21:18:43.895616 1142911 main.go:141] libmachine: Parsing certificate...
I0731 21:18:43.895642 1142911 main.go:141] libmachine: Running pre-create checks...
I0731 21:18:43.895655 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .PreCreateCheck
I0731 21:18:43.896067 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetConfigRaw
I0731 21:18:43.896615 1142911 main.go:141] libmachine: Creating machine...
I0731 21:18:43.896633 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .Create
I0731 21:18:43.896806 1142911 main.go:141] libmachine: (old-k8s-version-275462) Creating KVM machine...
I0731 21:18:43.898213 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | found existing default KVM network
I0731 21:18:43.899677 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | I0731 21:18:43.899474 1143286 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:ea:e4:80} reservation:<nil>}
I0731 21:18:43.900532 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | I0731 21:18:43.900449 1143286 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr4 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:06:81:d5} reservation:<nil>}
I0731 21:18:43.901556 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | I0731 21:18:43.901441 1143286 network.go:211] skipping subnet 192.168.61.0/24 that is taken: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.61.1 IfaceMTU:1500 IfaceMAC:52:54:00:e9:da:0c} reservation:<nil>}
I0731 21:18:43.902748 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | I0731 21:18:43.902605 1143286 network.go:206] using free private subnet 192.168.72.0/24: &{IP:192.168.72.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.72.0/24 Gateway:192.168.72.1 ClientMin:192.168.72.2 ClientMax:192.168.72.254 Broadcast:192.168.72.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00030f630}
I0731 21:18:43.902789 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | created network xml:
I0731 21:18:43.902801 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | <network>
I0731 21:18:43.902815 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | <name>mk-old-k8s-version-275462</name>
I0731 21:18:43.902825 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | <dns enable='no'/>
I0731 21:18:43.902837 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG |
I0731 21:18:43.902846 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | <ip address='192.168.72.1' netmask='255.255.255.0'>
I0731 21:18:43.902856 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | <dhcp>
I0731 21:18:43.902865 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | <range start='192.168.72.2' end='192.168.72.253'/>
I0731 21:18:43.902875 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | </dhcp>
I0731 21:18:43.902889 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | </ip>
I0731 21:18:43.902901 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG |
I0731 21:18:43.902912 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | </network>
I0731 21:18:43.902926 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG |
I0731 21:18:43.908183 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | trying to create private KVM network mk-old-k8s-version-275462 192.168.72.0/24...
I0731 21:18:43.990702 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | private KVM network mk-old-k8s-version-275462 192.168.72.0/24 created
I0731 21:18:43.990738 1142911 main.go:141] libmachine: (old-k8s-version-275462) Setting up store path in /home/jenkins/minikube-integration/19360-1093692/.minikube/machines/old-k8s-version-275462 ...
I0731 21:18:43.990751 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | I0731 21:18:43.990631 1143286 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19360-1093692/.minikube
I0731 21:18:43.990773 1142911 main.go:141] libmachine: (old-k8s-version-275462) Building disk image from file:///home/jenkins/minikube-integration/19360-1093692/.minikube/cache/iso/amd64/minikube-v1.33.1-1722248113-19339-amd64.iso
I0731 21:18:43.990797 1142911 main.go:141] libmachine: (old-k8s-version-275462) Downloading /home/jenkins/minikube-integration/19360-1093692/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19360-1093692/.minikube/cache/iso/amd64/minikube-v1.33.1-1722248113-19339-amd64.iso...
I0731 21:18:44.265156 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | I0731 21:18:44.265005 1143286 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19360-1093692/.minikube/machines/old-k8s-version-275462/id_rsa...
I0731 21:18:44.442960 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | I0731 21:18:44.442816 1143286 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19360-1093692/.minikube/machines/old-k8s-version-275462/old-k8s-version-275462.rawdisk...
I0731 21:18:44.442991 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | Writing magic tar header
I0731 21:18:44.443005 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | Writing SSH key tar header
I0731 21:18:44.443014 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | I0731 21:18:44.442952 1143286 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19360-1093692/.minikube/machines/old-k8s-version-275462 ...
I0731 21:18:44.443132 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19360-1093692/.minikube/machines/old-k8s-version-275462
I0731 21:18:44.443176 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19360-1093692/.minikube/machines
I0731 21:18:44.443195 1142911 main.go:141] libmachine: (old-k8s-version-275462) Setting executable bit set on /home/jenkins/minikube-integration/19360-1093692/.minikube/machines/old-k8s-version-275462 (perms=drwx------)
I0731 21:18:44.443212 1142911 main.go:141] libmachine: (old-k8s-version-275462) Setting executable bit set on /home/jenkins/minikube-integration/19360-1093692/.minikube/machines (perms=drwxr-xr-x)
I0731 21:18:44.443232 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19360-1093692/.minikube
I0731 21:18:44.443253 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19360-1093692
I0731 21:18:44.443266 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0731 21:18:44.443282 1142911 main.go:141] libmachine: (old-k8s-version-275462) Setting executable bit set on /home/jenkins/minikube-integration/19360-1093692/.minikube (perms=drwxr-xr-x)
I0731 21:18:44.443301 1142911 main.go:141] libmachine: (old-k8s-version-275462) Setting executable bit set on /home/jenkins/minikube-integration/19360-1093692 (perms=drwxrwxr-x)
I0731 21:18:44.443314 1142911 main.go:141] libmachine: (old-k8s-version-275462) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0731 21:18:44.443325 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | Checking permissions on dir: /home/jenkins
I0731 21:18:44.443341 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | Checking permissions on dir: /home
I0731 21:18:44.443353 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | Skipping /home - not owner
I0731 21:18:44.443371 1142911 main.go:141] libmachine: (old-k8s-version-275462) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0731 21:18:44.443386 1142911 main.go:141] libmachine: (old-k8s-version-275462) Creating domain...
I0731 21:18:44.444540 1142911 main.go:141] libmachine: (old-k8s-version-275462) define libvirt domain using xml:
I0731 21:18:44.444566 1142911 main.go:141] libmachine: (old-k8s-version-275462) <domain type='kvm'>
I0731 21:18:44.444578 1142911 main.go:141] libmachine: (old-k8s-version-275462) <name>old-k8s-version-275462</name>
I0731 21:18:44.444587 1142911 main.go:141] libmachine: (old-k8s-version-275462) <memory unit='MiB'>2200</memory>
I0731 21:18:44.444597 1142911 main.go:141] libmachine: (old-k8s-version-275462) <vcpu>2</vcpu>
I0731 21:18:44.444613 1142911 main.go:141] libmachine: (old-k8s-version-275462) <features>
I0731 21:18:44.444626 1142911 main.go:141] libmachine: (old-k8s-version-275462) <acpi/>
I0731 21:18:44.444645 1142911 main.go:141] libmachine: (old-k8s-version-275462) <apic/>
I0731 21:18:44.444683 1142911 main.go:141] libmachine: (old-k8s-version-275462) <pae/>
I0731 21:18:44.444716 1142911 main.go:141] libmachine: (old-k8s-version-275462)
I0731 21:18:44.444727 1142911 main.go:141] libmachine: (old-k8s-version-275462) </features>
I0731 21:18:44.444738 1142911 main.go:141] libmachine: (old-k8s-version-275462) <cpu mode='host-passthrough'>
I0731 21:18:44.444748 1142911 main.go:141] libmachine: (old-k8s-version-275462)
I0731 21:18:44.444758 1142911 main.go:141] libmachine: (old-k8s-version-275462) </cpu>
I0731 21:18:44.444769 1142911 main.go:141] libmachine: (old-k8s-version-275462) <os>
I0731 21:18:44.444776 1142911 main.go:141] libmachine: (old-k8s-version-275462) <type>hvm</type>
I0731 21:18:44.444812 1142911 main.go:141] libmachine: (old-k8s-version-275462) <boot dev='cdrom'/>
I0731 21:18:44.444835 1142911 main.go:141] libmachine: (old-k8s-version-275462) <boot dev='hd'/>
I0731 21:18:44.444842 1142911 main.go:141] libmachine: (old-k8s-version-275462) <bootmenu enable='no'/>
I0731 21:18:44.444855 1142911 main.go:141] libmachine: (old-k8s-version-275462) </os>
I0731 21:18:44.444881 1142911 main.go:141] libmachine: (old-k8s-version-275462) <devices>
I0731 21:18:44.444897 1142911 main.go:141] libmachine: (old-k8s-version-275462) <disk type='file' device='cdrom'>
I0731 21:18:44.444908 1142911 main.go:141] libmachine: (old-k8s-version-275462) <source file='/home/jenkins/minikube-integration/19360-1093692/.minikube/machines/old-k8s-version-275462/boot2docker.iso'/>
I0731 21:18:44.444916 1142911 main.go:141] libmachine: (old-k8s-version-275462) <target dev='hdc' bus='scsi'/>
I0731 21:18:44.444923 1142911 main.go:141] libmachine: (old-k8s-version-275462) <readonly/>
I0731 21:18:44.444933 1142911 main.go:141] libmachine: (old-k8s-version-275462) </disk>
I0731 21:18:44.444945 1142911 main.go:141] libmachine: (old-k8s-version-275462) <disk type='file' device='disk'>
I0731 21:18:44.444960 1142911 main.go:141] libmachine: (old-k8s-version-275462) <driver name='qemu' type='raw' cache='default' io='threads' />
I0731 21:18:44.444977 1142911 main.go:141] libmachine: (old-k8s-version-275462) <source file='/home/jenkins/minikube-integration/19360-1093692/.minikube/machines/old-k8s-version-275462/old-k8s-version-275462.rawdisk'/>
I0731 21:18:44.444988 1142911 main.go:141] libmachine: (old-k8s-version-275462) <target dev='hda' bus='virtio'/>
I0731 21:18:44.444997 1142911 main.go:141] libmachine: (old-k8s-version-275462) </disk>
I0731 21:18:44.445006 1142911 main.go:141] libmachine: (old-k8s-version-275462) <interface type='network'>
I0731 21:18:44.445017 1142911 main.go:141] libmachine: (old-k8s-version-275462) <source network='mk-old-k8s-version-275462'/>
I0731 21:18:44.445032 1142911 main.go:141] libmachine: (old-k8s-version-275462) <model type='virtio'/>
I0731 21:18:44.445045 1142911 main.go:141] libmachine: (old-k8s-version-275462) </interface>
I0731 21:18:44.445056 1142911 main.go:141] libmachine: (old-k8s-version-275462) <interface type='network'>
I0731 21:18:44.445066 1142911 main.go:141] libmachine: (old-k8s-version-275462) <source network='default'/>
I0731 21:18:44.445079 1142911 main.go:141] libmachine: (old-k8s-version-275462) <model type='virtio'/>
I0731 21:18:44.445091 1142911 main.go:141] libmachine: (old-k8s-version-275462) </interface>
I0731 21:18:44.445104 1142911 main.go:141] libmachine: (old-k8s-version-275462) <serial type='pty'>
I0731 21:18:44.445120 1142911 main.go:141] libmachine: (old-k8s-version-275462) <target port='0'/>
I0731 21:18:44.445134 1142911 main.go:141] libmachine: (old-k8s-version-275462) </serial>
I0731 21:18:44.445146 1142911 main.go:141] libmachine: (old-k8s-version-275462) <console type='pty'>
I0731 21:18:44.445157 1142911 main.go:141] libmachine: (old-k8s-version-275462) <target type='serial' port='0'/>
I0731 21:18:44.445170 1142911 main.go:141] libmachine: (old-k8s-version-275462) </console>
I0731 21:18:44.445181 1142911 main.go:141] libmachine: (old-k8s-version-275462) <rng model='virtio'>
I0731 21:18:44.445194 1142911 main.go:141] libmachine: (old-k8s-version-275462) <backend model='random'>/dev/random</backend>
I0731 21:18:44.445206 1142911 main.go:141] libmachine: (old-k8s-version-275462) </rng>
I0731 21:18:44.445215 1142911 main.go:141] libmachine: (old-k8s-version-275462)
I0731 21:18:44.445225 1142911 main.go:141] libmachine: (old-k8s-version-275462)
I0731 21:18:44.445233 1142911 main.go:141] libmachine: (old-k8s-version-275462) </devices>
I0731 21:18:44.445243 1142911 main.go:141] libmachine: (old-k8s-version-275462) </domain>
I0731 21:18:44.445254 1142911 main.go:141] libmachine: (old-k8s-version-275462)
I0731 21:18:44.452674 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has defined MAC address 52:54:00:9b:aa:e4 in network default
I0731 21:18:44.453288 1142911 main.go:141] libmachine: (old-k8s-version-275462) Ensuring networks are active...
I0731 21:18:44.453316 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has defined MAC address 52:54:00:87:e2:c6 in network mk-old-k8s-version-275462
I0731 21:18:44.454049 1142911 main.go:141] libmachine: (old-k8s-version-275462) Ensuring network default is active
I0731 21:18:44.454341 1142911 main.go:141] libmachine: (old-k8s-version-275462) Ensuring network mk-old-k8s-version-275462 is active
I0731 21:18:44.454984 1142911 main.go:141] libmachine: (old-k8s-version-275462) Getting domain xml...
I0731 21:18:44.455794 1142911 main.go:141] libmachine: (old-k8s-version-275462) Creating domain...
I0731 21:18:45.719353 1142911 main.go:141] libmachine: (old-k8s-version-275462) Waiting to get IP...
I0731 21:18:45.720304 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has defined MAC address 52:54:00:87:e2:c6 in network mk-old-k8s-version-275462
I0731 21:18:45.720782 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | unable to find current IP address of domain old-k8s-version-275462 in network mk-old-k8s-version-275462
I0731 21:18:45.720851 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | I0731 21:18:45.720749 1143286 retry.go:31] will retry after 291.213122ms: waiting for machine to come up
I0731 21:18:46.013473 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has defined MAC address 52:54:00:87:e2:c6 in network mk-old-k8s-version-275462
I0731 21:18:46.014056 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | unable to find current IP address of domain old-k8s-version-275462 in network mk-old-k8s-version-275462
I0731 21:18:46.014090 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | I0731 21:18:46.013996 1143286 retry.go:31] will retry after 386.192021ms: waiting for machine to come up
I0731 21:18:46.401463 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has defined MAC address 52:54:00:87:e2:c6 in network mk-old-k8s-version-275462
I0731 21:18:46.402015 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | unable to find current IP address of domain old-k8s-version-275462 in network mk-old-k8s-version-275462
I0731 21:18:46.402049 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | I0731 21:18:46.401959 1143286 retry.go:31] will retry after 421.035983ms: waiting for machine to come up
I0731 21:18:46.824563 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has defined MAC address 52:54:00:87:e2:c6 in network mk-old-k8s-version-275462
I0731 21:18:46.825093 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | unable to find current IP address of domain old-k8s-version-275462 in network mk-old-k8s-version-275462
I0731 21:18:46.825124 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | I0731 21:18:46.825034 1143286 retry.go:31] will retry after 565.160318ms: waiting for machine to come up
I0731 21:18:47.391883 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has defined MAC address 52:54:00:87:e2:c6 in network mk-old-k8s-version-275462
I0731 21:18:47.392447 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | unable to find current IP address of domain old-k8s-version-275462 in network mk-old-k8s-version-275462
I0731 21:18:47.392478 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | I0731 21:18:47.392394 1143286 retry.go:31] will retry after 599.948202ms: waiting for machine to come up
I0731 21:18:47.994407 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has defined MAC address 52:54:00:87:e2:c6 in network mk-old-k8s-version-275462
I0731 21:18:47.994908 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | unable to find current IP address of domain old-k8s-version-275462 in network mk-old-k8s-version-275462
I0731 21:18:47.994939 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | I0731 21:18:47.994852 1143286 retry.go:31] will retry after 913.915511ms: waiting for machine to come up
I0731 21:18:48.910210 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has defined MAC address 52:54:00:87:e2:c6 in network mk-old-k8s-version-275462
I0731 21:18:48.910837 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | unable to find current IP address of domain old-k8s-version-275462 in network mk-old-k8s-version-275462
I0731 21:18:48.910864 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | I0731 21:18:48.910792 1143286 retry.go:31] will retry after 1.132292543s: waiting for machine to come up
I0731 21:18:50.045214 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has defined MAC address 52:54:00:87:e2:c6 in network mk-old-k8s-version-275462
I0731 21:18:50.045767 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | unable to find current IP address of domain old-k8s-version-275462 in network mk-old-k8s-version-275462
I0731 21:18:50.045789 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | I0731 21:18:50.045704 1143286 retry.go:31] will retry after 1.24888579s: waiting for machine to come up
I0731 21:18:51.296261 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has defined MAC address 52:54:00:87:e2:c6 in network mk-old-k8s-version-275462
I0731 21:18:51.296837 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | unable to find current IP address of domain old-k8s-version-275462 in network mk-old-k8s-version-275462
I0731 21:18:51.296870 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | I0731 21:18:51.296776 1143286 retry.go:31] will retry after 1.446102829s: waiting for machine to come up
I0731 21:18:52.745325 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has defined MAC address 52:54:00:87:e2:c6 in network mk-old-k8s-version-275462
I0731 21:18:52.745869 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | unable to find current IP address of domain old-k8s-version-275462 in network mk-old-k8s-version-275462
I0731 21:18:52.745897 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | I0731 21:18:52.745812 1143286 retry.go:31] will retry after 1.822385142s: waiting for machine to come up
I0731 21:18:54.570604 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has defined MAC address 52:54:00:87:e2:c6 in network mk-old-k8s-version-275462
I0731 21:18:54.571177 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | unable to find current IP address of domain old-k8s-version-275462 in network mk-old-k8s-version-275462
I0731 21:18:54.571231 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | I0731 21:18:54.571134 1143286 retry.go:31] will retry after 1.785199692s: waiting for machine to come up
I0731 21:18:56.359981 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has defined MAC address 52:54:00:87:e2:c6 in network mk-old-k8s-version-275462
I0731 21:18:56.360686 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | unable to find current IP address of domain old-k8s-version-275462 in network mk-old-k8s-version-275462
I0731 21:18:56.360714 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | I0731 21:18:56.360621 1143286 retry.go:31] will retry after 2.798943746s: waiting for machine to come up
I0731 21:18:59.161757 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has defined MAC address 52:54:00:87:e2:c6 in network mk-old-k8s-version-275462
I0731 21:18:59.162193 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | unable to find current IP address of domain old-k8s-version-275462 in network mk-old-k8s-version-275462
I0731 21:18:59.162221 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | I0731 21:18:59.162147 1143286 retry.go:31] will retry after 4.377795826s: waiting for machine to come up
I0731 21:19:03.541661 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has defined MAC address 52:54:00:87:e2:c6 in network mk-old-k8s-version-275462
I0731 21:19:03.542366 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | unable to find current IP address of domain old-k8s-version-275462 in network mk-old-k8s-version-275462
I0731 21:19:03.542393 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | I0731 21:19:03.542289 1143286 retry.go:31] will retry after 3.556794784s: waiting for machine to come up
I0731 21:19:07.101424 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has defined MAC address 52:54:00:87:e2:c6 in network mk-old-k8s-version-275462
I0731 21:19:07.102192 1142911 main.go:141] libmachine: (old-k8s-version-275462) Found IP for machine: 192.168.72.107
I0731 21:19:07.102228 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has current primary IP address 192.168.72.107 and MAC address 52:54:00:87:e2:c6 in network mk-old-k8s-version-275462
I0731 21:19:07.102236 1142911 main.go:141] libmachine: (old-k8s-version-275462) Reserving static IP address...
I0731 21:19:07.102746 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-275462", mac: "52:54:00:87:e2:c6", ip: "192.168.72.107"} in network mk-old-k8s-version-275462
I0731 21:19:07.197597 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | Getting to WaitForSSH function...
I0731 21:19:07.197636 1142911 main.go:141] libmachine: (old-k8s-version-275462) Reserved static IP address: 192.168.72.107
I0731 21:19:07.197654 1142911 main.go:141] libmachine: (old-k8s-version-275462) Waiting for SSH to be available...
I0731 21:19:07.201067 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has defined MAC address 52:54:00:87:e2:c6 in network mk-old-k8s-version-275462
I0731 21:19:07.205157 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:87:e2:c6", ip: ""} in network mk-old-k8s-version-275462: {Iface:virbr3 ExpiryTime:2024-07-31 22:18:58 +0000 UTC Type:0 Mac:52:54:00:87:e2:c6 Iaid: IPaddr:192.168.72.107 Prefix:24 Hostname:minikube Clientid:01:52:54:00:87:e2:c6}
I0731 21:19:07.205217 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has defined IP address 192.168.72.107 and MAC address 52:54:00:87:e2:c6 in network mk-old-k8s-version-275462
I0731 21:19:07.205769 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | Using SSH client type: external
I0731 21:19:07.205807 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | Using SSH private key: /home/jenkins/minikube-integration/19360-1093692/.minikube/machines/old-k8s-version-275462/id_rsa (-rw-------)
I0731 21:19:07.205838 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.72.107 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19360-1093692/.minikube/machines/old-k8s-version-275462/id_rsa -p 22] /usr/bin/ssh <nil>}
I0731 21:19:07.205848 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | About to run SSH command:
I0731 21:19:07.205863 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | exit 0
I0731 21:19:07.336647 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | SSH cmd err, output: <nil>:
I0731 21:19:07.336958 1142911 main.go:141] libmachine: (old-k8s-version-275462) KVM machine creation complete!
I0731 21:19:07.337367 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetConfigRaw
I0731 21:19:07.337993 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .DriverName
I0731 21:19:07.338252 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .DriverName
I0731 21:19:07.338446 1142911 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0731 21:19:07.338464 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetState
I0731 21:19:07.340146 1142911 main.go:141] libmachine: Detecting operating system of created instance...
I0731 21:19:07.340178 1142911 main.go:141] libmachine: Waiting for SSH to be available...
I0731 21:19:07.340186 1142911 main.go:141] libmachine: Getting to WaitForSSH function...
I0731 21:19:07.340196 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetSSHHostname
I0731 21:19:07.343204 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has defined MAC address 52:54:00:87:e2:c6 in network mk-old-k8s-version-275462
I0731 21:19:07.343715 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:87:e2:c6", ip: ""} in network mk-old-k8s-version-275462: {Iface:virbr3 ExpiryTime:2024-07-31 22:18:58 +0000 UTC Type:0 Mac:52:54:00:87:e2:c6 Iaid: IPaddr:192.168.72.107 Prefix:24 Hostname:old-k8s-version-275462 Clientid:01:52:54:00:87:e2:c6}
I0731 21:19:07.343751 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has defined IP address 192.168.72.107 and MAC address 52:54:00:87:e2:c6 in network mk-old-k8s-version-275462
I0731 21:19:07.343920 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetSSHPort
I0731 21:19:07.344155 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetSSHKeyPath
I0731 21:19:07.344352 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetSSHKeyPath
I0731 21:19:07.344596 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetSSHUsername
I0731 21:19:07.344790 1142911 main.go:141] libmachine: Using SSH client type: native
I0731 21:19:07.345013 1142911 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.72.107 22 <nil> <nil>}
I0731 21:19:07.345028 1142911 main.go:141] libmachine: About to run SSH command:
exit 0
I0731 21:19:07.447529 1142911 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0731 21:19:07.447566 1142911 main.go:141] libmachine: Detecting the provisioner...
I0731 21:19:07.447576 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetSSHHostname
I0731 21:19:07.451154 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has defined MAC address 52:54:00:87:e2:c6 in network mk-old-k8s-version-275462
I0731 21:19:07.451630 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:87:e2:c6", ip: ""} in network mk-old-k8s-version-275462: {Iface:virbr3 ExpiryTime:2024-07-31 22:18:58 +0000 UTC Type:0 Mac:52:54:00:87:e2:c6 Iaid: IPaddr:192.168.72.107 Prefix:24 Hostname:old-k8s-version-275462 Clientid:01:52:54:00:87:e2:c6}
I0731 21:19:07.451666 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has defined IP address 192.168.72.107 and MAC address 52:54:00:87:e2:c6 in network mk-old-k8s-version-275462
I0731 21:19:07.451880 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetSSHPort
I0731 21:19:07.452116 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetSSHKeyPath
I0731 21:19:07.452320 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetSSHKeyPath
I0731 21:19:07.452499 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetSSHUsername
I0731 21:19:07.452692 1142911 main.go:141] libmachine: Using SSH client type: native
I0731 21:19:07.452890 1142911 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.72.107 22 <nil> <nil>}
I0731 21:19:07.452908 1142911 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0731 21:19:07.561199 1142911 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0731 21:19:07.561301 1142911 main.go:141] libmachine: found compatible host: buildroot
I0731 21:19:07.561317 1142911 main.go:141] libmachine: Provisioning with buildroot...
I0731 21:19:07.561334 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetMachineName
I0731 21:19:07.561629 1142911 buildroot.go:166] provisioning hostname "old-k8s-version-275462"
I0731 21:19:07.561662 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetMachineName
I0731 21:19:07.561900 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetSSHHostname
I0731 21:19:07.565274 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has defined MAC address 52:54:00:87:e2:c6 in network mk-old-k8s-version-275462
I0731 21:19:07.565704 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:87:e2:c6", ip: ""} in network mk-old-k8s-version-275462: {Iface:virbr3 ExpiryTime:2024-07-31 22:18:58 +0000 UTC Type:0 Mac:52:54:00:87:e2:c6 Iaid: IPaddr:192.168.72.107 Prefix:24 Hostname:old-k8s-version-275462 Clientid:01:52:54:00:87:e2:c6}
I0731 21:19:07.565741 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has defined IP address 192.168.72.107 and MAC address 52:54:00:87:e2:c6 in network mk-old-k8s-version-275462
I0731 21:19:07.566060 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetSSHPort
I0731 21:19:07.566279 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetSSHKeyPath
I0731 21:19:07.566495 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetSSHKeyPath
I0731 21:19:07.566673 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetSSHUsername
I0731 21:19:07.566884 1142911 main.go:141] libmachine: Using SSH client type: native
I0731 21:19:07.567130 1142911 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.72.107 22 <nil> <nil>}
I0731 21:19:07.567148 1142911 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-275462 && echo "old-k8s-version-275462" | sudo tee /etc/hostname
I0731 21:19:07.694269 1142911 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-275462
I0731 21:19:07.694307 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetSSHHostname
I0731 21:19:07.697568 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has defined MAC address 52:54:00:87:e2:c6 in network mk-old-k8s-version-275462
I0731 21:19:07.697929 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:87:e2:c6", ip: ""} in network mk-old-k8s-version-275462: {Iface:virbr3 ExpiryTime:2024-07-31 22:18:58 +0000 UTC Type:0 Mac:52:54:00:87:e2:c6 Iaid: IPaddr:192.168.72.107 Prefix:24 Hostname:old-k8s-version-275462 Clientid:01:52:54:00:87:e2:c6}
I0731 21:19:07.697961 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has defined IP address 192.168.72.107 and MAC address 52:54:00:87:e2:c6 in network mk-old-k8s-version-275462
I0731 21:19:07.698149 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetSSHPort
I0731 21:19:07.698426 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetSSHKeyPath
I0731 21:19:07.698634 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetSSHKeyPath
I0731 21:19:07.698849 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetSSHUsername
I0731 21:19:07.699073 1142911 main.go:141] libmachine: Using SSH client type: native
I0731 21:19:07.699322 1142911 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.72.107 22 <nil> <nil>}
I0731 21:19:07.699350 1142911 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-275462' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-275462/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-275462' | sudo tee -a /etc/hosts;
fi
fi
I0731 21:19:07.814160 1142911 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0731 21:19:07.814209 1142911 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19360-1093692/.minikube CaCertPath:/home/jenkins/minikube-integration/19360-1093692/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19360-1093692/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19360-1093692/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19360-1093692/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19360-1093692/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19360-1093692/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19360-1093692/.minikube}
I0731 21:19:07.814243 1142911 buildroot.go:174] setting up certificates
I0731 21:19:07.814257 1142911 provision.go:84] configureAuth start
I0731 21:19:07.814275 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetMachineName
I0731 21:19:07.814642 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetIP
I0731 21:19:07.818019 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has defined MAC address 52:54:00:87:e2:c6 in network mk-old-k8s-version-275462
I0731 21:19:07.818383 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:87:e2:c6", ip: ""} in network mk-old-k8s-version-275462: {Iface:virbr3 ExpiryTime:2024-07-31 22:18:58 +0000 UTC Type:0 Mac:52:54:00:87:e2:c6 Iaid: IPaddr:192.168.72.107 Prefix:24 Hostname:old-k8s-version-275462 Clientid:01:52:54:00:87:e2:c6}
I0731 21:19:07.818407 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has defined IP address 192.168.72.107 and MAC address 52:54:00:87:e2:c6 in network mk-old-k8s-version-275462
I0731 21:19:07.818619 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetSSHHostname
I0731 21:19:07.821373 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has defined MAC address 52:54:00:87:e2:c6 in network mk-old-k8s-version-275462
I0731 21:19:07.821778 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:87:e2:c6", ip: ""} in network mk-old-k8s-version-275462: {Iface:virbr3 ExpiryTime:2024-07-31 22:18:58 +0000 UTC Type:0 Mac:52:54:00:87:e2:c6 Iaid: IPaddr:192.168.72.107 Prefix:24 Hostname:old-k8s-version-275462 Clientid:01:52:54:00:87:e2:c6}
I0731 21:19:07.821819 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has defined IP address 192.168.72.107 and MAC address 52:54:00:87:e2:c6 in network mk-old-k8s-version-275462
I0731 21:19:07.822008 1142911 provision.go:143] copyHostCerts
I0731 21:19:07.822070 1142911 exec_runner.go:144] found /home/jenkins/minikube-integration/19360-1093692/.minikube/ca.pem, removing ...
I0731 21:19:07.822081 1142911 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19360-1093692/.minikube/ca.pem
I0731 21:19:07.822129 1142911 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19360-1093692/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19360-1093692/.minikube/ca.pem (1082 bytes)
I0731 21:19:07.822253 1142911 exec_runner.go:144] found /home/jenkins/minikube-integration/19360-1093692/.minikube/cert.pem, removing ...
I0731 21:19:07.822267 1142911 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19360-1093692/.minikube/cert.pem
I0731 21:19:07.822300 1142911 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19360-1093692/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19360-1093692/.minikube/cert.pem (1123 bytes)
I0731 21:19:07.822377 1142911 exec_runner.go:144] found /home/jenkins/minikube-integration/19360-1093692/.minikube/key.pem, removing ...
I0731 21:19:07.822386 1142911 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19360-1093692/.minikube/key.pem
I0731 21:19:07.822407 1142911 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19360-1093692/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19360-1093692/.minikube/key.pem (1675 bytes)
I0731 21:19:07.822461 1142911 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19360-1093692/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19360-1093692/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19360-1093692/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-275462 san=[127.0.0.1 192.168.72.107 localhost minikube old-k8s-version-275462]
I0731 21:19:07.973286 1142911 provision.go:177] copyRemoteCerts
I0731 21:19:07.973347 1142911 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0731 21:19:07.973373 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetSSHHostname
I0731 21:19:07.976392 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has defined MAC address 52:54:00:87:e2:c6 in network mk-old-k8s-version-275462
I0731 21:19:07.976705 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:87:e2:c6", ip: ""} in network mk-old-k8s-version-275462: {Iface:virbr3 ExpiryTime:2024-07-31 22:18:58 +0000 UTC Type:0 Mac:52:54:00:87:e2:c6 Iaid: IPaddr:192.168.72.107 Prefix:24 Hostname:old-k8s-version-275462 Clientid:01:52:54:00:87:e2:c6}
I0731 21:19:07.976733 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has defined IP address 192.168.72.107 and MAC address 52:54:00:87:e2:c6 in network mk-old-k8s-version-275462
I0731 21:19:07.976939 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetSSHPort
I0731 21:19:07.977113 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetSSHKeyPath
I0731 21:19:07.977236 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetSSHUsername
I0731 21:19:07.977360 1142911 sshutil.go:53] new ssh client: &{IP:192.168.72.107 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19360-1093692/.minikube/machines/old-k8s-version-275462/id_rsa Username:docker}
I0731 21:19:08.058515 1142911 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19360-1093692/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0731 21:19:08.082883 1142911 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19360-1093692/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0731 21:19:08.106737 1142911 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19360-1093692/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0731 21:19:08.130421 1142911 provision.go:87] duration metric: took 316.141693ms to configureAuth
I0731 21:19:08.130461 1142911 buildroot.go:189] setting minikube options for container-runtime
I0731 21:19:08.130651 1142911 config.go:182] Loaded profile config "old-k8s-version-275462": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0731 21:19:08.130824 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetSSHHostname
I0731 21:19:08.133546 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has defined MAC address 52:54:00:87:e2:c6 in network mk-old-k8s-version-275462
I0731 21:19:08.133927 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:87:e2:c6", ip: ""} in network mk-old-k8s-version-275462: {Iface:virbr3 ExpiryTime:2024-07-31 22:18:58 +0000 UTC Type:0 Mac:52:54:00:87:e2:c6 Iaid: IPaddr:192.168.72.107 Prefix:24 Hostname:old-k8s-version-275462 Clientid:01:52:54:00:87:e2:c6}
I0731 21:19:08.133956 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has defined IP address 192.168.72.107 and MAC address 52:54:00:87:e2:c6 in network mk-old-k8s-version-275462
I0731 21:19:08.134144 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetSSHPort
I0731 21:19:08.134342 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetSSHKeyPath
I0731 21:19:08.134533 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetSSHKeyPath
I0731 21:19:08.134644 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetSSHUsername
I0731 21:19:08.134846 1142911 main.go:141] libmachine: Using SSH client type: native
I0731 21:19:08.135021 1142911 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.72.107 22 <nil> <nil>}
I0731 21:19:08.135035 1142911 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0731 21:19:08.409282 1142911 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0731 21:19:08.409312 1142911 main.go:141] libmachine: Checking connection to Docker...
I0731 21:19:08.409323 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetURL
I0731 21:19:08.410795 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | Using libvirt version 6000000
I0731 21:19:08.414002 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has defined MAC address 52:54:00:87:e2:c6 in network mk-old-k8s-version-275462
I0731 21:19:08.414448 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:87:e2:c6", ip: ""} in network mk-old-k8s-version-275462: {Iface:virbr3 ExpiryTime:2024-07-31 22:18:58 +0000 UTC Type:0 Mac:52:54:00:87:e2:c6 Iaid: IPaddr:192.168.72.107 Prefix:24 Hostname:old-k8s-version-275462 Clientid:01:52:54:00:87:e2:c6}
I0731 21:19:08.414483 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has defined IP address 192.168.72.107 and MAC address 52:54:00:87:e2:c6 in network mk-old-k8s-version-275462
I0731 21:19:08.414818 1142911 main.go:141] libmachine: Docker is up and running!
I0731 21:19:08.414839 1142911 main.go:141] libmachine: Reticulating splines...
I0731 21:19:08.414848 1142911 client.go:171] duration metric: took 24.519467967s to LocalClient.Create
I0731 21:19:08.414877 1142911 start.go:167] duration metric: took 24.519549023s to libmachine.API.Create "old-k8s-version-275462"
I0731 21:19:08.414892 1142911 start.go:293] postStartSetup for "old-k8s-version-275462" (driver="kvm2")
I0731 21:19:08.414908 1142911 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0731 21:19:08.414931 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .DriverName
I0731 21:19:08.415209 1142911 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0731 21:19:08.415245 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetSSHHostname
I0731 21:19:08.418208 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has defined MAC address 52:54:00:87:e2:c6 in network mk-old-k8s-version-275462
I0731 21:19:08.418654 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:87:e2:c6", ip: ""} in network mk-old-k8s-version-275462: {Iface:virbr3 ExpiryTime:2024-07-31 22:18:58 +0000 UTC Type:0 Mac:52:54:00:87:e2:c6 Iaid: IPaddr:192.168.72.107 Prefix:24 Hostname:old-k8s-version-275462 Clientid:01:52:54:00:87:e2:c6}
I0731 21:19:08.418684 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has defined IP address 192.168.72.107 and MAC address 52:54:00:87:e2:c6 in network mk-old-k8s-version-275462
I0731 21:19:08.419000 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetSSHPort
I0731 21:19:08.419277 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetSSHKeyPath
I0731 21:19:08.419479 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetSSHUsername
I0731 21:19:08.419678 1142911 sshutil.go:53] new ssh client: &{IP:192.168.72.107 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19360-1093692/.minikube/machines/old-k8s-version-275462/id_rsa Username:docker}
I0731 21:19:08.506836 1142911 ssh_runner.go:195] Run: cat /etc/os-release
I0731 21:19:08.511351 1142911 info.go:137] Remote host: Buildroot 2023.02.9
I0731 21:19:08.511389 1142911 filesync.go:126] Scanning /home/jenkins/minikube-integration/19360-1093692/.minikube/addons for local assets ...
I0731 21:19:08.511469 1142911 filesync.go:126] Scanning /home/jenkins/minikube-integration/19360-1093692/.minikube/files for local assets ...
I0731 21:19:08.511560 1142911 filesync.go:149] local asset: /home/jenkins/minikube-integration/19360-1093692/.minikube/files/etc/ssl/certs/11009762.pem -> 11009762.pem in /etc/ssl/certs
I0731 21:19:08.511683 1142911 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0731 21:19:08.524379 1142911 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19360-1093692/.minikube/files/etc/ssl/certs/11009762.pem --> /etc/ssl/certs/11009762.pem (1708 bytes)
I0731 21:19:08.552321 1142911 start.go:296] duration metric: took 137.408186ms for postStartSetup
I0731 21:19:08.552394 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetConfigRaw
I0731 21:19:08.553110 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetIP
I0731 21:19:08.555618 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has defined MAC address 52:54:00:87:e2:c6 in network mk-old-k8s-version-275462
I0731 21:19:08.556028 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:87:e2:c6", ip: ""} in network mk-old-k8s-version-275462: {Iface:virbr3 ExpiryTime:2024-07-31 22:18:58 +0000 UTC Type:0 Mac:52:54:00:87:e2:c6 Iaid: IPaddr:192.168.72.107 Prefix:24 Hostname:old-k8s-version-275462 Clientid:01:52:54:00:87:e2:c6}
I0731 21:19:08.556072 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has defined IP address 192.168.72.107 and MAC address 52:54:00:87:e2:c6 in network mk-old-k8s-version-275462
I0731 21:19:08.556415 1142911 profile.go:143] Saving config to /home/jenkins/minikube-integration/19360-1093692/.minikube/profiles/old-k8s-version-275462/config.json ...
I0731 21:19:08.556682 1142911 start.go:128] duration metric: took 24.687735305s to createHost
I0731 21:19:08.556716 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetSSHHostname
I0731 21:19:08.559927 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has defined MAC address 52:54:00:87:e2:c6 in network mk-old-k8s-version-275462
I0731 21:19:08.560369 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:87:e2:c6", ip: ""} in network mk-old-k8s-version-275462: {Iface:virbr3 ExpiryTime:2024-07-31 22:18:58 +0000 UTC Type:0 Mac:52:54:00:87:e2:c6 Iaid: IPaddr:192.168.72.107 Prefix:24 Hostname:old-k8s-version-275462 Clientid:01:52:54:00:87:e2:c6}
I0731 21:19:08.560396 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has defined IP address 192.168.72.107 and MAC address 52:54:00:87:e2:c6 in network mk-old-k8s-version-275462
I0731 21:19:08.560611 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetSSHPort
I0731 21:19:08.560838 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetSSHKeyPath
I0731 21:19:08.561006 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetSSHKeyPath
I0731 21:19:08.561220 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetSSHUsername
I0731 21:19:08.561444 1142911 main.go:141] libmachine: Using SSH client type: native
I0731 21:19:08.561678 1142911 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.72.107 22 <nil> <nil>}
I0731 21:19:08.561691 1142911 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0731 21:19:08.669413 1142911 main.go:141] libmachine: SSH cmd err, output: <nil>: 1722460748.646311717
I0731 21:19:08.669442 1142911 fix.go:216] guest clock: 1722460748.646311717
I0731 21:19:08.669450 1142911 fix.go:229] Guest: 2024-07-31 21:19:08.646311717 +0000 UTC Remote: 2024-07-31 21:19:08.556700259 +0000 UTC m=+52.105769979 (delta=89.611458ms)
I0731 21:19:08.669497 1142911 fix.go:200] guest clock delta is within tolerance: 89.611458ms
I0731 21:19:08.669505 1142911 start.go:83] releasing machines lock for "old-k8s-version-275462", held for 24.800776894s
I0731 21:19:08.669534 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .DriverName
I0731 21:19:08.669878 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetIP
I0731 21:19:08.673288 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has defined MAC address 52:54:00:87:e2:c6 in network mk-old-k8s-version-275462
I0731 21:19:08.673752 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:87:e2:c6", ip: ""} in network mk-old-k8s-version-275462: {Iface:virbr3 ExpiryTime:2024-07-31 22:18:58 +0000 UTC Type:0 Mac:52:54:00:87:e2:c6 Iaid: IPaddr:192.168.72.107 Prefix:24 Hostname:old-k8s-version-275462 Clientid:01:52:54:00:87:e2:c6}
I0731 21:19:08.673790 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has defined IP address 192.168.72.107 and MAC address 52:54:00:87:e2:c6 in network mk-old-k8s-version-275462
I0731 21:19:08.674025 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .DriverName
I0731 21:19:08.674739 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .DriverName
I0731 21:19:08.674982 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .DriverName
I0731 21:19:08.675095 1142911 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0731 21:19:08.675147 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetSSHHostname
I0731 21:19:08.675289 1142911 ssh_runner.go:195] Run: cat /version.json
I0731 21:19:08.675318 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetSSHHostname
I0731 21:19:08.678417 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has defined MAC address 52:54:00:87:e2:c6 in network mk-old-k8s-version-275462
I0731 21:19:08.678649 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has defined MAC address 52:54:00:87:e2:c6 in network mk-old-k8s-version-275462
I0731 21:19:08.678787 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:87:e2:c6", ip: ""} in network mk-old-k8s-version-275462: {Iface:virbr3 ExpiryTime:2024-07-31 22:18:58 +0000 UTC Type:0 Mac:52:54:00:87:e2:c6 Iaid: IPaddr:192.168.72.107 Prefix:24 Hostname:old-k8s-version-275462 Clientid:01:52:54:00:87:e2:c6}
I0731 21:19:08.678819 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has defined IP address 192.168.72.107 and MAC address 52:54:00:87:e2:c6 in network mk-old-k8s-version-275462
I0731 21:19:08.679023 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetSSHPort
I0731 21:19:08.679091 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:87:e2:c6", ip: ""} in network mk-old-k8s-version-275462: {Iface:virbr3 ExpiryTime:2024-07-31 22:18:58 +0000 UTC Type:0 Mac:52:54:00:87:e2:c6 Iaid: IPaddr:192.168.72.107 Prefix:24 Hostname:old-k8s-version-275462 Clientid:01:52:54:00:87:e2:c6}
I0731 21:19:08.679122 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has defined IP address 192.168.72.107 and MAC address 52:54:00:87:e2:c6 in network mk-old-k8s-version-275462
I0731 21:19:08.679250 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetSSHKeyPath
I0731 21:19:08.679309 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetSSHPort
I0731 21:19:08.679389 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetSSHUsername
I0731 21:19:08.679501 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetSSHKeyPath
I0731 21:19:08.679583 1142911 sshutil.go:53] new ssh client: &{IP:192.168.72.107 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19360-1093692/.minikube/machines/old-k8s-version-275462/id_rsa Username:docker}
I0731 21:19:08.679674 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetSSHUsername
I0731 21:19:08.679852 1142911 sshutil.go:53] new ssh client: &{IP:192.168.72.107 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19360-1093692/.minikube/machines/old-k8s-version-275462/id_rsa Username:docker}
I0731 21:19:08.779069 1142911 ssh_runner.go:195] Run: systemctl --version
I0731 21:19:08.785842 1142911 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0731 21:19:08.958580 1142911 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0731 21:19:08.966694 1142911 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0731 21:19:08.966787 1142911 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0731 21:19:08.989354 1142911 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0731 21:19:08.989384 1142911 start.go:495] detecting cgroup driver to use...
I0731 21:19:08.989459 1142911 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0731 21:19:09.010789 1142911 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0731 21:19:09.026170 1142911 docker.go:217] disabling cri-docker service (if available) ...
I0731 21:19:09.026247 1142911 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0731 21:19:09.040784 1142911 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0731 21:19:09.060392 1142911 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0731 21:19:09.201274 1142911 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0731 21:19:09.336342 1142911 docker.go:233] disabling docker service ...
I0731 21:19:09.336430 1142911 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0731 21:19:09.356663 1142911 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0731 21:19:09.373741 1142911 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0731 21:19:09.528594 1142911 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0731 21:19:09.674671 1142911 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0731 21:19:09.690015 1142911 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0731 21:19:09.713874 1142911 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0731 21:19:09.714023 1142911 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0731 21:19:09.728983 1142911 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0731 21:19:09.729075 1142911 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0731 21:19:09.743194 1142911 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0731 21:19:09.755030 1142911 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0731 21:19:09.766903 1142911 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0731 21:19:09.778681 1142911 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0731 21:19:09.791347 1142911 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0731 21:19:09.791448 1142911 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0731 21:19:09.810563 1142911 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0731 21:19:09.823229 1142911 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0731 21:19:09.943702 1142911 ssh_runner.go:195] Run: sudo systemctl restart crio
I0731 21:19:10.095224 1142911 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0731 21:19:10.095328 1142911 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0731 21:19:10.100064 1142911 start.go:563] Will wait 60s for crictl version
I0731 21:19:10.100165 1142911 ssh_runner.go:195] Run: which crictl
I0731 21:19:10.104196 1142911 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0731 21:19:10.146277 1142911 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0731 21:19:10.146372 1142911 ssh_runner.go:195] Run: crio --version
I0731 21:19:10.174905 1142911 ssh_runner.go:195] Run: crio --version
I0731 21:19:10.215239 1142911 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0731 21:19:10.216651 1142911 main.go:141] libmachine: (old-k8s-version-275462) Calling .GetIP
I0731 21:19:10.219900 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has defined MAC address 52:54:00:87:e2:c6 in network mk-old-k8s-version-275462
I0731 21:19:10.220274 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:87:e2:c6", ip: ""} in network mk-old-k8s-version-275462: {Iface:virbr3 ExpiryTime:2024-07-31 22:18:58 +0000 UTC Type:0 Mac:52:54:00:87:e2:c6 Iaid: IPaddr:192.168.72.107 Prefix:24 Hostname:old-k8s-version-275462 Clientid:01:52:54:00:87:e2:c6}
I0731 21:19:10.220302 1142911 main.go:141] libmachine: (old-k8s-version-275462) DBG | domain old-k8s-version-275462 has defined IP address 192.168.72.107 and MAC address 52:54:00:87:e2:c6 in network mk-old-k8s-version-275462
I0731 21:19:10.220558 1142911 ssh_runner.go:195] Run: grep 192.168.72.1 host.minikube.internal$ /etc/hosts
I0731 21:19:10.224916 1142911 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.72.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0731 21:19:10.238125 1142911 kubeadm.go:883] updating cluster {Name:old-k8s-version-275462 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19339/minikube-v1.33.1-1722248113-19339-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-275462 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.107 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] M
ountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0731 21:19:10.238279 1142911 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0731 21:19:10.238351 1142911 ssh_runner.go:195] Run: sudo crictl images --output json
I0731 21:19:10.278458 1142911 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0731 21:19:10.278571 1142911 ssh_runner.go:195] Run: which lz4
I0731 21:19:10.282698 1142911 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0731 21:19:10.287035 1142911 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0731 21:19:10.287081 1142911 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19360-1093692/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0731 21:19:11.835121 1142911 crio.go:462] duration metric: took 1.552473991s to copy over tarball
I0731 21:19:11.835212 1142911 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0731 21:19:14.498464 1142911 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.663212625s)
I0731 21:19:14.498517 1142911 crio.go:469] duration metric: took 2.663357361s to extract the tarball
I0731 21:19:14.498529 1142911 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0731 21:19:14.543401 1142911 ssh_runner.go:195] Run: sudo crictl images --output json
I0731 21:19:14.587404 1142911 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0731 21:19:14.587439 1142911 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0731 21:19:14.587514 1142911 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0731 21:19:14.587534 1142911 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0731 21:19:14.587541 1142911 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0731 21:19:14.587554 1142911 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0731 21:19:14.587520 1142911 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0731 21:19:14.587591 1142911 image.go:134] retrieving image: registry.k8s.io/pause:3.2
I0731 21:19:14.587600 1142911 image.go:134] retrieving image: registry.k8s.io/coredns:1.7.0
I0731 21:19:14.587525 1142911 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0731 21:19:14.589430 1142911 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0731 21:19:14.589454 1142911 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0731 21:19:14.589463 1142911 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0731 21:19:14.589465 1142911 image.go:177] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0731 21:19:14.589430 1142911 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0731 21:19:14.589464 1142911 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0731 21:19:14.589579 1142911 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0731 21:19:14.589888 1142911 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0731 21:19:14.738327 1142911 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0731 21:19:14.743292 1142911 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0731 21:19:14.747163 1142911 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0731 21:19:14.747531 1142911 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0731 21:19:14.747848 1142911 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0731 21:19:14.754623 1142911 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0731 21:19:14.767139 1142911 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0731 21:19:14.854529 1142911 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0731 21:19:14.854589 1142911 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0731 21:19:14.854645 1142911 ssh_runner.go:195] Run: which crictl
I0731 21:19:14.918390 1142911 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0731 21:19:14.918433 1142911 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0731 21:19:14.918484 1142911 ssh_runner.go:195] Run: which crictl
I0731 21:19:14.932997 1142911 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0731 21:19:14.933018 1142911 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0731 21:19:14.933056 1142911 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0731 21:19:14.933056 1142911 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0731 21:19:14.933107 1142911 ssh_runner.go:195] Run: which crictl
I0731 21:19:14.933108 1142911 ssh_runner.go:195] Run: which crictl
I0731 21:19:14.933025 1142911 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0731 21:19:14.933221 1142911 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0731 21:19:14.933255 1142911 ssh_runner.go:195] Run: which crictl
I0731 21:19:14.948899 1142911 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0731 21:19:14.948929 1142911 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0731 21:19:14.948953 1142911 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0731 21:19:14.948964 1142911 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0731 21:19:14.948990 1142911 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0731 21:19:14.949010 1142911 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0731 21:19:14.949040 1142911 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0731 21:19:14.948996 1142911 ssh_runner.go:195] Run: which crictl
I0731 21:19:14.948998 1142911 ssh_runner.go:195] Run: which crictl
I0731 21:19:14.949080 1142911 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0731 21:19:14.949134 1142911 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0731 21:19:15.047704 1142911 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19360-1093692/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0731 21:19:15.047777 1142911 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19360-1093692/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0731 21:19:15.062138 1142911 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19360-1093692/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0731 21:19:15.062169 1142911 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19360-1093692/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0731 21:19:15.067779 1142911 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0731 21:19:15.067825 1142911 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0731 21:19:15.067844 1142911 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19360-1093692/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0731 21:19:15.129259 1142911 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19360-1093692/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0731 21:19:15.129327 1142911 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19360-1093692/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0731 21:19:15.193897 1142911 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0731 21:19:15.338336 1142911 cache_images.go:92] duration metric: took 750.875338ms to LoadCachedImages
W0731 21:19:15.338453 1142911 out.go:239] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19360-1093692/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19360-1093692/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0: no such file or directory
I0731 21:19:15.338474 1142911 kubeadm.go:934] updating node { 192.168.72.107 8443 v1.20.0 crio true true} ...
I0731 21:19:15.338620 1142911 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-275462 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.72.107
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-275462 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0731 21:19:15.338716 1142911 ssh_runner.go:195] Run: crio config
I0731 21:19:15.392486 1142911 cni.go:84] Creating CNI manager for ""
I0731 21:19:15.392518 1142911 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0731 21:19:15.392532 1142911 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0731 21:19:15.392553 1142911 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.72.107 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-275462 NodeName:old-k8s-version-275462 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.72.107"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.72.107 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0731 21:19:15.392692 1142911 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.72.107
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-275462"
kubeletExtraArgs:
node-ip: 192.168.72.107
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.72.107"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0731 21:19:15.392774 1142911 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0731 21:19:15.405112 1142911 binaries.go:44] Found k8s binaries, skipping transfer
I0731 21:19:15.405216 1142911 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0731 21:19:15.418666 1142911 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0731 21:19:15.438498 1142911 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0731 21:19:15.460759 1142911 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0731 21:19:15.484295 1142911 ssh_runner.go:195] Run: grep 192.168.72.107 control-plane.minikube.internal$ /etc/hosts
I0731 21:19:15.491016 1142911 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.72.107 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0731 21:19:15.508614 1142911 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0731 21:19:15.648083 1142911 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0731 21:19:15.666040 1142911 certs.go:68] Setting up /home/jenkins/minikube-integration/19360-1093692/.minikube/profiles/old-k8s-version-275462 for IP: 192.168.72.107
I0731 21:19:15.666070 1142911 certs.go:194] generating shared ca certs ...
I0731 21:19:15.666088 1142911 certs.go:226] acquiring lock for ca certs: {Name:mkfaba598c13a8e6da4324f625faa476553ec3b4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0731 21:19:15.666255 1142911 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19360-1093692/.minikube/ca.key
I0731 21:19:15.666311 1142911 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19360-1093692/.minikube/proxy-client-ca.key
I0731 21:19:15.666322 1142911 certs.go:256] generating profile certs ...
I0731 21:19:15.666396 1142911 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19360-1093692/.minikube/profiles/old-k8s-version-275462/client.key
I0731 21:19:15.666420 1142911 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19360-1093692/.minikube/profiles/old-k8s-version-275462/client.crt with IP's: []
I0731 21:19:15.923202 1142911 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19360-1093692/.minikube/profiles/old-k8s-version-275462/client.crt ...
I0731 21:19:15.923240 1142911 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19360-1093692/.minikube/profiles/old-k8s-version-275462/client.crt: {Name:mkc8ab71374bebb53ecb61f7cc8792a6e87e7871 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0731 21:19:15.923456 1142911 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19360-1093692/.minikube/profiles/old-k8s-version-275462/client.key ...
I0731 21:19:15.923474 1142911 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19360-1093692/.minikube/profiles/old-k8s-version-275462/client.key: {Name:mk7cae9852d330d0c4c36d2c9aaefe1d2e6dd0c9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0731 21:19:15.923585 1142911 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19360-1093692/.minikube/profiles/old-k8s-version-275462/apiserver.key.512f5421
I0731 21:19:15.923608 1142911 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19360-1093692/.minikube/profiles/old-k8s-version-275462/apiserver.crt.512f5421 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.72.107]
I0731 21:19:16.096268 1142911 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19360-1093692/.minikube/profiles/old-k8s-version-275462/apiserver.crt.512f5421 ...
I0731 21:19:16.096309 1142911 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19360-1093692/.minikube/profiles/old-k8s-version-275462/apiserver.crt.512f5421: {Name:mk2b5a715e6d2b8980654afdd10f54cde2ccacc8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0731 21:19:16.096511 1142911 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19360-1093692/.minikube/profiles/old-k8s-version-275462/apiserver.key.512f5421 ...
I0731 21:19:16.096530 1142911 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19360-1093692/.minikube/profiles/old-k8s-version-275462/apiserver.key.512f5421: {Name:mk9df86df7dd4a7e9de28d230465a14c66d08de6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0731 21:19:16.096639 1142911 certs.go:381] copying /home/jenkins/minikube-integration/19360-1093692/.minikube/profiles/old-k8s-version-275462/apiserver.crt.512f5421 -> /home/jenkins/minikube-integration/19360-1093692/.minikube/profiles/old-k8s-version-275462/apiserver.crt
I0731 21:19:16.096734 1142911 certs.go:385] copying /home/jenkins/minikube-integration/19360-1093692/.minikube/profiles/old-k8s-version-275462/apiserver.key.512f5421 -> /home/jenkins/minikube-integration/19360-1093692/.minikube/profiles/old-k8s-version-275462/apiserver.key
I0731 21:19:16.096814 1142911 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19360-1093692/.minikube/profiles/old-k8s-version-275462/proxy-client.key
I0731 21:19:16.096838 1142911 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19360-1093692/.minikube/profiles/old-k8s-version-275462/proxy-client.crt with IP's: []
I0731 21:19:16.306234 1142911 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19360-1093692/.minikube/profiles/old-k8s-version-275462/proxy-client.crt ...
I0731 21:19:16.306273 1142911 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19360-1093692/.minikube/profiles/old-k8s-version-275462/proxy-client.crt: {Name:mkc66cfae5906eeb256e0dbe41233bae1cb7c33c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0731 21:19:16.306472 1142911 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19360-1093692/.minikube/profiles/old-k8s-version-275462/proxy-client.key ...
I0731 21:19:16.306491 1142911 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19360-1093692/.minikube/profiles/old-k8s-version-275462/proxy-client.key: {Name:mkfe34aa5466b9906397cc8c006b8b65473f1eac Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0731 21:19:16.306716 1142911 certs.go:484] found cert: /home/jenkins/minikube-integration/19360-1093692/.minikube/certs/1100976.pem (1338 bytes)
W0731 21:19:16.306779 1142911 certs.go:480] ignoring /home/jenkins/minikube-integration/19360-1093692/.minikube/certs/1100976_empty.pem, impossibly tiny 0 bytes
I0731 21:19:16.306795 1142911 certs.go:484] found cert: /home/jenkins/minikube-integration/19360-1093692/.minikube/certs/ca-key.pem (1675 bytes)
I0731 21:19:16.306828 1142911 certs.go:484] found cert: /home/jenkins/minikube-integration/19360-1093692/.minikube/certs/ca.pem (1082 bytes)
I0731 21:19:16.306871 1142911 certs.go:484] found cert: /home/jenkins/minikube-integration/19360-1093692/.minikube/certs/cert.pem (1123 bytes)
I0731 21:19:16.306908 1142911 certs.go:484] found cert: /home/jenkins/minikube-integration/19360-1093692/.minikube/certs/key.pem (1675 bytes)
I0731 21:19:16.306967 1142911 certs.go:484] found cert: /home/jenkins/minikube-integration/19360-1093692/.minikube/files/etc/ssl/certs/11009762.pem (1708 bytes)
I0731 21:19:16.307675 1142911 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19360-1093692/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0731 21:19:16.334581 1142911 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19360-1093692/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0731 21:19:16.361637 1142911 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19360-1093692/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0731 21:19:16.388719 1142911 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19360-1093692/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0731 21:19:16.416180 1142911 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19360-1093692/.minikube/profiles/old-k8s-version-275462/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0731 21:19:16.444910 1142911 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19360-1093692/.minikube/profiles/old-k8s-version-275462/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0731 21:19:16.469388 1142911 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19360-1093692/.minikube/profiles/old-k8s-version-275462/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0731 21:19:16.496604 1142911 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19360-1093692/.minikube/profiles/old-k8s-version-275462/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0731 21:19:16.528518 1142911 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19360-1093692/.minikube/certs/1100976.pem --> /usr/share/ca-certificates/1100976.pem (1338 bytes)
I0731 21:19:16.564171 1142911 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19360-1093692/.minikube/files/etc/ssl/certs/11009762.pem --> /usr/share/ca-certificates/11009762.pem (1708 bytes)
I0731 21:19:16.593227 1142911 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19360-1093692/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0731 21:19:16.617043 1142911 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0731 21:19:16.635328 1142911 ssh_runner.go:195] Run: openssl version
I0731 21:19:16.641302 1142911 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1100976.pem && ln -fs /usr/share/ca-certificates/1100976.pem /etc/ssl/certs/1100976.pem"
I0731 21:19:16.653102 1142911 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1100976.pem
I0731 21:19:16.657728 1142911 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jul 31 20:21 /usr/share/ca-certificates/1100976.pem
I0731 21:19:16.657811 1142911 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1100976.pem
I0731 21:19:16.663807 1142911 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1100976.pem /etc/ssl/certs/51391683.0"
I0731 21:19:16.675646 1142911 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11009762.pem && ln -fs /usr/share/ca-certificates/11009762.pem /etc/ssl/certs/11009762.pem"
I0731 21:19:16.688688 1142911 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11009762.pem
I0731 21:19:16.693567 1142911 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jul 31 20:21 /usr/share/ca-certificates/11009762.pem
I0731 21:19:16.693641 1142911 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11009762.pem
I0731 21:19:16.699408 1142911 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/11009762.pem /etc/ssl/certs/3ec20f2e.0"
I0731 21:19:16.710291 1142911 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0731 21:19:16.721416 1142911 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0731 21:19:16.726186 1142911 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jul 31 20:10 /usr/share/ca-certificates/minikubeCA.pem
I0731 21:19:16.726271 1142911 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0731 21:19:16.731897 1142911 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0731 21:19:16.742985 1142911 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0731 21:19:16.747132 1142911 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0731 21:19:16.747195 1142911 kubeadm.go:392] StartCluster: {Name:old-k8s-version-275462 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19339/minikube-v1.33.1-1722248113-19339-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-275462 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.107 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0731 21:19:16.747296 1142911 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0731 21:19:16.747363 1142911 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0731 21:19:16.787809 1142911 cri.go:89] found id: ""
I0731 21:19:16.787889 1142911 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0731 21:19:16.798009 1142911 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0731 21:19:16.808064 1142911 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0731 21:19:16.818193 1142911 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0731 21:19:16.818215 1142911 kubeadm.go:157] found existing configuration files:
I0731 21:19:16.818260 1142911 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0731 21:19:16.827804 1142911 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0731 21:19:16.827877 1142911 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0731 21:19:16.839004 1142911 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0731 21:19:16.849735 1142911 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0731 21:19:16.849802 1142911 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0731 21:19:16.860768 1142911 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0731 21:19:16.870006 1142911 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0731 21:19:16.870067 1142911 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0731 21:19:16.881022 1142911 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0731 21:19:16.891685 1142911 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0731 21:19:16.891749 1142911 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0731 21:19:16.901743 1142911 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0731 21:19:17.156672 1142911 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0731 21:21:15.168433 1142911 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0731 21:21:15.168564 1142911 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0731 21:21:15.170438 1142911 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0731 21:21:15.170555 1142911 kubeadm.go:310] [preflight] Running pre-flight checks
I0731 21:21:15.170673 1142911 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0731 21:21:15.170796 1142911 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0731 21:21:15.170932 1142911 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0731 21:21:15.171030 1142911 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0731 21:21:15.172728 1142911 out.go:204] - Generating certificates and keys ...
I0731 21:21:15.172841 1142911 kubeadm.go:310] [certs] Using existing ca certificate authority
I0731 21:21:15.172918 1142911 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0731 21:21:15.173003 1142911 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0731 21:21:15.173068 1142911 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0731 21:21:15.173124 1142911 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0731 21:21:15.173165 1142911 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0731 21:21:15.173213 1142911 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0731 21:21:15.173344 1142911 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-275462] and IPs [192.168.72.107 127.0.0.1 ::1]
I0731 21:21:15.173429 1142911 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0731 21:21:15.173614 1142911 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-275462] and IPs [192.168.72.107 127.0.0.1 ::1]
I0731 21:21:15.173705 1142911 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0731 21:21:15.173803 1142911 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0731 21:21:15.173858 1142911 kubeadm.go:310] [certs] Generating "sa" key and public key
I0731 21:21:15.173951 1142911 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0731 21:21:15.174021 1142911 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0731 21:21:15.174093 1142911 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0731 21:21:15.174181 1142911 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0731 21:21:15.174250 1142911 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0731 21:21:15.174389 1142911 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0731 21:21:15.174477 1142911 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0731 21:21:15.174523 1142911 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0731 21:21:15.174581 1142911 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0731 21:21:15.175865 1142911 out.go:204] - Booting up control plane ...
I0731 21:21:15.175964 1142911 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0731 21:21:15.176069 1142911 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0731 21:21:15.176160 1142911 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0731 21:21:15.176233 1142911 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0731 21:21:15.176437 1142911 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0731 21:21:15.176480 1142911 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0731 21:21:15.176543 1142911 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0731 21:21:15.176709 1142911 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0731 21:21:15.176782 1142911 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0731 21:21:15.176953 1142911 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0731 21:21:15.177060 1142911 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0731 21:21:15.177268 1142911 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0731 21:21:15.177339 1142911 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0731 21:21:15.177508 1142911 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0731 21:21:15.177572 1142911 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0731 21:21:15.177759 1142911 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0731 21:21:15.177766 1142911 kubeadm.go:310]
I0731 21:21:15.177799 1142911 kubeadm.go:310] Unfortunately, an error has occurred:
I0731 21:21:15.177836 1142911 kubeadm.go:310] timed out waiting for the condition
I0731 21:21:15.177846 1142911 kubeadm.go:310]
I0731 21:21:15.177888 1142911 kubeadm.go:310] This error is likely caused by:
I0731 21:21:15.177940 1142911 kubeadm.go:310] - The kubelet is not running
I0731 21:21:15.178047 1142911 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0731 21:21:15.178056 1142911 kubeadm.go:310]
I0731 21:21:15.178139 1142911 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0731 21:21:15.178179 1142911 kubeadm.go:310] - 'systemctl status kubelet'
I0731 21:21:15.178208 1142911 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0731 21:21:15.178214 1142911 kubeadm.go:310]
I0731 21:21:15.178305 1142911 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0731 21:21:15.178385 1142911 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0731 21:21:15.178406 1142911 kubeadm.go:310]
I0731 21:21:15.178495 1142911 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0731 21:21:15.178575 1142911 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0731 21:21:15.178644 1142911 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0731 21:21:15.178708 1142911 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0731 21:21:15.178787 1142911 kubeadm.go:310]
W0731 21:21:15.178854 1142911 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-275462] and IPs [192.168.72.107 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-275462] and IPs [192.168.72.107 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-275462] and IPs [192.168.72.107 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-275462] and IPs [192.168.72.107 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0731 21:21:15.178914 1142911 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0731 21:21:15.636908 1142911 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0731 21:21:15.651732 1142911 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0731 21:21:15.661423 1142911 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0731 21:21:15.661450 1142911 kubeadm.go:157] found existing configuration files:
I0731 21:21:15.661545 1142911 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0731 21:21:15.670878 1142911 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0731 21:21:15.670950 1142911 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0731 21:21:15.680589 1142911 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0731 21:21:15.689566 1142911 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0731 21:21:15.689661 1142911 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0731 21:21:15.699166 1142911 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0731 21:21:15.708421 1142911 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0731 21:21:15.708497 1142911 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0731 21:21:15.717959 1142911 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0731 21:21:15.726885 1142911 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0731 21:21:15.726960 1142911 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0731 21:21:15.736475 1142911 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0731 21:21:15.803032 1142911 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0731 21:21:15.803163 1142911 kubeadm.go:310] [preflight] Running pre-flight checks
I0731 21:21:15.941327 1142911 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0731 21:21:15.941488 1142911 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0731 21:21:15.941643 1142911 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0731 21:21:16.116485 1142911 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0731 21:21:16.118431 1142911 out.go:204] - Generating certificates and keys ...
I0731 21:21:16.118546 1142911 kubeadm.go:310] [certs] Using existing ca certificate authority
I0731 21:21:16.118638 1142911 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0731 21:21:16.118735 1142911 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0731 21:21:16.118792 1142911 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0731 21:21:16.118866 1142911 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0731 21:21:16.118920 1142911 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0731 21:21:16.118981 1142911 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0731 21:21:16.119084 1142911 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0731 21:21:16.119201 1142911 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0731 21:21:16.119313 1142911 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0731 21:21:16.119379 1142911 kubeadm.go:310] [certs] Using the existing "sa" key
I0731 21:21:16.119450 1142911 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0731 21:21:16.332996 1142911 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0731 21:21:16.675185 1142911 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0731 21:21:16.859507 1142911 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0731 21:21:17.025545 1142911 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0731 21:21:17.050395 1142911 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0731 21:21:17.053598 1142911 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0731 21:21:17.053738 1142911 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0731 21:21:17.198547 1142911 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0731 21:21:17.200425 1142911 out.go:204] - Booting up control plane ...
I0731 21:21:17.200594 1142911 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0731 21:21:17.207589 1142911 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0731 21:21:17.208962 1142911 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0731 21:21:17.211511 1142911 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0731 21:21:17.215924 1142911 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0731 21:21:57.218570 1142911 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0731 21:21:57.218777 1142911 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0731 21:21:57.219013 1142911 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0731 21:22:02.219765 1142911 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0731 21:22:02.219944 1142911 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0731 21:22:12.220686 1142911 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0731 21:22:12.220965 1142911 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0731 21:22:32.219747 1142911 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0731 21:22:32.220040 1142911 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0731 21:23:12.219553 1142911 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0731 21:23:12.219779 1142911 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0731 21:23:12.219792 1142911 kubeadm.go:310]
I0731 21:23:12.219863 1142911 kubeadm.go:310] Unfortunately, an error has occurred:
I0731 21:23:12.219937 1142911 kubeadm.go:310] timed out waiting for the condition
I0731 21:23:12.219946 1142911 kubeadm.go:310]
I0731 21:23:12.219987 1142911 kubeadm.go:310] This error is likely caused by:
I0731 21:23:12.220048 1142911 kubeadm.go:310] - The kubelet is not running
I0731 21:23:12.220178 1142911 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0731 21:23:12.220195 1142911 kubeadm.go:310]
I0731 21:23:12.220338 1142911 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0731 21:23:12.220388 1142911 kubeadm.go:310] - 'systemctl status kubelet'
I0731 21:23:12.220435 1142911 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0731 21:23:12.220445 1142911 kubeadm.go:310]
I0731 21:23:12.220607 1142911 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0731 21:23:12.220737 1142911 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0731 21:23:12.220752 1142911 kubeadm.go:310]
I0731 21:23:12.220891 1142911 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0731 21:23:12.220991 1142911 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0731 21:23:12.221112 1142911 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0731 21:23:12.221220 1142911 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0731 21:23:12.221231 1142911 kubeadm.go:310]
I0731 21:23:12.221766 1142911 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0731 21:23:12.221873 1142911 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0731 21:23:12.221959 1142911 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0731 21:23:12.222045 1142911 kubeadm.go:394] duration metric: took 3m55.474854938s to StartCluster
I0731 21:23:12.222095 1142911 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0731 21:23:12.222170 1142911 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0731 21:23:12.268456 1142911 cri.go:89] found id: ""
I0731 21:23:12.268488 1142911 logs.go:276] 0 containers: []
W0731 21:23:12.268499 1142911 logs.go:278] No container was found matching "kube-apiserver"
I0731 21:23:12.268507 1142911 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0731 21:23:12.268575 1142911 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0731 21:23:12.311331 1142911 cri.go:89] found id: ""
I0731 21:23:12.311361 1142911 logs.go:276] 0 containers: []
W0731 21:23:12.311370 1142911 logs.go:278] No container was found matching "etcd"
I0731 21:23:12.311377 1142911 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0731 21:23:12.311443 1142911 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0731 21:23:12.348062 1142911 cri.go:89] found id: ""
I0731 21:23:12.348123 1142911 logs.go:276] 0 containers: []
W0731 21:23:12.348135 1142911 logs.go:278] No container was found matching "coredns"
I0731 21:23:12.348144 1142911 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0731 21:23:12.348219 1142911 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0731 21:23:12.382136 1142911 cri.go:89] found id: ""
I0731 21:23:12.382171 1142911 logs.go:276] 0 containers: []
W0731 21:23:12.382183 1142911 logs.go:278] No container was found matching "kube-scheduler"
I0731 21:23:12.382192 1142911 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0731 21:23:12.382278 1142911 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0731 21:23:12.420889 1142911 cri.go:89] found id: ""
I0731 21:23:12.420917 1142911 logs.go:276] 0 containers: []
W0731 21:23:12.420929 1142911 logs.go:278] No container was found matching "kube-proxy"
I0731 21:23:12.420937 1142911 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0731 21:23:12.421000 1142911 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0731 21:23:12.462621 1142911 cri.go:89] found id: ""
I0731 21:23:12.462652 1142911 logs.go:276] 0 containers: []
W0731 21:23:12.462662 1142911 logs.go:278] No container was found matching "kube-controller-manager"
I0731 21:23:12.462669 1142911 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0731 21:23:12.462736 1142911 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0731 21:23:12.500005 1142911 cri.go:89] found id: ""
I0731 21:23:12.500040 1142911 logs.go:276] 0 containers: []
W0731 21:23:12.500052 1142911 logs.go:278] No container was found matching "kindnet"
I0731 21:23:12.500065 1142911 logs.go:123] Gathering logs for kubelet ...
I0731 21:23:12.500080 1142911 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0731 21:23:12.557573 1142911 logs.go:123] Gathering logs for dmesg ...
I0731 21:23:12.557615 1142911 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0731 21:23:12.571612 1142911 logs.go:123] Gathering logs for describe nodes ...
I0731 21:23:12.571649 1142911 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0731 21:23:12.721857 1142911 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0731 21:23:12.721888 1142911 logs.go:123] Gathering logs for CRI-O ...
I0731 21:23:12.721906 1142911 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0731 21:23:12.823082 1142911 logs.go:123] Gathering logs for container status ...
I0731 21:23:12.823128 1142911 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0731 21:23:12.864083 1142911 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0731 21:23:12.864154 1142911 out.go:239] *
*
W0731 21:23:12.864226 1142911 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0731 21:23:12.864257 1142911 out.go:239] *
*
W0731 21:23:12.865104 1142911 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0731 21:23:12.868234 1142911 out.go:177]
W0731 21:23:12.869488 1142911 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0731 21:23:12.869539 1142911 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0731 21:23:12.869560 1142911 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0731 21:23:12.871330 1142911 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-275462 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-275462 -n old-k8s-version-275462
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-275462 -n old-k8s-version-275462: exit status 6 (245.243428ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0731 21:23:13.157695 1145893 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-275462" does not appear in /home/jenkins/minikube-integration/19360-1093692/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-275462" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (296.73s)