=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-432422 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-432422 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (5m0.131984068s)
-- stdout --
* [old-k8s-version-432422] minikube v1.34.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=19598
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19598-5973/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19598-5973/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-432422" primary control-plane node in "old-k8s-version-432422" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0910 18:49:12.591122 64489 out.go:345] Setting OutFile to fd 1 ...
I0910 18:49:12.591221 64489 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0910 18:49:12.591231 64489 out.go:358] Setting ErrFile to fd 2...
I0910 18:49:12.591240 64489 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0910 18:49:12.591449 64489 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19598-5973/.minikube/bin
I0910 18:49:12.592049 64489 out.go:352] Setting JSON to false
I0910 18:49:12.593106 64489 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-13","uptime":5505,"bootTime":1725988648,"procs":287,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1067-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0910 18:49:12.593165 64489 start.go:139] virtualization: kvm guest
I0910 18:49:12.595363 64489 out.go:177] * [old-k8s-version-432422] minikube v1.34.0 on Ubuntu 20.04 (kvm/amd64)
I0910 18:49:12.596709 64489 notify.go:220] Checking for updates...
I0910 18:49:12.596713 64489 out.go:177] - MINIKUBE_LOCATION=19598
I0910 18:49:12.597936 64489 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0910 18:49:12.599149 64489 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19598-5973/kubeconfig
I0910 18:49:12.600399 64489 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19598-5973/.minikube
I0910 18:49:12.601469 64489 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0910 18:49:12.602558 64489 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0910 18:49:12.604053 64489 config.go:182] Loaded profile config "bridge-642043": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.0
I0910 18:49:12.604219 64489 config.go:182] Loaded profile config "enable-default-cni-642043": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.0
I0910 18:49:12.604342 64489 config.go:182] Loaded profile config "flannel-642043": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.0
I0910 18:49:12.604461 64489 driver.go:394] Setting default libvirt URI to qemu:///system
I0910 18:49:12.647966 64489 out.go:177] * Using the kvm2 driver based on user configuration
I0910 18:49:12.649389 64489 start.go:297] selected driver: kvm2
I0910 18:49:12.649408 64489 start.go:901] validating driver "kvm2" against <nil>
I0910 18:49:12.649423 64489 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0910 18:49:12.650228 64489 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0910 18:49:12.650335 64489 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19598-5973/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0910 18:49:12.669762 64489 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.34.0
I0910 18:49:12.669821 64489 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0910 18:49:12.670077 64489 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0910 18:49:12.670151 64489 cni.go:84] Creating CNI manager for ""
I0910 18:49:12.670165 64489 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0910 18:49:12.670176 64489 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0910 18:49:12.670249 64489 start.go:340] cluster config:
{Name:old-k8s-version-432422 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-432422 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0910 18:49:12.670378 64489 iso.go:125] acquiring lock: {Name:mk310938d9fbdb51215ef930a7daf1e95b891702 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0910 18:49:12.672299 64489 out.go:177] * Starting "old-k8s-version-432422" primary control-plane node in "old-k8s-version-432422" cluster
I0910 18:49:12.673578 64489 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0910 18:49:12.673626 64489 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19598-5973/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0910 18:49:12.673635 64489 cache.go:56] Caching tarball of preloaded images
I0910 18:49:12.673719 64489 preload.go:172] Found /home/jenkins/minikube-integration/19598-5973/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0910 18:49:12.673733 64489 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0910 18:49:12.673863 64489 profile.go:143] Saving config to /home/jenkins/minikube-integration/19598-5973/.minikube/profiles/old-k8s-version-432422/config.json ...
I0910 18:49:12.673886 64489 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19598-5973/.minikube/profiles/old-k8s-version-432422/config.json: {Name:mk9bb75484e7b3c907f6748cb62956ffa1c68a9b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0910 18:49:12.674055 64489 start.go:360] acquireMachinesLock for old-k8s-version-432422: {Name:mka8b4fee6f17f76c93c5b1ce15817bf0f00a352 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0910 18:49:39.349925 64489 start.go:364] duration metric: took 26.675845238s to acquireMachinesLock for "old-k8s-version-432422"
I0910 18:49:39.349987 64489 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-432422 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19598/minikube-v1.34.0-1725912912-19598-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-432422 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0910 18:49:39.350131 64489 start.go:125] createHost starting for "" (driver="kvm2")
I0910 18:49:39.352081 64489 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0910 18:49:39.352291 64489 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0910 18:49:39.352354 64489 main.go:141] libmachine: Launching plugin server for driver kvm2
I0910 18:49:39.370040 64489 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34037
I0910 18:49:39.370496 64489 main.go:141] libmachine: () Calling .GetVersion
I0910 18:49:39.371029 64489 main.go:141] libmachine: Using API Version 1
I0910 18:49:39.371052 64489 main.go:141] libmachine: () Calling .SetConfigRaw
I0910 18:49:39.371402 64489 main.go:141] libmachine: () Calling .GetMachineName
I0910 18:49:39.371595 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetMachineName
I0910 18:49:39.371755 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .DriverName
I0910 18:49:39.371905 64489 start.go:159] libmachine.API.Create for "old-k8s-version-432422" (driver="kvm2")
I0910 18:49:39.371930 64489 client.go:168] LocalClient.Create starting
I0910 18:49:39.371955 64489 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19598-5973/.minikube/certs/ca.pem
I0910 18:49:39.371985 64489 main.go:141] libmachine: Decoding PEM data...
I0910 18:49:39.372002 64489 main.go:141] libmachine: Parsing certificate...
I0910 18:49:39.372060 64489 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19598-5973/.minikube/certs/cert.pem
I0910 18:49:39.372085 64489 main.go:141] libmachine: Decoding PEM data...
I0910 18:49:39.372110 64489 main.go:141] libmachine: Parsing certificate...
I0910 18:49:39.372136 64489 main.go:141] libmachine: Running pre-create checks...
I0910 18:49:39.372155 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .PreCreateCheck
I0910 18:49:39.372499 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetConfigRaw
I0910 18:49:39.372887 64489 main.go:141] libmachine: Creating machine...
I0910 18:49:39.372900 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .Create
I0910 18:49:39.373037 64489 main.go:141] libmachine: (old-k8s-version-432422) Creating KVM machine...
I0910 18:49:39.374349 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | found existing default KVM network
I0910 18:49:39.375928 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | I0910 18:49:39.375756 64854 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:f7:ff:e6} reservation:<nil>}
I0910 18:49:39.376937 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | I0910 18:49:39.376816 64854 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr3 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:28:f7:4e} reservation:<nil>}
I0910 18:49:39.378041 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | I0910 18:49:39.377955 64854 network.go:206] using free private subnet 192.168.61.0/24: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000366950}
I0910 18:49:39.378064 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | created network xml:
I0910 18:49:39.378076 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | <network>
I0910 18:49:39.378091 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | <name>mk-old-k8s-version-432422</name>
I0910 18:49:39.378104 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | <dns enable='no'/>
I0910 18:49:39.378111 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG |
I0910 18:49:39.378121 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | <ip address='192.168.61.1' netmask='255.255.255.0'>
I0910 18:49:39.378137 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | <dhcp>
I0910 18:49:39.378151 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | <range start='192.168.61.2' end='192.168.61.253'/>
I0910 18:49:39.378161 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | </dhcp>
I0910 18:49:39.378169 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | </ip>
I0910 18:49:39.378178 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG |
I0910 18:49:39.378186 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | </network>
I0910 18:49:39.378197 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG |
I0910 18:49:39.383474 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | trying to create private KVM network mk-old-k8s-version-432422 192.168.61.0/24...
I0910 18:49:39.456774 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | private KVM network mk-old-k8s-version-432422 192.168.61.0/24 created
I0910 18:49:39.456810 64489 main.go:141] libmachine: (old-k8s-version-432422) Setting up store path in /home/jenkins/minikube-integration/19598-5973/.minikube/machines/old-k8s-version-432422 ...
I0910 18:49:39.456824 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | I0910 18:49:39.456718 64854 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19598-5973/.minikube
I0910 18:49:39.456861 64489 main.go:141] libmachine: (old-k8s-version-432422) Building disk image from file:///home/jenkins/minikube-integration/19598-5973/.minikube/cache/iso/amd64/minikube-v1.34.0-1725912912-19598-amd64.iso
I0910 18:49:39.456879 64489 main.go:141] libmachine: (old-k8s-version-432422) Downloading /home/jenkins/minikube-integration/19598-5973/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19598-5973/.minikube/cache/iso/amd64/minikube-v1.34.0-1725912912-19598-amd64.iso...
I0910 18:49:39.700598 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | I0910 18:49:39.700504 64854 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19598-5973/.minikube/machines/old-k8s-version-432422/id_rsa...
I0910 18:49:39.892855 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | I0910 18:49:39.892730 64854 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19598-5973/.minikube/machines/old-k8s-version-432422/old-k8s-version-432422.rawdisk...
I0910 18:49:39.892884 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | Writing magic tar header
I0910 18:49:39.892901 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | Writing SSH key tar header
I0910 18:49:39.892914 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | I0910 18:49:39.892840 64854 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19598-5973/.minikube/machines/old-k8s-version-432422 ...
I0910 18:49:39.892983 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19598-5973/.minikube/machines/old-k8s-version-432422
I0910 18:49:39.893046 64489 main.go:141] libmachine: (old-k8s-version-432422) Setting executable bit set on /home/jenkins/minikube-integration/19598-5973/.minikube/machines/old-k8s-version-432422 (perms=drwx------)
I0910 18:49:39.893063 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19598-5973/.minikube/machines
I0910 18:49:39.893090 64489 main.go:141] libmachine: (old-k8s-version-432422) Setting executable bit set on /home/jenkins/minikube-integration/19598-5973/.minikube/machines (perms=drwxr-xr-x)
I0910 18:49:39.893109 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19598-5973/.minikube
I0910 18:49:39.893124 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19598-5973
I0910 18:49:39.893136 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0910 18:49:39.893149 64489 main.go:141] libmachine: (old-k8s-version-432422) Setting executable bit set on /home/jenkins/minikube-integration/19598-5973/.minikube (perms=drwxr-xr-x)
I0910 18:49:39.893170 64489 main.go:141] libmachine: (old-k8s-version-432422) Setting executable bit set on /home/jenkins/minikube-integration/19598-5973 (perms=drwxrwxr-x)
I0910 18:49:39.893183 64489 main.go:141] libmachine: (old-k8s-version-432422) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0910 18:49:39.893206 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | Checking permissions on dir: /home/jenkins
I0910 18:49:39.893232 64489 main.go:141] libmachine: (old-k8s-version-432422) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0910 18:49:39.893244 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | Checking permissions on dir: /home
I0910 18:49:39.893256 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | Skipping /home - not owner
I0910 18:49:39.893268 64489 main.go:141] libmachine: (old-k8s-version-432422) Creating domain...
I0910 18:49:39.894541 64489 main.go:141] libmachine: (old-k8s-version-432422) define libvirt domain using xml:
I0910 18:49:39.894566 64489 main.go:141] libmachine: (old-k8s-version-432422) <domain type='kvm'>
I0910 18:49:39.894578 64489 main.go:141] libmachine: (old-k8s-version-432422) <name>old-k8s-version-432422</name>
I0910 18:49:39.894586 64489 main.go:141] libmachine: (old-k8s-version-432422) <memory unit='MiB'>2200</memory>
I0910 18:49:39.894609 64489 main.go:141] libmachine: (old-k8s-version-432422) <vcpu>2</vcpu>
I0910 18:49:39.894625 64489 main.go:141] libmachine: (old-k8s-version-432422) <features>
I0910 18:49:39.894638 64489 main.go:141] libmachine: (old-k8s-version-432422) <acpi/>
I0910 18:49:39.894653 64489 main.go:141] libmachine: (old-k8s-version-432422) <apic/>
I0910 18:49:39.894665 64489 main.go:141] libmachine: (old-k8s-version-432422) <pae/>
I0910 18:49:39.894675 64489 main.go:141] libmachine: (old-k8s-version-432422)
I0910 18:49:39.894683 64489 main.go:141] libmachine: (old-k8s-version-432422) </features>
I0910 18:49:39.894693 64489 main.go:141] libmachine: (old-k8s-version-432422) <cpu mode='host-passthrough'>
I0910 18:49:39.894701 64489 main.go:141] libmachine: (old-k8s-version-432422)
I0910 18:49:39.894707 64489 main.go:141] libmachine: (old-k8s-version-432422) </cpu>
I0910 18:49:39.894715 64489 main.go:141] libmachine: (old-k8s-version-432422) <os>
I0910 18:49:39.894744 64489 main.go:141] libmachine: (old-k8s-version-432422) <type>hvm</type>
I0910 18:49:39.894756 64489 main.go:141] libmachine: (old-k8s-version-432422) <boot dev='cdrom'/>
I0910 18:49:39.894764 64489 main.go:141] libmachine: (old-k8s-version-432422) <boot dev='hd'/>
I0910 18:49:39.894776 64489 main.go:141] libmachine: (old-k8s-version-432422) <bootmenu enable='no'/>
I0910 18:49:39.894785 64489 main.go:141] libmachine: (old-k8s-version-432422) </os>
I0910 18:49:39.894792 64489 main.go:141] libmachine: (old-k8s-version-432422) <devices>
I0910 18:49:39.894800 64489 main.go:141] libmachine: (old-k8s-version-432422) <disk type='file' device='cdrom'>
I0910 18:49:39.894818 64489 main.go:141] libmachine: (old-k8s-version-432422) <source file='/home/jenkins/minikube-integration/19598-5973/.minikube/machines/old-k8s-version-432422/boot2docker.iso'/>
I0910 18:49:39.894833 64489 main.go:141] libmachine: (old-k8s-version-432422) <target dev='hdc' bus='scsi'/>
I0910 18:49:39.894848 64489 main.go:141] libmachine: (old-k8s-version-432422) <readonly/>
I0910 18:49:39.894858 64489 main.go:141] libmachine: (old-k8s-version-432422) </disk>
I0910 18:49:39.894871 64489 main.go:141] libmachine: (old-k8s-version-432422) <disk type='file' device='disk'>
I0910 18:49:39.894884 64489 main.go:141] libmachine: (old-k8s-version-432422) <driver name='qemu' type='raw' cache='default' io='threads' />
I0910 18:49:39.894899 64489 main.go:141] libmachine: (old-k8s-version-432422) <source file='/home/jenkins/minikube-integration/19598-5973/.minikube/machines/old-k8s-version-432422/old-k8s-version-432422.rawdisk'/>
I0910 18:49:39.894914 64489 main.go:141] libmachine: (old-k8s-version-432422) <target dev='hda' bus='virtio'/>
I0910 18:49:39.894926 64489 main.go:141] libmachine: (old-k8s-version-432422) </disk>
I0910 18:49:39.894936 64489 main.go:141] libmachine: (old-k8s-version-432422) <interface type='network'>
I0910 18:49:39.894949 64489 main.go:141] libmachine: (old-k8s-version-432422) <source network='mk-old-k8s-version-432422'/>
I0910 18:49:39.894962 64489 main.go:141] libmachine: (old-k8s-version-432422) <model type='virtio'/>
I0910 18:49:39.894971 64489 main.go:141] libmachine: (old-k8s-version-432422) </interface>
I0910 18:49:39.894979 64489 main.go:141] libmachine: (old-k8s-version-432422) <interface type='network'>
I0910 18:49:39.894989 64489 main.go:141] libmachine: (old-k8s-version-432422) <source network='default'/>
I0910 18:49:39.894996 64489 main.go:141] libmachine: (old-k8s-version-432422) <model type='virtio'/>
I0910 18:49:39.895007 64489 main.go:141] libmachine: (old-k8s-version-432422) </interface>
I0910 18:49:39.895015 64489 main.go:141] libmachine: (old-k8s-version-432422) <serial type='pty'>
I0910 18:49:39.895027 64489 main.go:141] libmachine: (old-k8s-version-432422) <target port='0'/>
I0910 18:49:39.895040 64489 main.go:141] libmachine: (old-k8s-version-432422) </serial>
I0910 18:49:39.895053 64489 main.go:141] libmachine: (old-k8s-version-432422) <console type='pty'>
I0910 18:49:39.895067 64489 main.go:141] libmachine: (old-k8s-version-432422) <target type='serial' port='0'/>
I0910 18:49:39.895079 64489 main.go:141] libmachine: (old-k8s-version-432422) </console>
I0910 18:49:39.895090 64489 main.go:141] libmachine: (old-k8s-version-432422) <rng model='virtio'>
I0910 18:49:39.895104 64489 main.go:141] libmachine: (old-k8s-version-432422) <backend model='random'>/dev/random</backend>
I0910 18:49:39.895125 64489 main.go:141] libmachine: (old-k8s-version-432422) </rng>
I0910 18:49:39.895139 64489 main.go:141] libmachine: (old-k8s-version-432422)
I0910 18:49:39.895149 64489 main.go:141] libmachine: (old-k8s-version-432422)
I0910 18:49:39.895175 64489 main.go:141] libmachine: (old-k8s-version-432422) </devices>
I0910 18:49:39.895194 64489 main.go:141] libmachine: (old-k8s-version-432422) </domain>
I0910 18:49:39.895209 64489 main.go:141] libmachine: (old-k8s-version-432422)
I0910 18:49:39.899881 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has defined MAC address 52:54:00:f4:0d:74 in network default
I0910 18:49:39.900607 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has defined MAC address 52:54:00:65:ab:4d in network mk-old-k8s-version-432422
I0910 18:49:39.900664 64489 main.go:141] libmachine: (old-k8s-version-432422) Ensuring networks are active...
I0910 18:49:39.901432 64489 main.go:141] libmachine: (old-k8s-version-432422) Ensuring network default is active
I0910 18:49:39.901808 64489 main.go:141] libmachine: (old-k8s-version-432422) Ensuring network mk-old-k8s-version-432422 is active
I0910 18:49:39.902412 64489 main.go:141] libmachine: (old-k8s-version-432422) Getting domain xml...
I0910 18:49:39.903264 64489 main.go:141] libmachine: (old-k8s-version-432422) Creating domain...
I0910 18:49:41.377701 64489 main.go:141] libmachine: (old-k8s-version-432422) Waiting to get IP...
I0910 18:49:41.378686 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has defined MAC address 52:54:00:65:ab:4d in network mk-old-k8s-version-432422
I0910 18:49:41.379320 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | unable to find current IP address of domain old-k8s-version-432422 in network mk-old-k8s-version-432422
I0910 18:49:41.379358 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | I0910 18:49:41.379306 64854 retry.go:31] will retry after 285.927865ms: waiting for machine to come up
I0910 18:49:41.666958 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has defined MAC address 52:54:00:65:ab:4d in network mk-old-k8s-version-432422
I0910 18:49:41.667618 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | unable to find current IP address of domain old-k8s-version-432422 in network mk-old-k8s-version-432422
I0910 18:49:41.667644 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | I0910 18:49:41.667595 64854 retry.go:31] will retry after 323.196918ms: waiting for machine to come up
I0910 18:49:41.994790 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has defined MAC address 52:54:00:65:ab:4d in network mk-old-k8s-version-432422
I0910 18:49:41.995400 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | unable to find current IP address of domain old-k8s-version-432422 in network mk-old-k8s-version-432422
I0910 18:49:41.995420 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | I0910 18:49:41.995343 64854 retry.go:31] will retry after 433.533829ms: waiting for machine to come up
I0910 18:49:42.430691 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has defined MAC address 52:54:00:65:ab:4d in network mk-old-k8s-version-432422
I0910 18:49:42.431295 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | unable to find current IP address of domain old-k8s-version-432422 in network mk-old-k8s-version-432422
I0910 18:49:42.431330 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | I0910 18:49:42.431233 64854 retry.go:31] will retry after 376.573573ms: waiting for machine to come up
I0910 18:49:42.810267 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has defined MAC address 52:54:00:65:ab:4d in network mk-old-k8s-version-432422
I0910 18:49:42.821178 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | unable to find current IP address of domain old-k8s-version-432422 in network mk-old-k8s-version-432422
I0910 18:49:42.821202 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | I0910 18:49:42.817213 64854 retry.go:31] will retry after 642.546369ms: waiting for machine to come up
I0910 18:49:43.461360 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has defined MAC address 52:54:00:65:ab:4d in network mk-old-k8s-version-432422
I0910 18:49:43.461856 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | unable to find current IP address of domain old-k8s-version-432422 in network mk-old-k8s-version-432422
I0910 18:49:43.461884 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | I0910 18:49:43.461834 64854 retry.go:31] will retry after 636.511384ms: waiting for machine to come up
I0910 18:49:44.101683 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has defined MAC address 52:54:00:65:ab:4d in network mk-old-k8s-version-432422
I0910 18:49:44.104261 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | unable to find current IP address of domain old-k8s-version-432422 in network mk-old-k8s-version-432422
I0910 18:49:44.104291 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | I0910 18:49:44.104214 64854 retry.go:31] will retry after 1.026229685s: waiting for machine to come up
I0910 18:49:45.132191 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has defined MAC address 52:54:00:65:ab:4d in network mk-old-k8s-version-432422
I0910 18:49:45.132984 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | unable to find current IP address of domain old-k8s-version-432422 in network mk-old-k8s-version-432422
I0910 18:49:45.133013 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | I0910 18:49:45.132947 64854 retry.go:31] will retry after 1.336087899s: waiting for machine to come up
I0910 18:49:46.470260 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has defined MAC address 52:54:00:65:ab:4d in network mk-old-k8s-version-432422
I0910 18:49:46.470968 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | unable to find current IP address of domain old-k8s-version-432422 in network mk-old-k8s-version-432422
I0910 18:49:46.470994 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | I0910 18:49:46.470888 64854 retry.go:31] will retry after 1.506670277s: waiting for machine to come up
I0910 18:49:47.979062 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has defined MAC address 52:54:00:65:ab:4d in network mk-old-k8s-version-432422
I0910 18:49:47.979495 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | unable to find current IP address of domain old-k8s-version-432422 in network mk-old-k8s-version-432422
I0910 18:49:47.979521 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | I0910 18:49:47.979423 64854 retry.go:31] will retry after 2.284315854s: waiting for machine to come up
I0910 18:49:50.265181 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has defined MAC address 52:54:00:65:ab:4d in network mk-old-k8s-version-432422
I0910 18:49:50.265602 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | unable to find current IP address of domain old-k8s-version-432422 in network mk-old-k8s-version-432422
I0910 18:49:50.265631 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | I0910 18:49:50.265524 64854 retry.go:31] will retry after 2.267263482s: waiting for machine to come up
I0910 18:49:52.534487 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has defined MAC address 52:54:00:65:ab:4d in network mk-old-k8s-version-432422
I0910 18:49:52.535075 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | unable to find current IP address of domain old-k8s-version-432422 in network mk-old-k8s-version-432422
I0910 18:49:52.535104 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | I0910 18:49:52.535035 64854 retry.go:31] will retry after 2.577084278s: waiting for machine to come up
I0910 18:49:55.114038 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has defined MAC address 52:54:00:65:ab:4d in network mk-old-k8s-version-432422
I0910 18:49:55.114528 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | unable to find current IP address of domain old-k8s-version-432422 in network mk-old-k8s-version-432422
I0910 18:49:55.114564 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | I0910 18:49:55.114471 64854 retry.go:31] will retry after 4.15190677s: waiting for machine to come up
I0910 18:49:59.270120 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has defined MAC address 52:54:00:65:ab:4d in network mk-old-k8s-version-432422
I0910 18:49:59.270656 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | unable to find current IP address of domain old-k8s-version-432422 in network mk-old-k8s-version-432422
I0910 18:49:59.270683 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | I0910 18:49:59.270606 64854 retry.go:31] will retry after 5.631932411s: waiting for machine to come up
I0910 18:50:04.903690 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has defined MAC address 52:54:00:65:ab:4d in network mk-old-k8s-version-432422
I0910 18:50:04.904129 64489 main.go:141] libmachine: (old-k8s-version-432422) Found IP for machine: 192.168.61.51
I0910 18:50:04.904155 64489 main.go:141] libmachine: (old-k8s-version-432422) Reserving static IP address...
I0910 18:50:04.904169 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has current primary IP address 192.168.61.51 and MAC address 52:54:00:65:ab:4d in network mk-old-k8s-version-432422
I0910 18:50:04.904508 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-432422", mac: "52:54:00:65:ab:4d", ip: "192.168.61.51"} in network mk-old-k8s-version-432422
I0910 18:50:04.986541 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | Getting to WaitForSSH function...
I0910 18:50:04.986573 64489 main.go:141] libmachine: (old-k8s-version-432422) Reserved static IP address: 192.168.61.51
I0910 18:50:04.986586 64489 main.go:141] libmachine: (old-k8s-version-432422) Waiting for SSH to be available...
I0910 18:50:04.989144 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has defined MAC address 52:54:00:65:ab:4d in network mk-old-k8s-version-432422
I0910 18:50:04.989640 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:65:ab:4d", ip: ""} in network mk-old-k8s-version-432422: {Iface:virbr2 ExpiryTime:2024-09-10 19:49:56 +0000 UTC Type:0 Mac:52:54:00:65:ab:4d Iaid: IPaddr:192.168.61.51 Prefix:24 Hostname:minikube Clientid:01:52:54:00:65:ab:4d}
I0910 18:50:04.989670 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has defined IP address 192.168.61.51 and MAC address 52:54:00:65:ab:4d in network mk-old-k8s-version-432422
I0910 18:50:04.989802 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | Using SSH client type: external
I0910 18:50:04.989822 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | Using SSH private key: /home/jenkins/minikube-integration/19598-5973/.minikube/machines/old-k8s-version-432422/id_rsa (-rw-------)
I0910 18:50:04.989850 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.61.51 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19598-5973/.minikube/machines/old-k8s-version-432422/id_rsa -p 22] /usr/bin/ssh <nil>}
I0910 18:50:04.989860 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | About to run SSH command:
I0910 18:50:04.989880 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | exit 0
I0910 18:50:05.116991 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | SSH cmd err, output: <nil>:
I0910 18:50:05.117304 64489 main.go:141] libmachine: (old-k8s-version-432422) KVM machine creation complete!
I0910 18:50:05.117623 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetConfigRaw
I0910 18:50:05.118177 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .DriverName
I0910 18:50:05.118390 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .DriverName
I0910 18:50:05.118576 64489 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0910 18:50:05.118595 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetState
I0910 18:50:05.120014 64489 main.go:141] libmachine: Detecting operating system of created instance...
I0910 18:50:05.120027 64489 main.go:141] libmachine: Waiting for SSH to be available...
I0910 18:50:05.120033 64489 main.go:141] libmachine: Getting to WaitForSSH function...
I0910 18:50:05.120039 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetSSHHostname
I0910 18:50:05.122604 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has defined MAC address 52:54:00:65:ab:4d in network mk-old-k8s-version-432422
I0910 18:50:05.123130 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:65:ab:4d", ip: ""} in network mk-old-k8s-version-432422: {Iface:virbr2 ExpiryTime:2024-09-10 19:49:56 +0000 UTC Type:0 Mac:52:54:00:65:ab:4d Iaid: IPaddr:192.168.61.51 Prefix:24 Hostname:old-k8s-version-432422 Clientid:01:52:54:00:65:ab:4d}
I0910 18:50:05.123152 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has defined IP address 192.168.61.51 and MAC address 52:54:00:65:ab:4d in network mk-old-k8s-version-432422
I0910 18:50:05.123278 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetSSHPort
I0910 18:50:05.123454 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetSSHKeyPath
I0910 18:50:05.123605 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetSSHKeyPath
I0910 18:50:05.123742 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetSSHUsername
I0910 18:50:05.123916 64489 main.go:141] libmachine: Using SSH client type: native
I0910 18:50:05.124151 64489 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8375c0] 0x83a320 <nil> [] 0s} 192.168.61.51 22 <nil> <nil>}
I0910 18:50:05.124165 64489 main.go:141] libmachine: About to run SSH command:
exit 0
I0910 18:50:05.233000 64489 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0910 18:50:05.233024 64489 main.go:141] libmachine: Detecting the provisioner...
I0910 18:50:05.233034 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetSSHHostname
I0910 18:50:05.235899 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has defined MAC address 52:54:00:65:ab:4d in network mk-old-k8s-version-432422
I0910 18:50:05.236349 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:65:ab:4d", ip: ""} in network mk-old-k8s-version-432422: {Iface:virbr2 ExpiryTime:2024-09-10 19:49:56 +0000 UTC Type:0 Mac:52:54:00:65:ab:4d Iaid: IPaddr:192.168.61.51 Prefix:24 Hostname:old-k8s-version-432422 Clientid:01:52:54:00:65:ab:4d}
I0910 18:50:05.236380 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has defined IP address 192.168.61.51 and MAC address 52:54:00:65:ab:4d in network mk-old-k8s-version-432422
I0910 18:50:05.236580 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetSSHPort
I0910 18:50:05.236744 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetSSHKeyPath
I0910 18:50:05.236904 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetSSHKeyPath
I0910 18:50:05.237220 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetSSHUsername
I0910 18:50:05.237402 64489 main.go:141] libmachine: Using SSH client type: native
I0910 18:50:05.237576 64489 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8375c0] 0x83a320 <nil> [] 0s} 192.168.61.51 22 <nil> <nil>}
I0910 18:50:05.237587 64489 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0910 18:50:05.341847 64489 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0910 18:50:05.341924 64489 main.go:141] libmachine: found compatible host: buildroot
I0910 18:50:05.341936 64489 main.go:141] libmachine: Provisioning with buildroot...
I0910 18:50:05.341944 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetMachineName
I0910 18:50:05.342168 64489 buildroot.go:166] provisioning hostname "old-k8s-version-432422"
I0910 18:50:05.342193 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetMachineName
I0910 18:50:05.342397 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetSSHHostname
I0910 18:50:05.344682 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has defined MAC address 52:54:00:65:ab:4d in network mk-old-k8s-version-432422
I0910 18:50:05.345099 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:65:ab:4d", ip: ""} in network mk-old-k8s-version-432422: {Iface:virbr2 ExpiryTime:2024-09-10 19:49:56 +0000 UTC Type:0 Mac:52:54:00:65:ab:4d Iaid: IPaddr:192.168.61.51 Prefix:24 Hostname:old-k8s-version-432422 Clientid:01:52:54:00:65:ab:4d}
I0910 18:50:05.345129 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has defined IP address 192.168.61.51 and MAC address 52:54:00:65:ab:4d in network mk-old-k8s-version-432422
I0910 18:50:05.345257 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetSSHPort
I0910 18:50:05.345442 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetSSHKeyPath
I0910 18:50:05.345616 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetSSHKeyPath
I0910 18:50:05.345740 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetSSHUsername
I0910 18:50:05.345888 64489 main.go:141] libmachine: Using SSH client type: native
I0910 18:50:05.346091 64489 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8375c0] 0x83a320 <nil> [] 0s} 192.168.61.51 22 <nil> <nil>}
I0910 18:50:05.346109 64489 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-432422 && echo "old-k8s-version-432422" | sudo tee /etc/hostname
I0910 18:50:05.461639 64489 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-432422
I0910 18:50:05.461668 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetSSHHostname
I0910 18:50:05.464585 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has defined MAC address 52:54:00:65:ab:4d in network mk-old-k8s-version-432422
I0910 18:50:05.464906 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:65:ab:4d", ip: ""} in network mk-old-k8s-version-432422: {Iface:virbr2 ExpiryTime:2024-09-10 19:49:56 +0000 UTC Type:0 Mac:52:54:00:65:ab:4d Iaid: IPaddr:192.168.61.51 Prefix:24 Hostname:old-k8s-version-432422 Clientid:01:52:54:00:65:ab:4d}
I0910 18:50:05.464935 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has defined IP address 192.168.61.51 and MAC address 52:54:00:65:ab:4d in network mk-old-k8s-version-432422
I0910 18:50:05.465090 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetSSHPort
I0910 18:50:05.465262 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetSSHKeyPath
I0910 18:50:05.465415 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetSSHKeyPath
I0910 18:50:05.465548 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetSSHUsername
I0910 18:50:05.465709 64489 main.go:141] libmachine: Using SSH client type: native
I0910 18:50:05.465910 64489 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8375c0] 0x83a320 <nil> [] 0s} 192.168.61.51 22 <nil> <nil>}
I0910 18:50:05.465935 64489 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-432422' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-432422/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-432422' | sudo tee -a /etc/hosts;
fi
fi
I0910 18:50:05.586317 64489 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0910 18:50:05.586346 64489 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19598-5973/.minikube CaCertPath:/home/jenkins/minikube-integration/19598-5973/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19598-5973/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19598-5973/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19598-5973/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19598-5973/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19598-5973/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19598-5973/.minikube}
I0910 18:50:05.586383 64489 buildroot.go:174] setting up certificates
I0910 18:50:05.586399 64489 provision.go:84] configureAuth start
I0910 18:50:05.586413 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetMachineName
I0910 18:50:05.586676 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetIP
I0910 18:50:05.589328 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has defined MAC address 52:54:00:65:ab:4d in network mk-old-k8s-version-432422
I0910 18:50:05.589635 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:65:ab:4d", ip: ""} in network mk-old-k8s-version-432422: {Iface:virbr2 ExpiryTime:2024-09-10 19:49:56 +0000 UTC Type:0 Mac:52:54:00:65:ab:4d Iaid: IPaddr:192.168.61.51 Prefix:24 Hostname:old-k8s-version-432422 Clientid:01:52:54:00:65:ab:4d}
I0910 18:50:05.589657 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has defined IP address 192.168.61.51 and MAC address 52:54:00:65:ab:4d in network mk-old-k8s-version-432422
I0910 18:50:05.589813 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetSSHHostname
I0910 18:50:05.591998 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has defined MAC address 52:54:00:65:ab:4d in network mk-old-k8s-version-432422
I0910 18:50:05.592357 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:65:ab:4d", ip: ""} in network mk-old-k8s-version-432422: {Iface:virbr2 ExpiryTime:2024-09-10 19:49:56 +0000 UTC Type:0 Mac:52:54:00:65:ab:4d Iaid: IPaddr:192.168.61.51 Prefix:24 Hostname:old-k8s-version-432422 Clientid:01:52:54:00:65:ab:4d}
I0910 18:50:05.592382 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has defined IP address 192.168.61.51 and MAC address 52:54:00:65:ab:4d in network mk-old-k8s-version-432422
I0910 18:50:05.592501 64489 provision.go:143] copyHostCerts
I0910 18:50:05.592564 64489 exec_runner.go:144] found /home/jenkins/minikube-integration/19598-5973/.minikube/ca.pem, removing ...
I0910 18:50:05.592573 64489 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19598-5973/.minikube/ca.pem
I0910 18:50:05.592626 64489 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19598-5973/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19598-5973/.minikube/ca.pem (1082 bytes)
I0910 18:50:05.592737 64489 exec_runner.go:144] found /home/jenkins/minikube-integration/19598-5973/.minikube/cert.pem, removing ...
I0910 18:50:05.592746 64489 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19598-5973/.minikube/cert.pem
I0910 18:50:05.592768 64489 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19598-5973/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19598-5973/.minikube/cert.pem (1123 bytes)
I0910 18:50:05.592841 64489 exec_runner.go:144] found /home/jenkins/minikube-integration/19598-5973/.minikube/key.pem, removing ...
I0910 18:50:05.592848 64489 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19598-5973/.minikube/key.pem
I0910 18:50:05.592866 64489 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19598-5973/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19598-5973/.minikube/key.pem (1675 bytes)
I0910 18:50:05.592929 64489 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19598-5973/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19598-5973/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19598-5973/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-432422 san=[127.0.0.1 192.168.61.51 localhost minikube old-k8s-version-432422]
I0910 18:50:05.641136 64489 provision.go:177] copyRemoteCerts
I0910 18:50:05.641183 64489 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0910 18:50:05.641204 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetSSHHostname
I0910 18:50:05.643957 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has defined MAC address 52:54:00:65:ab:4d in network mk-old-k8s-version-432422
I0910 18:50:05.644264 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:65:ab:4d", ip: ""} in network mk-old-k8s-version-432422: {Iface:virbr2 ExpiryTime:2024-09-10 19:49:56 +0000 UTC Type:0 Mac:52:54:00:65:ab:4d Iaid: IPaddr:192.168.61.51 Prefix:24 Hostname:old-k8s-version-432422 Clientid:01:52:54:00:65:ab:4d}
I0910 18:50:05.644308 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has defined IP address 192.168.61.51 and MAC address 52:54:00:65:ab:4d in network mk-old-k8s-version-432422
I0910 18:50:05.644455 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetSSHPort
I0910 18:50:05.644651 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetSSHKeyPath
I0910 18:50:05.644820 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetSSHUsername
I0910 18:50:05.644981 64489 sshutil.go:53] new ssh client: &{IP:192.168.61.51 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19598-5973/.minikube/machines/old-k8s-version-432422/id_rsa Username:docker}
I0910 18:50:05.728001 64489 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19598-5973/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0910 18:50:05.755593 64489 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19598-5973/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0910 18:50:05.783331 64489 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19598-5973/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0910 18:50:05.813590 64489 provision.go:87] duration metric: took 227.176465ms to configureAuth
I0910 18:50:05.813619 64489 buildroot.go:189] setting minikube options for container-runtime
I0910 18:50:05.813808 64489 config.go:182] Loaded profile config "old-k8s-version-432422": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0910 18:50:05.813897 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetSSHHostname
I0910 18:50:05.816749 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has defined MAC address 52:54:00:65:ab:4d in network mk-old-k8s-version-432422
I0910 18:50:05.817120 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:65:ab:4d", ip: ""} in network mk-old-k8s-version-432422: {Iface:virbr2 ExpiryTime:2024-09-10 19:49:56 +0000 UTC Type:0 Mac:52:54:00:65:ab:4d Iaid: IPaddr:192.168.61.51 Prefix:24 Hostname:old-k8s-version-432422 Clientid:01:52:54:00:65:ab:4d}
I0910 18:50:05.817146 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has defined IP address 192.168.61.51 and MAC address 52:54:00:65:ab:4d in network mk-old-k8s-version-432422
I0910 18:50:05.817339 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetSSHPort
I0910 18:50:05.817521 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetSSHKeyPath
I0910 18:50:05.817677 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetSSHKeyPath
I0910 18:50:05.817859 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetSSHUsername
I0910 18:50:05.818022 64489 main.go:141] libmachine: Using SSH client type: native
I0910 18:50:05.818234 64489 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8375c0] 0x83a320 <nil> [] 0s} 192.168.61.51 22 <nil> <nil>}
I0910 18:50:05.818254 64489 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0910 18:50:06.056386 64489 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0910 18:50:06.056416 64489 main.go:141] libmachine: Checking connection to Docker...
I0910 18:50:06.056428 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetURL
I0910 18:50:06.057721 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | Using libvirt version 6000000
I0910 18:50:06.061363 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has defined MAC address 52:54:00:65:ab:4d in network mk-old-k8s-version-432422
I0910 18:50:06.061804 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:65:ab:4d", ip: ""} in network mk-old-k8s-version-432422: {Iface:virbr2 ExpiryTime:2024-09-10 19:49:56 +0000 UTC Type:0 Mac:52:54:00:65:ab:4d Iaid: IPaddr:192.168.61.51 Prefix:24 Hostname:old-k8s-version-432422 Clientid:01:52:54:00:65:ab:4d}
I0910 18:50:06.061829 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has defined IP address 192.168.61.51 and MAC address 52:54:00:65:ab:4d in network mk-old-k8s-version-432422
I0910 18:50:06.061975 64489 main.go:141] libmachine: Docker is up and running!
I0910 18:50:06.061986 64489 main.go:141] libmachine: Reticulating splines...
I0910 18:50:06.061993 64489 client.go:171] duration metric: took 26.690055539s to LocalClient.Create
I0910 18:50:06.062027 64489 start.go:167] duration metric: took 26.690110687s to libmachine.API.Create "old-k8s-version-432422"
I0910 18:50:06.062036 64489 start.go:293] postStartSetup for "old-k8s-version-432422" (driver="kvm2")
I0910 18:50:06.062055 64489 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0910 18:50:06.062080 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .DriverName
I0910 18:50:06.062290 64489 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0910 18:50:06.062309 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetSSHHostname
I0910 18:50:06.065120 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has defined MAC address 52:54:00:65:ab:4d in network mk-old-k8s-version-432422
I0910 18:50:06.065480 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:65:ab:4d", ip: ""} in network mk-old-k8s-version-432422: {Iface:virbr2 ExpiryTime:2024-09-10 19:49:56 +0000 UTC Type:0 Mac:52:54:00:65:ab:4d Iaid: IPaddr:192.168.61.51 Prefix:24 Hostname:old-k8s-version-432422 Clientid:01:52:54:00:65:ab:4d}
I0910 18:50:06.065507 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has defined IP address 192.168.61.51 and MAC address 52:54:00:65:ab:4d in network mk-old-k8s-version-432422
I0910 18:50:06.065668 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetSSHPort
I0910 18:50:06.065854 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetSSHKeyPath
I0910 18:50:06.066002 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetSSHUsername
I0910 18:50:06.066148 64489 sshutil.go:53] new ssh client: &{IP:192.168.61.51 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19598-5973/.minikube/machines/old-k8s-version-432422/id_rsa Username:docker}
I0910 18:50:06.149274 64489 ssh_runner.go:195] Run: cat /etc/os-release
I0910 18:50:06.155539 64489 info.go:137] Remote host: Buildroot 2023.02.9
I0910 18:50:06.155565 64489 filesync.go:126] Scanning /home/jenkins/minikube-integration/19598-5973/.minikube/addons for local assets ...
I0910 18:50:06.155637 64489 filesync.go:126] Scanning /home/jenkins/minikube-integration/19598-5973/.minikube/files for local assets ...
I0910 18:50:06.155729 64489 filesync.go:149] local asset: /home/jenkins/minikube-integration/19598-5973/.minikube/files/etc/ssl/certs/131212.pem -> 131212.pem in /etc/ssl/certs
I0910 18:50:06.155838 64489 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0910 18:50:06.167970 64489 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19598-5973/.minikube/files/etc/ssl/certs/131212.pem --> /etc/ssl/certs/131212.pem (1708 bytes)
I0910 18:50:06.200009 64489 start.go:296] duration metric: took 137.959029ms for postStartSetup
I0910 18:50:06.200067 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetConfigRaw
I0910 18:50:06.200750 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetIP
I0910 18:50:06.203240 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has defined MAC address 52:54:00:65:ab:4d in network mk-old-k8s-version-432422
I0910 18:50:06.203661 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:65:ab:4d", ip: ""} in network mk-old-k8s-version-432422: {Iface:virbr2 ExpiryTime:2024-09-10 19:49:56 +0000 UTC Type:0 Mac:52:54:00:65:ab:4d Iaid: IPaddr:192.168.61.51 Prefix:24 Hostname:old-k8s-version-432422 Clientid:01:52:54:00:65:ab:4d}
I0910 18:50:06.203690 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has defined IP address 192.168.61.51 and MAC address 52:54:00:65:ab:4d in network mk-old-k8s-version-432422
I0910 18:50:06.203962 64489 profile.go:143] Saving config to /home/jenkins/minikube-integration/19598-5973/.minikube/profiles/old-k8s-version-432422/config.json ...
I0910 18:50:06.204187 64489 start.go:128] duration metric: took 26.854042419s to createHost
I0910 18:50:06.204214 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetSSHHostname
I0910 18:50:06.206987 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has defined MAC address 52:54:00:65:ab:4d in network mk-old-k8s-version-432422
I0910 18:50:06.207435 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:65:ab:4d", ip: ""} in network mk-old-k8s-version-432422: {Iface:virbr2 ExpiryTime:2024-09-10 19:49:56 +0000 UTC Type:0 Mac:52:54:00:65:ab:4d Iaid: IPaddr:192.168.61.51 Prefix:24 Hostname:old-k8s-version-432422 Clientid:01:52:54:00:65:ab:4d}
I0910 18:50:06.207459 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has defined IP address 192.168.61.51 and MAC address 52:54:00:65:ab:4d in network mk-old-k8s-version-432422
I0910 18:50:06.207621 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetSSHPort
I0910 18:50:06.207799 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetSSHKeyPath
I0910 18:50:06.207981 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetSSHKeyPath
I0910 18:50:06.208154 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetSSHUsername
I0910 18:50:06.208326 64489 main.go:141] libmachine: Using SSH client type: native
I0910 18:50:06.208525 64489 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8375c0] 0x83a320 <nil> [] 0s} 192.168.61.51 22 <nil> <nil>}
I0910 18:50:06.208541 64489 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0910 18:50:06.314818 64489 main.go:141] libmachine: SSH cmd err, output: <nil>: 1725994206.266053112
I0910 18:50:06.314838 64489 fix.go:216] guest clock: 1725994206.266053112
I0910 18:50:06.314844 64489 fix.go:229] Guest: 2024-09-10 18:50:06.266053112 +0000 UTC Remote: 2024-09-10 18:50:06.2042003 +0000 UTC m=+53.655371379 (delta=61.852812ms)
I0910 18:50:06.314860 64489 fix.go:200] guest clock delta is within tolerance: 61.852812ms
I0910 18:50:06.314864 64489 start.go:83] releasing machines lock for "old-k8s-version-432422", held for 26.96490779s
I0910 18:50:06.314890 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .DriverName
I0910 18:50:06.315198 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetIP
I0910 18:50:06.318310 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has defined MAC address 52:54:00:65:ab:4d in network mk-old-k8s-version-432422
I0910 18:50:06.318799 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:65:ab:4d", ip: ""} in network mk-old-k8s-version-432422: {Iface:virbr2 ExpiryTime:2024-09-10 19:49:56 +0000 UTC Type:0 Mac:52:54:00:65:ab:4d Iaid: IPaddr:192.168.61.51 Prefix:24 Hostname:old-k8s-version-432422 Clientid:01:52:54:00:65:ab:4d}
I0910 18:50:06.318827 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has defined IP address 192.168.61.51 and MAC address 52:54:00:65:ab:4d in network mk-old-k8s-version-432422
I0910 18:50:06.319174 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .DriverName
I0910 18:50:06.319774 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .DriverName
I0910 18:50:06.319947 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .DriverName
I0910 18:50:06.320043 64489 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0910 18:50:06.320086 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetSSHHostname
I0910 18:50:06.320196 64489 ssh_runner.go:195] Run: cat /version.json
I0910 18:50:06.320224 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetSSHHostname
I0910 18:50:06.323422 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has defined MAC address 52:54:00:65:ab:4d in network mk-old-k8s-version-432422
I0910 18:50:06.323611 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has defined MAC address 52:54:00:65:ab:4d in network mk-old-k8s-version-432422
I0910 18:50:06.323785 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:65:ab:4d", ip: ""} in network mk-old-k8s-version-432422: {Iface:virbr2 ExpiryTime:2024-09-10 19:49:56 +0000 UTC Type:0 Mac:52:54:00:65:ab:4d Iaid: IPaddr:192.168.61.51 Prefix:24 Hostname:old-k8s-version-432422 Clientid:01:52:54:00:65:ab:4d}
I0910 18:50:06.323805 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has defined IP address 192.168.61.51 and MAC address 52:54:00:65:ab:4d in network mk-old-k8s-version-432422
I0910 18:50:06.323933 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:65:ab:4d", ip: ""} in network mk-old-k8s-version-432422: {Iface:virbr2 ExpiryTime:2024-09-10 19:49:56 +0000 UTC Type:0 Mac:52:54:00:65:ab:4d Iaid: IPaddr:192.168.61.51 Prefix:24 Hostname:old-k8s-version-432422 Clientid:01:52:54:00:65:ab:4d}
I0910 18:50:06.323949 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has defined IP address 192.168.61.51 and MAC address 52:54:00:65:ab:4d in network mk-old-k8s-version-432422
I0910 18:50:06.324120 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetSSHPort
I0910 18:50:06.324317 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetSSHKeyPath
I0910 18:50:06.324512 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetSSHUsername
I0910 18:50:06.324531 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetSSHPort
I0910 18:50:06.324714 64489 sshutil.go:53] new ssh client: &{IP:192.168.61.51 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19598-5973/.minikube/machines/old-k8s-version-432422/id_rsa Username:docker}
I0910 18:50:06.324781 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetSSHKeyPath
I0910 18:50:06.324989 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetSSHUsername
I0910 18:50:06.325198 64489 sshutil.go:53] new ssh client: &{IP:192.168.61.51 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19598-5973/.minikube/machines/old-k8s-version-432422/id_rsa Username:docker}
I0910 18:50:06.410557 64489 ssh_runner.go:195] Run: systemctl --version
I0910 18:50:06.438751 64489 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0910 18:50:06.599493 64489 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0910 18:50:06.606214 64489 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0910 18:50:06.606275 64489 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0910 18:50:06.624156 64489 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0910 18:50:06.624196 64489 start.go:495] detecting cgroup driver to use...
I0910 18:50:06.624271 64489 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0910 18:50:06.640542 64489 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0910 18:50:06.657630 64489 docker.go:217] disabling cri-docker service (if available) ...
I0910 18:50:06.657693 64489 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0910 18:50:06.675813 64489 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0910 18:50:06.690465 64489 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0910 18:50:06.837566 64489 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0910 18:50:06.999763 64489 docker.go:233] disabling docker service ...
I0910 18:50:06.999833 64489 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0910 18:50:07.018792 64489 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0910 18:50:07.032520 64489 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0910 18:50:07.180608 64489 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0910 18:50:07.322691 64489 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0910 18:50:07.337063 64489 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0910 18:50:07.358633 64489 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0910 18:50:07.358713 64489 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0910 18:50:07.369660 64489 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0910 18:50:07.369724 64489 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0910 18:50:07.382990 64489 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0910 18:50:07.397925 64489 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0910 18:50:07.409096 64489 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0910 18:50:07.420902 64489 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0910 18:50:07.432116 64489 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0910 18:50:07.432172 64489 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0910 18:50:07.447825 64489 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0910 18:50:07.460651 64489 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0910 18:50:07.616863 64489 ssh_runner.go:195] Run: sudo systemctl restart crio
I0910 18:50:07.730202 64489 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0910 18:50:07.730267 64489 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0910 18:50:07.735672 64489 start.go:563] Will wait 60s for crictl version
I0910 18:50:07.735721 64489 ssh_runner.go:195] Run: which crictl
I0910 18:50:07.740015 64489 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0910 18:50:07.792121 64489 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0910 18:50:07.792217 64489 ssh_runner.go:195] Run: crio --version
I0910 18:50:07.826317 64489 ssh_runner.go:195] Run: crio --version
I0910 18:50:07.860351 64489 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0910 18:50:07.861730 64489 main.go:141] libmachine: (old-k8s-version-432422) Calling .GetIP
I0910 18:50:07.864986 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has defined MAC address 52:54:00:65:ab:4d in network mk-old-k8s-version-432422
I0910 18:50:07.865373 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:65:ab:4d", ip: ""} in network mk-old-k8s-version-432422: {Iface:virbr2 ExpiryTime:2024-09-10 19:49:56 +0000 UTC Type:0 Mac:52:54:00:65:ab:4d Iaid: IPaddr:192.168.61.51 Prefix:24 Hostname:old-k8s-version-432422 Clientid:01:52:54:00:65:ab:4d}
I0910 18:50:07.865404 64489 main.go:141] libmachine: (old-k8s-version-432422) DBG | domain old-k8s-version-432422 has defined IP address 192.168.61.51 and MAC address 52:54:00:65:ab:4d in network mk-old-k8s-version-432422
I0910 18:50:07.865588 64489 ssh_runner.go:195] Run: grep 192.168.61.1 host.minikube.internal$ /etc/hosts
I0910 18:50:07.870163 64489 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.61.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0910 18:50:07.884325 64489 kubeadm.go:883] updating cluster {Name:old-k8s-version-432422 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19598/minikube-v1.34.0-1725912912-19598-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-432422 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.51 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mo
untPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0910 18:50:07.884435 64489 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0910 18:50:07.884491 64489 ssh_runner.go:195] Run: sudo crictl images --output json
I0910 18:50:07.916945 64489 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0910 18:50:07.917011 64489 ssh_runner.go:195] Run: which lz4
I0910 18:50:07.921295 64489 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0910 18:50:07.925963 64489 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0910 18:50:07.925992 64489 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19598-5973/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0910 18:50:09.752118 64489 crio.go:462] duration metric: took 1.830854734s to copy over tarball
I0910 18:50:09.752179 64489 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0910 18:50:12.626425 64489 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.874224337s)
I0910 18:50:12.626451 64489 crio.go:469] duration metric: took 2.874302825s to extract the tarball
I0910 18:50:12.626459 64489 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0910 18:50:12.676203 64489 ssh_runner.go:195] Run: sudo crictl images --output json
I0910 18:50:12.747373 64489 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0910 18:50:12.747398 64489 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0910 18:50:12.747472 64489 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0910 18:50:12.747753 64489 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0910 18:50:12.747776 64489 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0910 18:50:12.747805 64489 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0910 18:50:12.747969 64489 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0910 18:50:12.747752 64489 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0910 18:50:12.748508 64489 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0910 18:50:12.747973 64489 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0910 18:50:12.749819 64489 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0910 18:50:12.751687 64489 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0910 18:50:12.751917 64489 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0910 18:50:12.751979 64489 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0910 18:50:12.752200 64489 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0910 18:50:12.752762 64489 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0910 18:50:12.753292 64489 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0910 18:50:12.754019 64489 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0910 18:50:12.922101 64489 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0910 18:50:12.933663 64489 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0910 18:50:12.936571 64489 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0910 18:50:12.942069 64489 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0910 18:50:12.954897 64489 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0910 18:50:12.981260 64489 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0910 18:50:13.021348 64489 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0910 18:50:13.021402 64489 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0910 18:50:13.021458 64489 ssh_runner.go:195] Run: which crictl
I0910 18:50:13.071365 64489 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0910 18:50:13.111803 64489 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0910 18:50:13.111832 64489 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0910 18:50:13.111852 64489 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0910 18:50:13.111866 64489 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0910 18:50:13.111875 64489 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0910 18:50:13.111893 64489 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0910 18:50:13.111899 64489 ssh_runner.go:195] Run: which crictl
I0910 18:50:13.111912 64489 ssh_runner.go:195] Run: which crictl
I0910 18:50:13.111931 64489 ssh_runner.go:195] Run: which crictl
I0910 18:50:13.150826 64489 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0910 18:50:13.150872 64489 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0910 18:50:13.150920 64489 ssh_runner.go:195] Run: which crictl
I0910 18:50:13.164545 64489 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0910 18:50:13.164587 64489 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0910 18:50:13.164593 64489 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0910 18:50:13.164615 64489 ssh_runner.go:195] Run: which crictl
I0910 18:50:13.164684 64489 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0910 18:50:13.164703 64489 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0910 18:50:13.164752 64489 ssh_runner.go:195] Run: which crictl
I0910 18:50:13.164824 64489 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0910 18:50:13.164890 64489 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0910 18:50:13.164908 64489 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0910 18:50:13.164944 64489 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0910 18:50:13.288692 64489 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0910 18:50:13.288731 64489 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0910 18:50:13.288778 64489 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0910 18:50:13.288800 64489 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0910 18:50:13.288850 64489 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0910 18:50:13.288881 64489 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0910 18:50:13.288920 64489 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0910 18:50:13.457516 64489 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0910 18:50:13.457759 64489 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0910 18:50:13.465329 64489 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0910 18:50:13.465375 64489 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0910 18:50:13.465410 64489 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0910 18:50:13.465444 64489 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0910 18:50:13.465475 64489 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0910 18:50:13.550694 64489 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0910 18:50:13.630881 64489 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19598-5973/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0910 18:50:13.630944 64489 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19598-5973/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0910 18:50:13.652149 64489 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19598-5973/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0910 18:50:13.652210 64489 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19598-5973/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0910 18:50:13.656101 64489 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0910 18:50:13.656218 64489 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0910 18:50:13.656238 64489 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19598-5973/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0910 18:50:13.797850 64489 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19598-5973/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0910 18:50:13.797892 64489 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19598-5973/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0910 18:50:13.797950 64489 cache_images.go:92] duration metric: took 1.050537269s to LoadCachedImages
W0910 18:50:13.798044 64489 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19598-5973/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19598-5973/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0: no such file or directory
I0910 18:50:13.798063 64489 kubeadm.go:934] updating node { 192.168.61.51 8443 v1.20.0 crio true true} ...
I0910 18:50:13.798229 64489 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-432422 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.61.51
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-432422 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0910 18:50:13.798317 64489 ssh_runner.go:195] Run: crio config
I0910 18:50:13.851761 64489 cni.go:84] Creating CNI manager for ""
I0910 18:50:13.851788 64489 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0910 18:50:13.851803 64489 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0910 18:50:13.851829 64489 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.61.51 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-432422 NodeName:old-k8s-version-432422 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.61.51"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.61.51 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Stati
cPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0910 18:50:13.852003 64489 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.61.51
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-432422"
kubeletExtraArgs:
node-ip: 192.168.61.51
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.61.51"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0910 18:50:13.852073 64489 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0910 18:50:13.864416 64489 binaries.go:44] Found k8s binaries, skipping transfer
I0910 18:50:13.864484 64489 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0910 18:50:13.877014 64489 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (429 bytes)
I0910 18:50:13.906631 64489 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0910 18:50:13.928290 64489 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2120 bytes)
I0910 18:50:13.951186 64489 ssh_runner.go:195] Run: grep 192.168.61.51 control-plane.minikube.internal$ /etc/hosts
I0910 18:50:13.956186 64489 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.61.51 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0910 18:50:13.973271 64489 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0910 18:50:14.114329 64489 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0910 18:50:14.133803 64489 certs.go:68] Setting up /home/jenkins/minikube-integration/19598-5973/.minikube/profiles/old-k8s-version-432422 for IP: 192.168.61.51
I0910 18:50:14.133840 64489 certs.go:194] generating shared ca certs ...
I0910 18:50:14.133862 64489 certs.go:226] acquiring lock for ca certs: {Name:mk3f61979cd6c0fb13fdaf4e35ab8dc84995a5cd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0910 18:50:14.134031 64489 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19598-5973/.minikube/ca.key
I0910 18:50:14.134094 64489 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19598-5973/.minikube/proxy-client-ca.key
I0910 18:50:14.134112 64489 certs.go:256] generating profile certs ...
I0910 18:50:14.134178 64489 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19598-5973/.minikube/profiles/old-k8s-version-432422/client.key
I0910 18:50:14.134199 64489 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19598-5973/.minikube/profiles/old-k8s-version-432422/client.crt with IP's: []
I0910 18:50:14.304753 64489 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19598-5973/.minikube/profiles/old-k8s-version-432422/client.crt ...
I0910 18:50:14.304786 64489 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19598-5973/.minikube/profiles/old-k8s-version-432422/client.crt: {Name:mk3e4913688167cd28da912f471a1766948fdce8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0910 18:50:14.304982 64489 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19598-5973/.minikube/profiles/old-k8s-version-432422/client.key ...
I0910 18:50:14.304998 64489 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19598-5973/.minikube/profiles/old-k8s-version-432422/client.key: {Name:mkff0afc833901d49863bd4d1ca2be230bd9196f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0910 18:50:14.305135 64489 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19598-5973/.minikube/profiles/old-k8s-version-432422/apiserver.key.da6b542b
I0910 18:50:14.305160 64489 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19598-5973/.minikube/profiles/old-k8s-version-432422/apiserver.crt.da6b542b with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.61.51]
I0910 18:50:14.363110 64489 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19598-5973/.minikube/profiles/old-k8s-version-432422/apiserver.crt.da6b542b ...
I0910 18:50:14.363143 64489 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19598-5973/.minikube/profiles/old-k8s-version-432422/apiserver.crt.da6b542b: {Name:mkdcb269dd3b3decf2eb01d21cf040c9fd7709eb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0910 18:50:14.363341 64489 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19598-5973/.minikube/profiles/old-k8s-version-432422/apiserver.key.da6b542b ...
I0910 18:50:14.363366 64489 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19598-5973/.minikube/profiles/old-k8s-version-432422/apiserver.key.da6b542b: {Name:mk4d2290ff03b491d48302797d5584bf8b2b4c8f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0910 18:50:14.363469 64489 certs.go:381] copying /home/jenkins/minikube-integration/19598-5973/.minikube/profiles/old-k8s-version-432422/apiserver.crt.da6b542b -> /home/jenkins/minikube-integration/19598-5973/.minikube/profiles/old-k8s-version-432422/apiserver.crt
I0910 18:50:14.363586 64489 certs.go:385] copying /home/jenkins/minikube-integration/19598-5973/.minikube/profiles/old-k8s-version-432422/apiserver.key.da6b542b -> /home/jenkins/minikube-integration/19598-5973/.minikube/profiles/old-k8s-version-432422/apiserver.key
I0910 18:50:14.363686 64489 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19598-5973/.minikube/profiles/old-k8s-version-432422/proxy-client.key
I0910 18:50:14.363708 64489 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19598-5973/.minikube/profiles/old-k8s-version-432422/proxy-client.crt with IP's: []
I0910 18:50:14.554209 64489 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19598-5973/.minikube/profiles/old-k8s-version-432422/proxy-client.crt ...
I0910 18:50:14.554241 64489 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19598-5973/.minikube/profiles/old-k8s-version-432422/proxy-client.crt: {Name:mk05e0c2d078a4b2f4821797984dbc9a4c835c31 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0910 18:50:14.554417 64489 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19598-5973/.minikube/profiles/old-k8s-version-432422/proxy-client.key ...
I0910 18:50:14.554430 64489 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19598-5973/.minikube/profiles/old-k8s-version-432422/proxy-client.key: {Name:mk0fcad8b722b9171181895f35f024b7eb5b664b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0910 18:50:14.554665 64489 certs.go:484] found cert: /home/jenkins/minikube-integration/19598-5973/.minikube/certs/13121.pem (1338 bytes)
W0910 18:50:14.554712 64489 certs.go:480] ignoring /home/jenkins/minikube-integration/19598-5973/.minikube/certs/13121_empty.pem, impossibly tiny 0 bytes
I0910 18:50:14.554726 64489 certs.go:484] found cert: /home/jenkins/minikube-integration/19598-5973/.minikube/certs/ca-key.pem (1679 bytes)
I0910 18:50:14.554756 64489 certs.go:484] found cert: /home/jenkins/minikube-integration/19598-5973/.minikube/certs/ca.pem (1082 bytes)
I0910 18:50:14.554788 64489 certs.go:484] found cert: /home/jenkins/minikube-integration/19598-5973/.minikube/certs/cert.pem (1123 bytes)
I0910 18:50:14.554817 64489 certs.go:484] found cert: /home/jenkins/minikube-integration/19598-5973/.minikube/certs/key.pem (1675 bytes)
I0910 18:50:14.554870 64489 certs.go:484] found cert: /home/jenkins/minikube-integration/19598-5973/.minikube/files/etc/ssl/certs/131212.pem (1708 bytes)
I0910 18:50:14.555687 64489 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19598-5973/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0910 18:50:14.591803 64489 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19598-5973/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0910 18:50:14.627561 64489 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19598-5973/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0910 18:50:14.663807 64489 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19598-5973/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0910 18:50:14.696441 64489 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19598-5973/.minikube/profiles/old-k8s-version-432422/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0910 18:50:14.726578 64489 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19598-5973/.minikube/profiles/old-k8s-version-432422/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0910 18:50:14.754693 64489 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19598-5973/.minikube/profiles/old-k8s-version-432422/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0910 18:50:14.779347 64489 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19598-5973/.minikube/profiles/old-k8s-version-432422/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0910 18:50:14.812455 64489 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19598-5973/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0910 18:50:14.845468 64489 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19598-5973/.minikube/certs/13121.pem --> /usr/share/ca-certificates/13121.pem (1338 bytes)
I0910 18:50:14.874225 64489 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19598-5973/.minikube/files/etc/ssl/certs/131212.pem --> /usr/share/ca-certificates/131212.pem (1708 bytes)
I0910 18:50:14.901860 64489 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0910 18:50:14.923324 64489 ssh_runner.go:195] Run: openssl version
I0910 18:50:14.929624 64489 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0910 18:50:14.942160 64489 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0910 18:50:14.946961 64489 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 10 17:29 /usr/share/ca-certificates/minikubeCA.pem
I0910 18:50:14.947002 64489 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0910 18:50:14.953416 64489 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0910 18:50:14.965068 64489 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/13121.pem && ln -fs /usr/share/ca-certificates/13121.pem /etc/ssl/certs/13121.pem"
I0910 18:50:14.977765 64489 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/13121.pem
I0910 18:50:14.984511 64489 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 10 17:46 /usr/share/ca-certificates/13121.pem
I0910 18:50:14.984585 64489 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/13121.pem
I0910 18:50:14.992954 64489 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/13121.pem /etc/ssl/certs/51391683.0"
I0910 18:50:15.013247 64489 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/131212.pem && ln -fs /usr/share/ca-certificates/131212.pem /etc/ssl/certs/131212.pem"
I0910 18:50:15.044912 64489 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/131212.pem
I0910 18:50:15.050032 64489 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 10 17:46 /usr/share/ca-certificates/131212.pem
I0910 18:50:15.050094 64489 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/131212.pem
I0910 18:50:15.059512 64489 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/131212.pem /etc/ssl/certs/3ec20f2e.0"
I0910 18:50:15.074995 64489 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0910 18:50:15.080521 64489 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0910 18:50:15.080590 64489 kubeadm.go:392] StartCluster: {Name:old-k8s-version-432422 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19598/minikube-v1.34.0-1725912912-19598-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-432422 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.51 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0910 18:50:15.080682 64489 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0910 18:50:15.080760 64489 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0910 18:50:15.138009 64489 cri.go:89] found id: ""
I0910 18:50:15.138080 64489 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0910 18:50:15.152824 64489 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0910 18:50:15.168278 64489 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0910 18:50:15.178709 64489 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0910 18:50:15.178731 64489 kubeadm.go:157] found existing configuration files:
I0910 18:50:15.178779 64489 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0910 18:50:15.194020 64489 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0910 18:50:15.194080 64489 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0910 18:50:15.214053 64489 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0910 18:50:15.227437 64489 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0910 18:50:15.227497 64489 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0910 18:50:15.239500 64489 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0910 18:50:15.250289 64489 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0910 18:50:15.250356 64489 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0910 18:50:15.260757 64489 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0910 18:50:15.271953 64489 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0910 18:50:15.272017 64489 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0910 18:50:15.283690 64489 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0910 18:50:15.403132 64489 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0910 18:50:15.403276 64489 kubeadm.go:310] [preflight] Running pre-flight checks
I0910 18:50:15.581168 64489 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0910 18:50:15.581350 64489 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0910 18:50:15.581539 64489 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0910 18:50:15.820390 64489 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0910 18:50:15.890391 64489 out.go:235] - Generating certificates and keys ...
I0910 18:50:15.890495 64489 kubeadm.go:310] [certs] Using existing ca certificate authority
I0910 18:50:15.890606 64489 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0910 18:50:16.074414 64489 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0910 18:50:16.489438 64489 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0910 18:50:16.544069 64489 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0910 18:50:16.632006 64489 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0910 18:50:16.734079 64489 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0910 18:50:16.734480 64489 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-432422] and IPs [192.168.61.51 127.0.0.1 ::1]
I0910 18:50:17.071311 64489 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0910 18:50:17.071749 64489 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-432422] and IPs [192.168.61.51 127.0.0.1 ::1]
I0910 18:50:17.134351 64489 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0910 18:50:17.556579 64489 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0910 18:50:18.027747 64489 kubeadm.go:310] [certs] Generating "sa" key and public key
I0910 18:50:18.027984 64489 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0910 18:50:18.116674 64489 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0910 18:50:18.289370 64489 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0910 18:50:18.452069 64489 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0910 18:50:18.542363 64489 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0910 18:50:18.564061 64489 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0910 18:50:18.567445 64489 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0910 18:50:18.567511 64489 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0910 18:50:18.709671 64489 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0910 18:50:18.711471 64489 out.go:235] - Booting up control plane ...
I0910 18:50:18.711609 64489 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0910 18:50:18.716283 64489 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0910 18:50:18.718021 64489 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0910 18:50:18.718879 64489 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0910 18:50:18.723505 64489 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0910 18:50:58.678053 64489 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0910 18:50:58.680398 64489 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0910 18:50:58.680640 64489 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0910 18:51:03.679528 64489 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0910 18:51:03.679776 64489 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0910 18:51:13.679240 64489 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0910 18:51:13.679540 64489 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0910 18:51:33.680043 64489 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0910 18:51:33.680324 64489 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0910 18:52:13.682135 64489 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0910 18:52:13.682680 64489 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0910 18:52:13.682705 64489 kubeadm.go:310]
I0910 18:52:13.682815 64489 kubeadm.go:310] Unfortunately, an error has occurred:
I0910 18:52:13.682915 64489 kubeadm.go:310] timed out waiting for the condition
I0910 18:52:13.682929 64489 kubeadm.go:310]
I0910 18:52:13.683018 64489 kubeadm.go:310] This error is likely caused by:
I0910 18:52:13.683092 64489 kubeadm.go:310] - The kubelet is not running
I0910 18:52:13.683357 64489 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0910 18:52:13.683390 64489 kubeadm.go:310]
I0910 18:52:13.683592 64489 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0910 18:52:13.683679 64489 kubeadm.go:310] - 'systemctl status kubelet'
I0910 18:52:13.683769 64489 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0910 18:52:13.683782 64489 kubeadm.go:310]
I0910 18:52:13.684038 64489 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0910 18:52:13.684237 64489 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0910 18:52:13.684256 64489 kubeadm.go:310]
I0910 18:52:13.684514 64489 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0910 18:52:13.684769 64489 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0910 18:52:13.684914 64489 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0910 18:52:13.685126 64489 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0910 18:52:13.685167 64489 kubeadm.go:310]
I0910 18:52:13.685512 64489 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0910 18:52:13.685965 64489 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0910 18:52:13.686093 64489 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
W0910 18:52:13.686171 64489 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-432422] and IPs [192.168.61.51 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-432422] and IPs [192.168.61.51 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-432422] and IPs [192.168.61.51 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-432422] and IPs [192.168.61.51 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0910 18:52:13.686219 64489 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0910 18:52:15.158995 64489 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (1.472746649s)
I0910 18:52:15.159081 64489 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0910 18:52:15.173131 64489 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0910 18:52:15.182600 64489 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0910 18:52:15.182615 64489 kubeadm.go:157] found existing configuration files:
I0910 18:52:15.182651 64489 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0910 18:52:15.191725 64489 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0910 18:52:15.191771 64489 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0910 18:52:15.200752 64489 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0910 18:52:15.209239 64489 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0910 18:52:15.209289 64489 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0910 18:52:15.218089 64489 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0910 18:52:15.226653 64489 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0910 18:52:15.226695 64489 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0910 18:52:15.235566 64489 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0910 18:52:15.244397 64489 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0910 18:52:15.244441 64489 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0910 18:52:15.253392 64489 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0910 18:52:15.451011 64489 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0910 18:54:12.056601 64489 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0910 18:54:12.056703 64489 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0910 18:54:12.058152 64489 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0910 18:54:12.058209 64489 kubeadm.go:310] [preflight] Running pre-flight checks
I0910 18:54:12.058279 64489 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0910 18:54:12.058406 64489 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0910 18:54:12.058544 64489 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0910 18:54:12.058639 64489 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0910 18:54:12.060360 64489 out.go:235] - Generating certificates and keys ...
I0910 18:54:12.060443 64489 kubeadm.go:310] [certs] Using existing ca certificate authority
I0910 18:54:12.060508 64489 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0910 18:54:12.060600 64489 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0910 18:54:12.060671 64489 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0910 18:54:12.060758 64489 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0910 18:54:12.060832 64489 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0910 18:54:12.060916 64489 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0910 18:54:12.060988 64489 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0910 18:54:12.061057 64489 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0910 18:54:12.061149 64489 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0910 18:54:12.061184 64489 kubeadm.go:310] [certs] Using the existing "sa" key
I0910 18:54:12.061228 64489 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0910 18:54:12.061272 64489 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0910 18:54:12.061318 64489 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0910 18:54:12.061366 64489 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0910 18:54:12.061410 64489 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0910 18:54:12.061500 64489 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0910 18:54:12.061623 64489 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0910 18:54:12.061674 64489 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0910 18:54:12.061759 64489 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0910 18:54:12.063675 64489 out.go:235] - Booting up control plane ...
I0910 18:54:12.063764 64489 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0910 18:54:12.063833 64489 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0910 18:54:12.063890 64489 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0910 18:54:12.063967 64489 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0910 18:54:12.064107 64489 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0910 18:54:12.064149 64489 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0910 18:54:12.064207 64489 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0910 18:54:12.064382 64489 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0910 18:54:12.064448 64489 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0910 18:54:12.064603 64489 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0910 18:54:12.064662 64489 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0910 18:54:12.064826 64489 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0910 18:54:12.064887 64489 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0910 18:54:12.065051 64489 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0910 18:54:12.065134 64489 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0910 18:54:12.065293 64489 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0910 18:54:12.065300 64489 kubeadm.go:310]
I0910 18:54:12.065339 64489 kubeadm.go:310] Unfortunately, an error has occurred:
I0910 18:54:12.065371 64489 kubeadm.go:310] timed out waiting for the condition
I0910 18:54:12.065377 64489 kubeadm.go:310]
I0910 18:54:12.065412 64489 kubeadm.go:310] This error is likely caused by:
I0910 18:54:12.065439 64489 kubeadm.go:310] - The kubelet is not running
I0910 18:54:12.065522 64489 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0910 18:54:12.065529 64489 kubeadm.go:310]
I0910 18:54:12.065607 64489 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0910 18:54:12.065634 64489 kubeadm.go:310] - 'systemctl status kubelet'
I0910 18:54:12.065665 64489 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0910 18:54:12.065671 64489 kubeadm.go:310]
I0910 18:54:12.065752 64489 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0910 18:54:12.065818 64489 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0910 18:54:12.065824 64489 kubeadm.go:310]
I0910 18:54:12.065915 64489 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0910 18:54:12.066002 64489 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0910 18:54:12.066072 64489 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0910 18:54:12.066132 64489 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0910 18:54:12.066148 64489 kubeadm.go:310]
I0910 18:54:12.066190 64489 kubeadm.go:394] duration metric: took 3m56.985607608s to StartCluster
I0910 18:54:12.066239 64489 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0910 18:54:12.066289 64489 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0910 18:54:12.124665 64489 cri.go:89] found id: ""
I0910 18:54:12.124690 64489 logs.go:276] 0 containers: []
W0910 18:54:12.124702 64489 logs.go:278] No container was found matching "kube-apiserver"
I0910 18:54:12.124709 64489 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0910 18:54:12.124756 64489 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0910 18:54:12.162247 64489 cri.go:89] found id: ""
I0910 18:54:12.162276 64489 logs.go:276] 0 containers: []
W0910 18:54:12.162286 64489 logs.go:278] No container was found matching "etcd"
I0910 18:54:12.162293 64489 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0910 18:54:12.162362 64489 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0910 18:54:12.211296 64489 cri.go:89] found id: ""
I0910 18:54:12.211323 64489 logs.go:276] 0 containers: []
W0910 18:54:12.211333 64489 logs.go:278] No container was found matching "coredns"
I0910 18:54:12.211340 64489 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0910 18:54:12.211387 64489 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0910 18:54:12.248872 64489 cri.go:89] found id: ""
I0910 18:54:12.248895 64489 logs.go:276] 0 containers: []
W0910 18:54:12.248905 64489 logs.go:278] No container was found matching "kube-scheduler"
I0910 18:54:12.248915 64489 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0910 18:54:12.248971 64489 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0910 18:54:12.287331 64489 cri.go:89] found id: ""
I0910 18:54:12.287356 64489 logs.go:276] 0 containers: []
W0910 18:54:12.287367 64489 logs.go:278] No container was found matching "kube-proxy"
I0910 18:54:12.287375 64489 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0910 18:54:12.287428 64489 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0910 18:54:12.322251 64489 cri.go:89] found id: ""
I0910 18:54:12.322280 64489 logs.go:276] 0 containers: []
W0910 18:54:12.322289 64489 logs.go:278] No container was found matching "kube-controller-manager"
I0910 18:54:12.322295 64489 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0910 18:54:12.322342 64489 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0910 18:54:12.357012 64489 cri.go:89] found id: ""
I0910 18:54:12.357037 64489 logs.go:276] 0 containers: []
W0910 18:54:12.357047 64489 logs.go:278] No container was found matching "kindnet"
I0910 18:54:12.357065 64489 logs.go:123] Gathering logs for CRI-O ...
I0910 18:54:12.357093 64489 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0910 18:54:12.462825 64489 logs.go:123] Gathering logs for container status ...
I0910 18:54:12.462859 64489 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0910 18:54:12.501083 64489 logs.go:123] Gathering logs for kubelet ...
I0910 18:54:12.501108 64489 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0910 18:54:12.548434 64489 logs.go:123] Gathering logs for dmesg ...
I0910 18:54:12.548462 64489 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0910 18:54:12.561900 64489 logs.go:123] Gathering logs for describe nodes ...
I0910 18:54:12.561927 64489 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0910 18:54:12.666143 64489 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
W0910 18:54:12.666166 64489 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0910 18:54:12.666210 64489 out.go:270] *
*
W0910 18:54:12.666267 64489 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0910 18:54:12.666285 64489 out.go:270] *
*
W0910 18:54:12.667133 64489 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0910 18:54:12.669767 64489 out.go:201]
W0910 18:54:12.670752 64489 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0910 18:54:12.670800 64489 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0910 18:54:12.670828 64489 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0910 18:54:12.672677 64489 out.go:201]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-432422 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-432422 -n old-k8s-version-432422
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-432422 -n old-k8s-version-432422: exit status 6 (219.53042ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0910 18:54:12.932218 71225 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-432422" does not appear in /home/jenkins/minikube-integration/19598-5973/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-432422" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (300.40s)