=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-190698 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-190698 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m59.520765796s)
-- stdout --
* [old-k8s-version-190698] minikube v1.34.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=19662
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19662-11085/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19662-11085/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-190698" primary control-plane node in "old-k8s-version-190698" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0917 18:17:24.511656 70593 out.go:345] Setting OutFile to fd 1 ...
I0917 18:17:24.511811 70593 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0917 18:17:24.511823 70593 out.go:358] Setting ErrFile to fd 2...
I0917 18:17:24.511833 70593 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0917 18:17:24.512010 70593 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19662-11085/.minikube/bin
I0917 18:17:24.512576 70593 out.go:352] Setting JSON to false
I0917 18:17:24.513569 70593 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-13","uptime":7159,"bootTime":1726589885,"procs":245,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1069-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0917 18:17:24.513656 70593 start.go:139] virtualization: kvm guest
I0917 18:17:24.515895 70593 out.go:177] * [old-k8s-version-190698] minikube v1.34.0 on Ubuntu 20.04 (kvm/amd64)
I0917 18:17:24.518210 70593 out.go:177] - MINIKUBE_LOCATION=19662
I0917 18:17:24.518219 70593 notify.go:220] Checking for updates...
I0917 18:17:24.519924 70593 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0917 18:17:24.521263 70593 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19662-11085/kubeconfig
I0917 18:17:24.522755 70593 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19662-11085/.minikube
I0917 18:17:24.524361 70593 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0917 18:17:24.527432 70593 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0917 18:17:24.529301 70593 config.go:182] Loaded profile config "bridge-639892": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1
I0917 18:17:24.529406 70593 config.go:182] Loaded profile config "enable-default-cni-639892": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1
I0917 18:17:24.529500 70593 config.go:182] Loaded profile config "flannel-639892": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1
I0917 18:17:24.529589 70593 driver.go:394] Setting default libvirt URI to qemu:///system
I0917 18:17:24.569953 70593 out.go:177] * Using the kvm2 driver based on user configuration
I0917 18:17:24.571377 70593 start.go:297] selected driver: kvm2
I0917 18:17:24.571393 70593 start.go:901] validating driver "kvm2" against <nil>
I0917 18:17:24.571404 70593 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0917 18:17:24.572222 70593 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0917 18:17:24.572305 70593 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19662-11085/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0917 18:17:24.590718 70593 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.34.0
I0917 18:17:24.590771 70593 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0917 18:17:24.591051 70593 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0917 18:17:24.591089 70593 cni.go:84] Creating CNI manager for ""
I0917 18:17:24.591145 70593 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0917 18:17:24.591214 70593 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0917 18:17:24.591331 70593 start.go:340] cluster config:
{Name:old-k8s-version-190698 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726589491-19662@sha256:6370b9fec173944088c2d87d44b01819c0ec611a83d9e2f38d36352dff8121a4 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-190698 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0917 18:17:24.591507 70593 iso.go:125] acquiring lock: {Name:mkee7131e09b1c5eb94d106bda884bcbdbf6f906 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0917 18:17:24.593492 70593 out.go:177] * Starting "old-k8s-version-190698" primary control-plane node in "old-k8s-version-190698" cluster
I0917 18:17:24.594829 70593 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0917 18:17:24.594876 70593 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19662-11085/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0917 18:17:24.594896 70593 cache.go:56] Caching tarball of preloaded images
I0917 18:17:24.594987 70593 preload.go:172] Found /home/jenkins/minikube-integration/19662-11085/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0917 18:17:24.595001 70593 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0917 18:17:24.595126 70593 profile.go:143] Saving config to /home/jenkins/minikube-integration/19662-11085/.minikube/profiles/old-k8s-version-190698/config.json ...
I0917 18:17:24.595147 70593 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19662-11085/.minikube/profiles/old-k8s-version-190698/config.json: {Name:mkb4215e2edc045dbb5befb53a79bf398f5477ab Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0917 18:17:24.595306 70593 start.go:360] acquireMachinesLock for old-k8s-version-190698: {Name:mk6402dbe89020208df2680dbd7b5623a7cfa6f0 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0917 18:17:50.754692 70593 start.go:364] duration metric: took 26.159340611s to acquireMachinesLock for "old-k8s-version-190698"
I0917 18:17:50.754763 70593 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-190698 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19649/minikube-v1.34.0-1726481713-19649-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726589491-19662@sha256:6370b9fec173944088c2d87d44b01819c0ec611a83d9e2f38d36352dff8121a4 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-190698 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0917 18:17:50.754902 70593 start.go:125] createHost starting for "" (driver="kvm2")
I0917 18:17:50.756765 70593 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0917 18:17:50.756963 70593 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0917 18:17:50.757012 70593 main.go:141] libmachine: Launching plugin server for driver kvm2
I0917 18:17:50.778524 70593 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35401
I0917 18:17:50.778997 70593 main.go:141] libmachine: () Calling .GetVersion
I0917 18:17:50.779559 70593 main.go:141] libmachine: Using API Version 1
I0917 18:17:50.779585 70593 main.go:141] libmachine: () Calling .SetConfigRaw
I0917 18:17:50.779997 70593 main.go:141] libmachine: () Calling .GetMachineName
I0917 18:17:50.780168 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetMachineName
I0917 18:17:50.780304 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .DriverName
I0917 18:17:50.780532 70593 start.go:159] libmachine.API.Create for "old-k8s-version-190698" (driver="kvm2")
I0917 18:17:50.780575 70593 client.go:168] LocalClient.Create starting
I0917 18:17:50.780613 70593 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19662-11085/.minikube/certs/ca.pem
I0917 18:17:50.780656 70593 main.go:141] libmachine: Decoding PEM data...
I0917 18:17:50.780676 70593 main.go:141] libmachine: Parsing certificate...
I0917 18:17:50.780747 70593 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19662-11085/.minikube/certs/cert.pem
I0917 18:17:50.780771 70593 main.go:141] libmachine: Decoding PEM data...
I0917 18:17:50.780784 70593 main.go:141] libmachine: Parsing certificate...
I0917 18:17:50.780814 70593 main.go:141] libmachine: Running pre-create checks...
I0917 18:17:50.780850 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .PreCreateCheck
I0917 18:17:50.781213 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetConfigRaw
I0917 18:17:50.781704 70593 main.go:141] libmachine: Creating machine...
I0917 18:17:50.781724 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .Create
I0917 18:17:50.781865 70593 main.go:141] libmachine: (old-k8s-version-190698) Creating KVM machine...
I0917 18:17:50.783336 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | found existing default KVM network
I0917 18:17:50.784834 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | I0917 18:17:50.784634 71564 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:17:b5:b2} reservation:<nil>}
I0917 18:17:50.785704 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | I0917 18:17:50.785603 71564 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:f0:64:09} reservation:<nil>}
I0917 18:17:50.786918 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | I0917 18:17:50.786837 71564 network.go:206] using free private subnet 192.168.61.0/24: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00027cd50}
I0917 18:17:50.786977 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | created network xml:
I0917 18:17:50.787003 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | <network>
I0917 18:17:50.787031 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | <name>mk-old-k8s-version-190698</name>
I0917 18:17:50.787070 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | <dns enable='no'/>
I0917 18:17:50.787082 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG |
I0917 18:17:50.787091 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | <ip address='192.168.61.1' netmask='255.255.255.0'>
I0917 18:17:50.787100 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | <dhcp>
I0917 18:17:50.787112 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | <range start='192.168.61.2' end='192.168.61.253'/>
I0917 18:17:50.787123 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | </dhcp>
I0917 18:17:50.787143 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | </ip>
I0917 18:17:50.787154 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG |
I0917 18:17:50.787163 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | </network>
I0917 18:17:50.787185 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG |
I0917 18:17:50.792643 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | trying to create private KVM network mk-old-k8s-version-190698 192.168.61.0/24...
I0917 18:17:50.879512 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | private KVM network mk-old-k8s-version-190698 192.168.61.0/24 created
I0917 18:17:50.879570 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | I0917 18:17:50.879474 71564 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19662-11085/.minikube
I0917 18:17:50.879602 70593 main.go:141] libmachine: (old-k8s-version-190698) Setting up store path in /home/jenkins/minikube-integration/19662-11085/.minikube/machines/old-k8s-version-190698 ...
I0917 18:17:50.879629 70593 main.go:141] libmachine: (old-k8s-version-190698) Building disk image from file:///home/jenkins/minikube-integration/19662-11085/.minikube/cache/iso/amd64/minikube-v1.34.0-1726481713-19649-amd64.iso
I0917 18:17:50.879648 70593 main.go:141] libmachine: (old-k8s-version-190698) Downloading /home/jenkins/minikube-integration/19662-11085/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19662-11085/.minikube/cache/iso/amd64/minikube-v1.34.0-1726481713-19649-amd64.iso...
I0917 18:17:51.144366 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | I0917 18:17:51.144188 71564 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19662-11085/.minikube/machines/old-k8s-version-190698/id_rsa...
I0917 18:17:51.500499 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | I0917 18:17:51.500363 71564 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19662-11085/.minikube/machines/old-k8s-version-190698/old-k8s-version-190698.rawdisk...
I0917 18:17:51.500532 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | Writing magic tar header
I0917 18:17:51.500545 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | Writing SSH key tar header
I0917 18:17:51.500553 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | I0917 18:17:51.500473 71564 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19662-11085/.minikube/machines/old-k8s-version-190698 ...
I0917 18:17:51.500604 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19662-11085/.minikube/machines/old-k8s-version-190698
I0917 18:17:51.500653 70593 main.go:141] libmachine: (old-k8s-version-190698) Setting executable bit set on /home/jenkins/minikube-integration/19662-11085/.minikube/machines/old-k8s-version-190698 (perms=drwx------)
I0917 18:17:51.500667 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19662-11085/.minikube/machines
I0917 18:17:51.500687 70593 main.go:141] libmachine: (old-k8s-version-190698) Setting executable bit set on /home/jenkins/minikube-integration/19662-11085/.minikube/machines (perms=drwxr-xr-x)
I0917 18:17:51.500721 70593 main.go:141] libmachine: (old-k8s-version-190698) Setting executable bit set on /home/jenkins/minikube-integration/19662-11085/.minikube (perms=drwxr-xr-x)
I0917 18:17:51.500734 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19662-11085/.minikube
I0917 18:17:51.500854 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19662-11085
I0917 18:17:51.500883 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0917 18:17:51.500894 70593 main.go:141] libmachine: (old-k8s-version-190698) Setting executable bit set on /home/jenkins/minikube-integration/19662-11085 (perms=drwxrwxr-x)
I0917 18:17:51.500906 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | Checking permissions on dir: /home/jenkins
I0917 18:17:51.500919 70593 main.go:141] libmachine: (old-k8s-version-190698) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0917 18:17:51.500931 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | Checking permissions on dir: /home
I0917 18:17:51.500953 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | Skipping /home - not owner
I0917 18:17:51.500969 70593 main.go:141] libmachine: (old-k8s-version-190698) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0917 18:17:51.500980 70593 main.go:141] libmachine: (old-k8s-version-190698) Creating domain...
I0917 18:17:51.502170 70593 main.go:141] libmachine: (old-k8s-version-190698) define libvirt domain using xml:
I0917 18:17:51.502194 70593 main.go:141] libmachine: (old-k8s-version-190698) <domain type='kvm'>
I0917 18:17:51.502223 70593 main.go:141] libmachine: (old-k8s-version-190698) <name>old-k8s-version-190698</name>
I0917 18:17:51.502241 70593 main.go:141] libmachine: (old-k8s-version-190698) <memory unit='MiB'>2200</memory>
I0917 18:17:51.502253 70593 main.go:141] libmachine: (old-k8s-version-190698) <vcpu>2</vcpu>
I0917 18:17:51.502262 70593 main.go:141] libmachine: (old-k8s-version-190698) <features>
I0917 18:17:51.502269 70593 main.go:141] libmachine: (old-k8s-version-190698) <acpi/>
I0917 18:17:51.502279 70593 main.go:141] libmachine: (old-k8s-version-190698) <apic/>
I0917 18:17:51.502286 70593 main.go:141] libmachine: (old-k8s-version-190698) <pae/>
I0917 18:17:51.502294 70593 main.go:141] libmachine: (old-k8s-version-190698)
I0917 18:17:51.502301 70593 main.go:141] libmachine: (old-k8s-version-190698) </features>
I0917 18:17:51.502310 70593 main.go:141] libmachine: (old-k8s-version-190698) <cpu mode='host-passthrough'>
I0917 18:17:51.502316 70593 main.go:141] libmachine: (old-k8s-version-190698)
I0917 18:17:51.502321 70593 main.go:141] libmachine: (old-k8s-version-190698) </cpu>
I0917 18:17:51.502329 70593 main.go:141] libmachine: (old-k8s-version-190698) <os>
I0917 18:17:51.502343 70593 main.go:141] libmachine: (old-k8s-version-190698) <type>hvm</type>
I0917 18:17:51.502354 70593 main.go:141] libmachine: (old-k8s-version-190698) <boot dev='cdrom'/>
I0917 18:17:51.502360 70593 main.go:141] libmachine: (old-k8s-version-190698) <boot dev='hd'/>
I0917 18:17:51.502368 70593 main.go:141] libmachine: (old-k8s-version-190698) <bootmenu enable='no'/>
I0917 18:17:51.502375 70593 main.go:141] libmachine: (old-k8s-version-190698) </os>
I0917 18:17:51.502384 70593 main.go:141] libmachine: (old-k8s-version-190698) <devices>
I0917 18:17:51.502395 70593 main.go:141] libmachine: (old-k8s-version-190698) <disk type='file' device='cdrom'>
I0917 18:17:51.502442 70593 main.go:141] libmachine: (old-k8s-version-190698) <source file='/home/jenkins/minikube-integration/19662-11085/.minikube/machines/old-k8s-version-190698/boot2docker.iso'/>
I0917 18:17:51.502478 70593 main.go:141] libmachine: (old-k8s-version-190698) <target dev='hdc' bus='scsi'/>
I0917 18:17:51.502511 70593 main.go:141] libmachine: (old-k8s-version-190698) <readonly/>
I0917 18:17:51.502535 70593 main.go:141] libmachine: (old-k8s-version-190698) </disk>
I0917 18:17:51.502549 70593 main.go:141] libmachine: (old-k8s-version-190698) <disk type='file' device='disk'>
I0917 18:17:51.502565 70593 main.go:141] libmachine: (old-k8s-version-190698) <driver name='qemu' type='raw' cache='default' io='threads' />
I0917 18:17:51.502582 70593 main.go:141] libmachine: (old-k8s-version-190698) <source file='/home/jenkins/minikube-integration/19662-11085/.minikube/machines/old-k8s-version-190698/old-k8s-version-190698.rawdisk'/>
I0917 18:17:51.502593 70593 main.go:141] libmachine: (old-k8s-version-190698) <target dev='hda' bus='virtio'/>
I0917 18:17:51.502601 70593 main.go:141] libmachine: (old-k8s-version-190698) </disk>
I0917 18:17:51.502611 70593 main.go:141] libmachine: (old-k8s-version-190698) <interface type='network'>
I0917 18:17:51.502622 70593 main.go:141] libmachine: (old-k8s-version-190698) <source network='mk-old-k8s-version-190698'/>
I0917 18:17:51.502633 70593 main.go:141] libmachine: (old-k8s-version-190698) <model type='virtio'/>
I0917 18:17:51.502646 70593 main.go:141] libmachine: (old-k8s-version-190698) </interface>
I0917 18:17:51.502666 70593 main.go:141] libmachine: (old-k8s-version-190698) <interface type='network'>
I0917 18:17:51.502683 70593 main.go:141] libmachine: (old-k8s-version-190698) <source network='default'/>
I0917 18:17:51.502694 70593 main.go:141] libmachine: (old-k8s-version-190698) <model type='virtio'/>
I0917 18:17:51.502703 70593 main.go:141] libmachine: (old-k8s-version-190698) </interface>
I0917 18:17:51.502712 70593 main.go:141] libmachine: (old-k8s-version-190698) <serial type='pty'>
I0917 18:17:51.502718 70593 main.go:141] libmachine: (old-k8s-version-190698) <target port='0'/>
I0917 18:17:51.502724 70593 main.go:141] libmachine: (old-k8s-version-190698) </serial>
I0917 18:17:51.502729 70593 main.go:141] libmachine: (old-k8s-version-190698) <console type='pty'>
I0917 18:17:51.502740 70593 main.go:141] libmachine: (old-k8s-version-190698) <target type='serial' port='0'/>
I0917 18:17:51.502752 70593 main.go:141] libmachine: (old-k8s-version-190698) </console>
I0917 18:17:51.502761 70593 main.go:141] libmachine: (old-k8s-version-190698) <rng model='virtio'>
I0917 18:17:51.502772 70593 main.go:141] libmachine: (old-k8s-version-190698) <backend model='random'>/dev/random</backend>
I0917 18:17:51.502792 70593 main.go:141] libmachine: (old-k8s-version-190698) </rng>
I0917 18:17:51.502801 70593 main.go:141] libmachine: (old-k8s-version-190698)
I0917 18:17:51.502807 70593 main.go:141] libmachine: (old-k8s-version-190698)
I0917 18:17:51.502834 70593 main.go:141] libmachine: (old-k8s-version-190698) </devices>
I0917 18:17:51.502854 70593 main.go:141] libmachine: (old-k8s-version-190698) </domain>
I0917 18:17:51.502867 70593 main.go:141] libmachine: (old-k8s-version-190698)
I0917 18:17:51.507303 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has defined MAC address 52:54:00:c1:8f:72 in network default
I0917 18:17:51.508073 70593 main.go:141] libmachine: (old-k8s-version-190698) Ensuring networks are active...
I0917 18:17:51.508093 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has defined MAC address 52:54:00:72:8a:43 in network mk-old-k8s-version-190698
I0917 18:17:51.508847 70593 main.go:141] libmachine: (old-k8s-version-190698) Ensuring network default is active
I0917 18:17:51.509205 70593 main.go:141] libmachine: (old-k8s-version-190698) Ensuring network mk-old-k8s-version-190698 is active
I0917 18:17:51.509844 70593 main.go:141] libmachine: (old-k8s-version-190698) Getting domain xml...
I0917 18:17:51.510733 70593 main.go:141] libmachine: (old-k8s-version-190698) Creating domain...
I0917 18:17:53.017457 70593 main.go:141] libmachine: (old-k8s-version-190698) Waiting to get IP...
I0917 18:17:53.018933 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has defined MAC address 52:54:00:72:8a:43 in network mk-old-k8s-version-190698
I0917 18:17:53.019456 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | unable to find current IP address of domain old-k8s-version-190698 in network mk-old-k8s-version-190698
I0917 18:17:53.019486 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | I0917 18:17:53.019433 71564 retry.go:31] will retry after 188.553748ms: waiting for machine to come up
I0917 18:17:53.210246 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has defined MAC address 52:54:00:72:8a:43 in network mk-old-k8s-version-190698
I0917 18:17:53.211119 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | unable to find current IP address of domain old-k8s-version-190698 in network mk-old-k8s-version-190698
I0917 18:17:53.211146 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | I0917 18:17:53.211084 71564 retry.go:31] will retry after 270.443262ms: waiting for machine to come up
I0917 18:17:53.483599 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has defined MAC address 52:54:00:72:8a:43 in network mk-old-k8s-version-190698
I0917 18:17:53.484429 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | unable to find current IP address of domain old-k8s-version-190698 in network mk-old-k8s-version-190698
I0917 18:17:53.484459 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | I0917 18:17:53.484389 71564 retry.go:31] will retry after 326.986895ms: waiting for machine to come up
I0917 18:17:53.813033 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has defined MAC address 52:54:00:72:8a:43 in network mk-old-k8s-version-190698
I0917 18:17:53.813636 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | unable to find current IP address of domain old-k8s-version-190698 in network mk-old-k8s-version-190698
I0917 18:17:53.813663 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | I0917 18:17:53.813552 71564 retry.go:31] will retry after 523.659215ms: waiting for machine to come up
I0917 18:17:54.339575 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has defined MAC address 52:54:00:72:8a:43 in network mk-old-k8s-version-190698
I0917 18:17:54.340063 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | unable to find current IP address of domain old-k8s-version-190698 in network mk-old-k8s-version-190698
I0917 18:17:54.340091 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | I0917 18:17:54.340018 71564 retry.go:31] will retry after 743.56114ms: waiting for machine to come up
I0917 18:17:55.084861 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has defined MAC address 52:54:00:72:8a:43 in network mk-old-k8s-version-190698
I0917 18:17:55.085487 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | unable to find current IP address of domain old-k8s-version-190698 in network mk-old-k8s-version-190698
I0917 18:17:55.085510 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | I0917 18:17:55.085433 71564 retry.go:31] will retry after 675.387131ms: waiting for machine to come up
I0917 18:17:55.763023 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has defined MAC address 52:54:00:72:8a:43 in network mk-old-k8s-version-190698
I0917 18:17:55.763528 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | unable to find current IP address of domain old-k8s-version-190698 in network mk-old-k8s-version-190698
I0917 18:17:55.763550 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | I0917 18:17:55.763462 71564 retry.go:31] will retry after 1.005682325s: waiting for machine to come up
I0917 18:17:56.770961 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has defined MAC address 52:54:00:72:8a:43 in network mk-old-k8s-version-190698
I0917 18:17:56.771505 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | unable to find current IP address of domain old-k8s-version-190698 in network mk-old-k8s-version-190698
I0917 18:17:56.771531 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | I0917 18:17:56.771463 71564 retry.go:31] will retry after 1.469441853s: waiting for machine to come up
I0917 18:17:58.242545 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has defined MAC address 52:54:00:72:8a:43 in network mk-old-k8s-version-190698
I0917 18:17:58.243142 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | unable to find current IP address of domain old-k8s-version-190698 in network mk-old-k8s-version-190698
I0917 18:17:58.243171 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | I0917 18:17:58.243097 71564 retry.go:31] will retry after 1.692812044s: waiting for machine to come up
I0917 18:17:59.937145 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has defined MAC address 52:54:00:72:8a:43 in network mk-old-k8s-version-190698
I0917 18:17:59.937667 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | unable to find current IP address of domain old-k8s-version-190698 in network mk-old-k8s-version-190698
I0917 18:17:59.937691 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | I0917 18:17:59.937636 71564 retry.go:31] will retry after 1.633473652s: waiting for machine to come up
I0917 18:18:01.573443 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has defined MAC address 52:54:00:72:8a:43 in network mk-old-k8s-version-190698
I0917 18:18:01.573939 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | unable to find current IP address of domain old-k8s-version-190698 in network mk-old-k8s-version-190698
I0917 18:18:01.573965 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | I0917 18:18:01.573892 71564 retry.go:31] will retry after 2.166322593s: waiting for machine to come up
I0917 18:18:03.743470 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has defined MAC address 52:54:00:72:8a:43 in network mk-old-k8s-version-190698
I0917 18:18:03.743927 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | unable to find current IP address of domain old-k8s-version-190698 in network mk-old-k8s-version-190698
I0917 18:18:03.743956 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | I0917 18:18:03.743877 71564 retry.go:31] will retry after 3.042266102s: waiting for machine to come up
I0917 18:18:06.787565 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has defined MAC address 52:54:00:72:8a:43 in network mk-old-k8s-version-190698
I0917 18:18:06.787976 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | unable to find current IP address of domain old-k8s-version-190698 in network mk-old-k8s-version-190698
I0917 18:18:06.788001 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | I0917 18:18:06.787927 71564 retry.go:31] will retry after 3.352376008s: waiting for machine to come up
I0917 18:18:10.142479 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has defined MAC address 52:54:00:72:8a:43 in network mk-old-k8s-version-190698
I0917 18:18:10.142988 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | unable to find current IP address of domain old-k8s-version-190698 in network mk-old-k8s-version-190698
I0917 18:18:10.143017 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | I0917 18:18:10.142943 71564 retry.go:31] will retry after 3.52800113s: waiting for machine to come up
I0917 18:18:13.674260 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has defined MAC address 52:54:00:72:8a:43 in network mk-old-k8s-version-190698
I0917 18:18:13.674819 70593 main.go:141] libmachine: (old-k8s-version-190698) Found IP for machine: 192.168.61.143
I0917 18:18:13.674871 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has current primary IP address 192.168.61.143 and MAC address 52:54:00:72:8a:43 in network mk-old-k8s-version-190698
I0917 18:18:13.674884 70593 main.go:141] libmachine: (old-k8s-version-190698) Reserving static IP address...
I0917 18:18:13.675176 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-190698", mac: "52:54:00:72:8a:43", ip: "192.168.61.143"} in network mk-old-k8s-version-190698
I0917 18:18:13.761607 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | Getting to WaitForSSH function...
I0917 18:18:13.761642 70593 main.go:141] libmachine: (old-k8s-version-190698) Reserved static IP address: 192.168.61.143
I0917 18:18:13.761657 70593 main.go:141] libmachine: (old-k8s-version-190698) Waiting for SSH to be available...
I0917 18:18:13.765040 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has defined MAC address 52:54:00:72:8a:43 in network mk-old-k8s-version-190698
I0917 18:18:13.765517 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:72:8a:43", ip: ""} in network mk-old-k8s-version-190698: {Iface:virbr3 ExpiryTime:2024-09-17 19:18:07 +0000 UTC Type:0 Mac:52:54:00:72:8a:43 Iaid: IPaddr:192.168.61.143 Prefix:24 Hostname:minikube Clientid:01:52:54:00:72:8a:43}
I0917 18:18:13.765568 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has defined IP address 192.168.61.143 and MAC address 52:54:00:72:8a:43 in network mk-old-k8s-version-190698
I0917 18:18:13.765704 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | Using SSH client type: external
I0917 18:18:13.765732 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | Using SSH private key: /home/jenkins/minikube-integration/19662-11085/.minikube/machines/old-k8s-version-190698/id_rsa (-rw-------)
I0917 18:18:13.765762 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.61.143 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19662-11085/.minikube/machines/old-k8s-version-190698/id_rsa -p 22] /usr/bin/ssh <nil>}
I0917 18:18:13.765777 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | About to run SSH command:
I0917 18:18:13.765790 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | exit 0
I0917 18:18:13.893692 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | SSH cmd err, output: <nil>:
I0917 18:18:13.894011 70593 main.go:141] libmachine: (old-k8s-version-190698) KVM machine creation complete!
I0917 18:18:13.894386 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetConfigRaw
I0917 18:18:13.895088 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .DriverName
I0917 18:18:13.895296 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .DriverName
I0917 18:18:13.895520 70593 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0917 18:18:13.895540 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetState
I0917 18:18:13.897022 70593 main.go:141] libmachine: Detecting operating system of created instance...
I0917 18:18:13.897038 70593 main.go:141] libmachine: Waiting for SSH to be available...
I0917 18:18:13.897045 70593 main.go:141] libmachine: Getting to WaitForSSH function...
I0917 18:18:13.897052 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetSSHHostname
I0917 18:18:13.899799 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has defined MAC address 52:54:00:72:8a:43 in network mk-old-k8s-version-190698
I0917 18:18:13.900217 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:72:8a:43", ip: ""} in network mk-old-k8s-version-190698: {Iface:virbr3 ExpiryTime:2024-09-17 19:18:07 +0000 UTC Type:0 Mac:52:54:00:72:8a:43 Iaid: IPaddr:192.168.61.143 Prefix:24 Hostname:old-k8s-version-190698 Clientid:01:52:54:00:72:8a:43}
I0917 18:18:13.900251 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has defined IP address 192.168.61.143 and MAC address 52:54:00:72:8a:43 in network mk-old-k8s-version-190698
I0917 18:18:13.900407 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetSSHPort
I0917 18:18:13.900666 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetSSHKeyPath
I0917 18:18:13.900857 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetSSHKeyPath
I0917 18:18:13.900964 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetSSHUsername
I0917 18:18:13.901171 70593 main.go:141] libmachine: Using SSH client type: native
I0917 18:18:13.901467 70593 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x86c560] 0x86f240 <nil> [] 0s} 192.168.61.143 22 <nil> <nil>}
I0917 18:18:13.901485 70593 main.go:141] libmachine: About to run SSH command:
exit 0
I0917 18:18:14.012676 70593 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0917 18:18:14.012697 70593 main.go:141] libmachine: Detecting the provisioner...
I0917 18:18:14.012705 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetSSHHostname
I0917 18:18:14.015528 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has defined MAC address 52:54:00:72:8a:43 in network mk-old-k8s-version-190698
I0917 18:18:14.015911 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:72:8a:43", ip: ""} in network mk-old-k8s-version-190698: {Iface:virbr3 ExpiryTime:2024-09-17 19:18:07 +0000 UTC Type:0 Mac:52:54:00:72:8a:43 Iaid: IPaddr:192.168.61.143 Prefix:24 Hostname:old-k8s-version-190698 Clientid:01:52:54:00:72:8a:43}
I0917 18:18:14.015942 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has defined IP address 192.168.61.143 and MAC address 52:54:00:72:8a:43 in network mk-old-k8s-version-190698
I0917 18:18:14.016093 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetSSHPort
I0917 18:18:14.016362 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetSSHKeyPath
I0917 18:18:14.016542 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetSSHKeyPath
I0917 18:18:14.016737 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetSSHUsername
I0917 18:18:14.016916 70593 main.go:141] libmachine: Using SSH client type: native
I0917 18:18:14.017159 70593 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x86c560] 0x86f240 <nil> [] 0s} 192.168.61.143 22 <nil> <nil>}
I0917 18:18:14.017177 70593 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0917 18:18:14.134866 70593 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0917 18:18:14.134943 70593 main.go:141] libmachine: found compatible host: buildroot
I0917 18:18:14.134969 70593 main.go:141] libmachine: Provisioning with buildroot...
I0917 18:18:14.134982 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetMachineName
I0917 18:18:14.135273 70593 buildroot.go:166] provisioning hostname "old-k8s-version-190698"
I0917 18:18:14.135305 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetMachineName
I0917 18:18:14.135528 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetSSHHostname
I0917 18:18:14.138744 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has defined MAC address 52:54:00:72:8a:43 in network mk-old-k8s-version-190698
I0917 18:18:14.139144 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:72:8a:43", ip: ""} in network mk-old-k8s-version-190698: {Iface:virbr3 ExpiryTime:2024-09-17 19:18:07 +0000 UTC Type:0 Mac:52:54:00:72:8a:43 Iaid: IPaddr:192.168.61.143 Prefix:24 Hostname:old-k8s-version-190698 Clientid:01:52:54:00:72:8a:43}
I0917 18:18:14.139173 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has defined IP address 192.168.61.143 and MAC address 52:54:00:72:8a:43 in network mk-old-k8s-version-190698
I0917 18:18:14.139317 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetSSHPort
I0917 18:18:14.139504 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetSSHKeyPath
I0917 18:18:14.139673 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetSSHKeyPath
I0917 18:18:14.139827 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetSSHUsername
I0917 18:18:14.140021 70593 main.go:141] libmachine: Using SSH client type: native
I0917 18:18:14.140235 70593 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x86c560] 0x86f240 <nil> [] 0s} 192.168.61.143 22 <nil> <nil>}
I0917 18:18:14.140251 70593 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-190698 && echo "old-k8s-version-190698" | sudo tee /etc/hostname
I0917 18:18:14.271238 70593 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-190698
I0917 18:18:14.271277 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetSSHHostname
I0917 18:18:14.274329 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has defined MAC address 52:54:00:72:8a:43 in network mk-old-k8s-version-190698
I0917 18:18:14.274693 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:72:8a:43", ip: ""} in network mk-old-k8s-version-190698: {Iface:virbr3 ExpiryTime:2024-09-17 19:18:07 +0000 UTC Type:0 Mac:52:54:00:72:8a:43 Iaid: IPaddr:192.168.61.143 Prefix:24 Hostname:old-k8s-version-190698 Clientid:01:52:54:00:72:8a:43}
I0917 18:18:14.274738 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has defined IP address 192.168.61.143 and MAC address 52:54:00:72:8a:43 in network mk-old-k8s-version-190698
I0917 18:18:14.274905 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetSSHPort
I0917 18:18:14.275138 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetSSHKeyPath
I0917 18:18:14.275294 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetSSHKeyPath
I0917 18:18:14.275467 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetSSHUsername
I0917 18:18:14.275624 70593 main.go:141] libmachine: Using SSH client type: native
I0917 18:18:14.275799 70593 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x86c560] 0x86f240 <nil> [] 0s} 192.168.61.143 22 <nil> <nil>}
I0917 18:18:14.275838 70593 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-190698' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-190698/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-190698' | sudo tee -a /etc/hosts;
fi
fi
I0917 18:18:14.425676 70593 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0917 18:18:14.425719 70593 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19662-11085/.minikube CaCertPath:/home/jenkins/minikube-integration/19662-11085/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19662-11085/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19662-11085/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19662-11085/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19662-11085/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19662-11085/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19662-11085/.minikube}
I0917 18:18:14.425747 70593 buildroot.go:174] setting up certificates
I0917 18:18:14.425761 70593 provision.go:84] configureAuth start
I0917 18:18:14.425780 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetMachineName
I0917 18:18:14.426085 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetIP
I0917 18:18:14.430152 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has defined MAC address 52:54:00:72:8a:43 in network mk-old-k8s-version-190698
I0917 18:18:14.430615 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:72:8a:43", ip: ""} in network mk-old-k8s-version-190698: {Iface:virbr3 ExpiryTime:2024-09-17 19:18:07 +0000 UTC Type:0 Mac:52:54:00:72:8a:43 Iaid: IPaddr:192.168.61.143 Prefix:24 Hostname:old-k8s-version-190698 Clientid:01:52:54:00:72:8a:43}
I0917 18:18:14.430645 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has defined IP address 192.168.61.143 and MAC address 52:54:00:72:8a:43 in network mk-old-k8s-version-190698
I0917 18:18:14.431132 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetSSHHostname
I0917 18:18:14.434396 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has defined MAC address 52:54:00:72:8a:43 in network mk-old-k8s-version-190698
I0917 18:18:14.434818 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:72:8a:43", ip: ""} in network mk-old-k8s-version-190698: {Iface:virbr3 ExpiryTime:2024-09-17 19:18:07 +0000 UTC Type:0 Mac:52:54:00:72:8a:43 Iaid: IPaddr:192.168.61.143 Prefix:24 Hostname:old-k8s-version-190698 Clientid:01:52:54:00:72:8a:43}
I0917 18:18:14.434845 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has defined IP address 192.168.61.143 and MAC address 52:54:00:72:8a:43 in network mk-old-k8s-version-190698
I0917 18:18:14.435038 70593 provision.go:143] copyHostCerts
I0917 18:18:14.435142 70593 exec_runner.go:144] found /home/jenkins/minikube-integration/19662-11085/.minikube/ca.pem, removing ...
I0917 18:18:14.435158 70593 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19662-11085/.minikube/ca.pem
I0917 18:18:14.435236 70593 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19662-11085/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19662-11085/.minikube/ca.pem (1082 bytes)
I0917 18:18:14.435387 70593 exec_runner.go:144] found /home/jenkins/minikube-integration/19662-11085/.minikube/cert.pem, removing ...
I0917 18:18:14.435404 70593 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19662-11085/.minikube/cert.pem
I0917 18:18:14.435463 70593 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19662-11085/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19662-11085/.minikube/cert.pem (1123 bytes)
I0917 18:18:14.435558 70593 exec_runner.go:144] found /home/jenkins/minikube-integration/19662-11085/.minikube/key.pem, removing ...
I0917 18:18:14.435571 70593 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19662-11085/.minikube/key.pem
I0917 18:18:14.435600 70593 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19662-11085/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19662-11085/.minikube/key.pem (1679 bytes)
I0917 18:18:14.435672 70593 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19662-11085/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19662-11085/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19662-11085/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-190698 san=[127.0.0.1 192.168.61.143 localhost minikube old-k8s-version-190698]
I0917 18:18:14.744899 70593 provision.go:177] copyRemoteCerts
I0917 18:18:14.744959 70593 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0917 18:18:14.744984 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetSSHHostname
I0917 18:18:14.747977 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has defined MAC address 52:54:00:72:8a:43 in network mk-old-k8s-version-190698
I0917 18:18:14.748400 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:72:8a:43", ip: ""} in network mk-old-k8s-version-190698: {Iface:virbr3 ExpiryTime:2024-09-17 19:18:07 +0000 UTC Type:0 Mac:52:54:00:72:8a:43 Iaid: IPaddr:192.168.61.143 Prefix:24 Hostname:old-k8s-version-190698 Clientid:01:52:54:00:72:8a:43}
I0917 18:18:14.748425 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has defined IP address 192.168.61.143 and MAC address 52:54:00:72:8a:43 in network mk-old-k8s-version-190698
I0917 18:18:14.748758 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetSSHPort
I0917 18:18:14.748970 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetSSHKeyPath
I0917 18:18:14.749158 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetSSHUsername
I0917 18:18:14.749344 70593 sshutil.go:53] new ssh client: &{IP:192.168.61.143 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19662-11085/.minikube/machines/old-k8s-version-190698/id_rsa Username:docker}
I0917 18:18:14.852179 70593 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19662-11085/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0917 18:18:14.884295 70593 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19662-11085/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0917 18:18:14.919676 70593 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19662-11085/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0917 18:18:14.955449 70593 provision.go:87] duration metric: took 529.667957ms to configureAuth
I0917 18:18:14.955482 70593 buildroot.go:189] setting minikube options for container-runtime
I0917 18:18:14.955690 70593 config.go:182] Loaded profile config "old-k8s-version-190698": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0917 18:18:14.955785 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetSSHHostname
I0917 18:18:14.958863 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has defined MAC address 52:54:00:72:8a:43 in network mk-old-k8s-version-190698
I0917 18:18:14.959141 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:72:8a:43", ip: ""} in network mk-old-k8s-version-190698: {Iface:virbr3 ExpiryTime:2024-09-17 19:18:07 +0000 UTC Type:0 Mac:52:54:00:72:8a:43 Iaid: IPaddr:192.168.61.143 Prefix:24 Hostname:old-k8s-version-190698 Clientid:01:52:54:00:72:8a:43}
I0917 18:18:14.959165 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has defined IP address 192.168.61.143 and MAC address 52:54:00:72:8a:43 in network mk-old-k8s-version-190698
I0917 18:18:14.959394 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetSSHPort
I0917 18:18:14.959604 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetSSHKeyPath
I0917 18:18:14.959801 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetSSHKeyPath
I0917 18:18:14.959957 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetSSHUsername
I0917 18:18:14.960125 70593 main.go:141] libmachine: Using SSH client type: native
I0917 18:18:14.960316 70593 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x86c560] 0x86f240 <nil> [] 0s} 192.168.61.143 22 <nil> <nil>}
I0917 18:18:14.960335 70593 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0917 18:18:15.219522 70593 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0917 18:18:15.219587 70593 main.go:141] libmachine: Checking connection to Docker...
I0917 18:18:15.219600 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetURL
I0917 18:18:15.220918 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | Using libvirt version 6000000
I0917 18:18:15.223964 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has defined MAC address 52:54:00:72:8a:43 in network mk-old-k8s-version-190698
I0917 18:18:15.224344 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:72:8a:43", ip: ""} in network mk-old-k8s-version-190698: {Iface:virbr3 ExpiryTime:2024-09-17 19:18:07 +0000 UTC Type:0 Mac:52:54:00:72:8a:43 Iaid: IPaddr:192.168.61.143 Prefix:24 Hostname:old-k8s-version-190698 Clientid:01:52:54:00:72:8a:43}
I0917 18:18:15.224375 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has defined IP address 192.168.61.143 and MAC address 52:54:00:72:8a:43 in network mk-old-k8s-version-190698
I0917 18:18:15.224569 70593 main.go:141] libmachine: Docker is up and running!
I0917 18:18:15.224584 70593 main.go:141] libmachine: Reticulating splines...
I0917 18:18:15.224593 70593 client.go:171] duration metric: took 24.444006269s to LocalClient.Create
I0917 18:18:15.224617 70593 start.go:167] duration metric: took 24.44408572s to libmachine.API.Create "old-k8s-version-190698"
I0917 18:18:15.224630 70593 start.go:293] postStartSetup for "old-k8s-version-190698" (driver="kvm2")
I0917 18:18:15.224644 70593 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0917 18:18:15.224668 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .DriverName
I0917 18:18:15.224904 70593 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0917 18:18:15.224929 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetSSHHostname
I0917 18:18:15.227367 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has defined MAC address 52:54:00:72:8a:43 in network mk-old-k8s-version-190698
I0917 18:18:15.227751 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:72:8a:43", ip: ""} in network mk-old-k8s-version-190698: {Iface:virbr3 ExpiryTime:2024-09-17 19:18:07 +0000 UTC Type:0 Mac:52:54:00:72:8a:43 Iaid: IPaddr:192.168.61.143 Prefix:24 Hostname:old-k8s-version-190698 Clientid:01:52:54:00:72:8a:43}
I0917 18:18:15.227776 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has defined IP address 192.168.61.143 and MAC address 52:54:00:72:8a:43 in network mk-old-k8s-version-190698
I0917 18:18:15.227983 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetSSHPort
I0917 18:18:15.228166 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetSSHKeyPath
I0917 18:18:15.228310 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetSSHUsername
I0917 18:18:15.228446 70593 sshutil.go:53] new ssh client: &{IP:192.168.61.143 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19662-11085/.minikube/machines/old-k8s-version-190698/id_rsa Username:docker}
I0917 18:18:15.324063 70593 ssh_runner.go:195] Run: cat /etc/os-release
I0917 18:18:15.330081 70593 info.go:137] Remote host: Buildroot 2023.02.9
I0917 18:18:15.330181 70593 filesync.go:126] Scanning /home/jenkins/minikube-integration/19662-11085/.minikube/addons for local assets ...
I0917 18:18:15.330263 70593 filesync.go:126] Scanning /home/jenkins/minikube-integration/19662-11085/.minikube/files for local assets ...
I0917 18:18:15.330390 70593 filesync.go:149] local asset: /home/jenkins/minikube-integration/19662-11085/.minikube/files/etc/ssl/certs/182592.pem -> 182592.pem in /etc/ssl/certs
I0917 18:18:15.330541 70593 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0917 18:18:15.341670 70593 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19662-11085/.minikube/files/etc/ssl/certs/182592.pem --> /etc/ssl/certs/182592.pem (1708 bytes)
I0917 18:18:15.374445 70593 start.go:296] duration metric: took 149.800611ms for postStartSetup
I0917 18:18:15.374509 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetConfigRaw
I0917 18:18:15.375201 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetIP
I0917 18:18:15.378402 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has defined MAC address 52:54:00:72:8a:43 in network mk-old-k8s-version-190698
I0917 18:18:15.378860 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:72:8a:43", ip: ""} in network mk-old-k8s-version-190698: {Iface:virbr3 ExpiryTime:2024-09-17 19:18:07 +0000 UTC Type:0 Mac:52:54:00:72:8a:43 Iaid: IPaddr:192.168.61.143 Prefix:24 Hostname:old-k8s-version-190698 Clientid:01:52:54:00:72:8a:43}
I0917 18:18:15.378896 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has defined IP address 192.168.61.143 and MAC address 52:54:00:72:8a:43 in network mk-old-k8s-version-190698
I0917 18:18:15.379161 70593 profile.go:143] Saving config to /home/jenkins/minikube-integration/19662-11085/.minikube/profiles/old-k8s-version-190698/config.json ...
I0917 18:18:15.379397 70593 start.go:128] duration metric: took 24.624474998s to createHost
I0917 18:18:15.379447 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetSSHHostname
I0917 18:18:15.382105 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has defined MAC address 52:54:00:72:8a:43 in network mk-old-k8s-version-190698
I0917 18:18:15.382487 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:72:8a:43", ip: ""} in network mk-old-k8s-version-190698: {Iface:virbr3 ExpiryTime:2024-09-17 19:18:07 +0000 UTC Type:0 Mac:52:54:00:72:8a:43 Iaid: IPaddr:192.168.61.143 Prefix:24 Hostname:old-k8s-version-190698 Clientid:01:52:54:00:72:8a:43}
I0917 18:18:15.382520 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has defined IP address 192.168.61.143 and MAC address 52:54:00:72:8a:43 in network mk-old-k8s-version-190698
I0917 18:18:15.382811 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetSSHPort
I0917 18:18:15.383015 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetSSHKeyPath
I0917 18:18:15.383202 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetSSHKeyPath
I0917 18:18:15.383320 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetSSHUsername
I0917 18:18:15.383481 70593 main.go:141] libmachine: Using SSH client type: native
I0917 18:18:15.383706 70593 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x86c560] 0x86f240 <nil> [] 0s} 192.168.61.143 22 <nil> <nil>}
I0917 18:18:15.383721 70593 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0917 18:18:15.502396 70593 main.go:141] libmachine: SSH cmd err, output: <nil>: 1726597095.440363257
I0917 18:18:15.502424 70593 fix.go:216] guest clock: 1726597095.440363257
I0917 18:18:15.502435 70593 fix.go:229] Guest: 2024-09-17 18:18:15.440363257 +0000 UTC Remote: 2024-09-17 18:18:15.379416052 +0000 UTC m=+50.909753838 (delta=60.947205ms)
I0917 18:18:15.502498 70593 fix.go:200] guest clock delta is within tolerance: 60.947205ms
I0917 18:18:15.502509 70593 start.go:83] releasing machines lock for "old-k8s-version-190698", held for 24.747790223s
I0917 18:18:15.502542 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .DriverName
I0917 18:18:15.502903 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetIP
I0917 18:18:15.506524 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has defined MAC address 52:54:00:72:8a:43 in network mk-old-k8s-version-190698
I0917 18:18:15.507063 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:72:8a:43", ip: ""} in network mk-old-k8s-version-190698: {Iface:virbr3 ExpiryTime:2024-09-17 19:18:07 +0000 UTC Type:0 Mac:52:54:00:72:8a:43 Iaid: IPaddr:192.168.61.143 Prefix:24 Hostname:old-k8s-version-190698 Clientid:01:52:54:00:72:8a:43}
I0917 18:18:15.507088 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has defined IP address 192.168.61.143 and MAC address 52:54:00:72:8a:43 in network mk-old-k8s-version-190698
I0917 18:18:15.507351 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .DriverName
I0917 18:18:15.507913 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .DriverName
I0917 18:18:15.508156 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .DriverName
I0917 18:18:15.508239 70593 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0917 18:18:15.508293 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetSSHHostname
I0917 18:18:15.508415 70593 ssh_runner.go:195] Run: cat /version.json
I0917 18:18:15.508451 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetSSHHostname
I0917 18:18:15.511886 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has defined MAC address 52:54:00:72:8a:43 in network mk-old-k8s-version-190698
I0917 18:18:15.512434 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:72:8a:43", ip: ""} in network mk-old-k8s-version-190698: {Iface:virbr3 ExpiryTime:2024-09-17 19:18:07 +0000 UTC Type:0 Mac:52:54:00:72:8a:43 Iaid: IPaddr:192.168.61.143 Prefix:24 Hostname:old-k8s-version-190698 Clientid:01:52:54:00:72:8a:43}
I0917 18:18:15.512481 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has defined IP address 192.168.61.143 and MAC address 52:54:00:72:8a:43 in network mk-old-k8s-version-190698
I0917 18:18:15.512666 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has defined MAC address 52:54:00:72:8a:43 in network mk-old-k8s-version-190698
I0917 18:18:15.512704 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetSSHPort
I0917 18:18:15.512959 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetSSHKeyPath
I0917 18:18:15.513094 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:72:8a:43", ip: ""} in network mk-old-k8s-version-190698: {Iface:virbr3 ExpiryTime:2024-09-17 19:18:07 +0000 UTC Type:0 Mac:52:54:00:72:8a:43 Iaid: IPaddr:192.168.61.143 Prefix:24 Hostname:old-k8s-version-190698 Clientid:01:52:54:00:72:8a:43}
I0917 18:18:15.513129 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has defined IP address 192.168.61.143 and MAC address 52:54:00:72:8a:43 in network mk-old-k8s-version-190698
I0917 18:18:15.513178 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetSSHUsername
I0917 18:18:15.513331 70593 sshutil.go:53] new ssh client: &{IP:192.168.61.143 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19662-11085/.minikube/machines/old-k8s-version-190698/id_rsa Username:docker}
I0917 18:18:15.513715 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetSSHPort
I0917 18:18:15.513906 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetSSHKeyPath
I0917 18:18:15.514068 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetSSHUsername
I0917 18:18:15.514216 70593 sshutil.go:53] new ssh client: &{IP:192.168.61.143 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19662-11085/.minikube/machines/old-k8s-version-190698/id_rsa Username:docker}
I0917 18:18:15.613635 70593 ssh_runner.go:195] Run: systemctl --version
I0917 18:18:15.653367 70593 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0917 18:18:15.837806 70593 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0917 18:18:15.846602 70593 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0917 18:18:15.846676 70593 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0917 18:18:15.872049 70593 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0917 18:18:15.872144 70593 start.go:495] detecting cgroup driver to use...
I0917 18:18:15.872265 70593 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0917 18:18:15.896112 70593 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0917 18:18:15.917038 70593 docker.go:217] disabling cri-docker service (if available) ...
I0917 18:18:15.917117 70593 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0917 18:18:15.937694 70593 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0917 18:18:15.958121 70593 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0917 18:18:16.139763 70593 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0917 18:18:16.314611 70593 docker.go:233] disabling docker service ...
I0917 18:18:16.314686 70593 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0917 18:18:16.331970 70593 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0917 18:18:16.347463 70593 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0917 18:18:16.493043 70593 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0917 18:18:16.660104 70593 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0917 18:18:16.681183 70593 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0917 18:18:16.717735 70593 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0917 18:18:16.717805 70593 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0917 18:18:16.732960 70593 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0917 18:18:16.733050 70593 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0917 18:18:16.748556 70593 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0917 18:18:16.764368 70593 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0917 18:18:16.779487 70593 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0917 18:18:16.796491 70593 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0917 18:18:16.811635 70593 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0917 18:18:16.811697 70593 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0917 18:18:16.833257 70593 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0917 18:18:16.851593 70593 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0917 18:18:17.041401 70593 ssh_runner.go:195] Run: sudo systemctl restart crio
I0917 18:18:17.169763 70593 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0917 18:18:17.169868 70593 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0917 18:18:17.178691 70593 start.go:563] Will wait 60s for crictl version
I0917 18:18:17.178766 70593 ssh_runner.go:195] Run: which crictl
I0917 18:18:17.185962 70593 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0917 18:18:17.257631 70593 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0917 18:18:17.257734 70593 ssh_runner.go:195] Run: crio --version
I0917 18:18:17.300685 70593 ssh_runner.go:195] Run: crio --version
I0917 18:18:17.349062 70593 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0917 18:18:17.350567 70593 main.go:141] libmachine: (old-k8s-version-190698) Calling .GetIP
I0917 18:18:17.354315 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has defined MAC address 52:54:00:72:8a:43 in network mk-old-k8s-version-190698
I0917 18:18:17.354793 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:72:8a:43", ip: ""} in network mk-old-k8s-version-190698: {Iface:virbr3 ExpiryTime:2024-09-17 19:18:07 +0000 UTC Type:0 Mac:52:54:00:72:8a:43 Iaid: IPaddr:192.168.61.143 Prefix:24 Hostname:old-k8s-version-190698 Clientid:01:52:54:00:72:8a:43}
I0917 18:18:17.354825 70593 main.go:141] libmachine: (old-k8s-version-190698) DBG | domain old-k8s-version-190698 has defined IP address 192.168.61.143 and MAC address 52:54:00:72:8a:43 in network mk-old-k8s-version-190698
I0917 18:18:17.355217 70593 ssh_runner.go:195] Run: grep 192.168.61.1 host.minikube.internal$ /etc/hosts
I0917 18:18:17.364152 70593 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.61.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0917 18:18:17.384667 70593 kubeadm.go:883] updating cluster {Name:old-k8s-version-190698 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19649/minikube-v1.34.0-1726481713-19649-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726589491-19662@sha256:6370b9fec173944088c2d87d44b01819c0ec611a83d9e2f38d36352dff8121a4 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-190698 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.143 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] M
ountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0917 18:18:17.384792 70593 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0917 18:18:17.384833 70593 ssh_runner.go:195] Run: sudo crictl images --output json
I0917 18:18:17.437319 70593 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0917 18:18:17.437396 70593 ssh_runner.go:195] Run: which lz4
I0917 18:18:17.442692 70593 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0917 18:18:17.449161 70593 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0917 18:18:17.449190 70593 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19662-11085/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0917 18:18:19.788230 70593 crio.go:462] duration metric: took 2.345575192s to copy over tarball
I0917 18:18:19.788307 70593 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0917 18:18:23.201894 70593 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.41355318s)
I0917 18:18:23.201926 70593 crio.go:469] duration metric: took 3.413668173s to extract the tarball
I0917 18:18:23.201933 70593 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0917 18:18:23.248699 70593 ssh_runner.go:195] Run: sudo crictl images --output json
I0917 18:18:23.327076 70593 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0917 18:18:23.327101 70593 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0917 18:18:23.327145 70593 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0917 18:18:23.327203 70593 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0917 18:18:23.327222 70593 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0917 18:18:23.327261 70593 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0917 18:18:23.327202 70593 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0917 18:18:23.327327 70593 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0917 18:18:23.327335 70593 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0917 18:18:23.327153 70593 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0917 18:18:23.328957 70593 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0917 18:18:23.329021 70593 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0917 18:18:23.329025 70593 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0917 18:18:23.329057 70593 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0917 18:18:23.328961 70593 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0917 18:18:23.328963 70593 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0917 18:18:23.329613 70593 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0917 18:18:23.329613 70593 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0917 18:18:23.504449 70593 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0917 18:18:23.508675 70593 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0917 18:18:23.509452 70593 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0917 18:18:23.512825 70593 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0917 18:18:23.516814 70593 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0917 18:18:23.527550 70593 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0917 18:18:23.556416 70593 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0917 18:18:23.610612 70593 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0917 18:18:23.610801 70593 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0917 18:18:23.610891 70593 ssh_runner.go:195] Run: which crictl
I0917 18:18:23.728697 70593 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0917 18:18:23.728728 70593 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0917 18:18:23.728742 70593 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0917 18:18:23.728762 70593 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0917 18:18:23.728792 70593 ssh_runner.go:195] Run: which crictl
I0917 18:18:23.728799 70593 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0917 18:18:23.728851 70593 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0917 18:18:23.728863 70593 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0917 18:18:23.728882 70593 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0917 18:18:23.728920 70593 ssh_runner.go:195] Run: which crictl
I0917 18:18:23.728887 70593 ssh_runner.go:195] Run: which crictl
I0917 18:18:23.728810 70593 ssh_runner.go:195] Run: which crictl
I0917 18:18:23.736183 70593 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0917 18:18:23.736227 70593 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0917 18:18:23.736279 70593 ssh_runner.go:195] Run: which crictl
I0917 18:18:23.736292 70593 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0917 18:18:23.736326 70593 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0917 18:18:23.736336 70593 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0917 18:18:23.736372 70593 ssh_runner.go:195] Run: which crictl
I0917 18:18:23.744990 70593 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0917 18:18:23.745066 70593 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0917 18:18:23.745094 70593 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0917 18:18:23.745156 70593 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0917 18:18:23.842998 70593 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0917 18:18:23.843033 70593 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0917 18:18:23.843100 70593 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0917 18:18:23.894127 70593 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0917 18:18:23.894216 70593 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0917 18:18:23.894228 70593 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0917 18:18:23.912936 70593 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0917 18:18:23.998214 70593 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0917 18:18:23.998419 70593 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0917 18:18:23.998473 70593 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0917 18:18:24.074567 70593 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0917 18:18:24.080215 70593 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0917 18:18:24.080314 70593 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0917 18:18:24.080275 70593 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0917 18:18:24.114618 70593 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19662-11085/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0917 18:18:24.189714 70593 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0917 18:18:24.189802 70593 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0917 18:18:24.206544 70593 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19662-11085/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0917 18:18:24.255179 70593 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19662-11085/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0917 18:18:24.255304 70593 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19662-11085/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0917 18:18:24.255306 70593 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19662-11085/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0917 18:18:24.262889 70593 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0917 18:18:24.306066 70593 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19662-11085/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0917 18:18:24.306197 70593 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19662-11085/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0917 18:18:24.425107 70593 cache_images.go:92] duration metric: took 1.097987878s to LoadCachedImages
W0917 18:18:24.425216 70593 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19662-11085/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19662-11085/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0: no such file or directory
I0917 18:18:24.425256 70593 kubeadm.go:934] updating node { 192.168.61.143 8443 v1.20.0 crio true true} ...
I0917 18:18:24.425371 70593 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-190698 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.61.143
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-190698 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0917 18:18:24.425457 70593 ssh_runner.go:195] Run: crio config
I0917 18:18:24.485417 70593 cni.go:84] Creating CNI manager for ""
I0917 18:18:24.485446 70593 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0917 18:18:24.485457 70593 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0917 18:18:24.485481 70593 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.61.143 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-190698 NodeName:old-k8s-version-190698 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.61.143"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.61.143 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0917 18:18:24.485664 70593 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.61.143
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-190698"
kubeletExtraArgs:
node-ip: 192.168.61.143
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.61.143"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0917 18:18:24.485773 70593 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0917 18:18:24.499662 70593 binaries.go:44] Found k8s binaries, skipping transfer
I0917 18:18:24.499734 70593 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0917 18:18:24.510974 70593 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0917 18:18:24.533518 70593 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0917 18:18:24.558750 70593 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0917 18:18:24.581691 70593 ssh_runner.go:195] Run: grep 192.168.61.143 control-plane.minikube.internal$ /etc/hosts
I0917 18:18:24.586198 70593 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.61.143 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0917 18:18:24.601180 70593 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0917 18:18:24.745970 70593 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0917 18:18:24.766624 70593 certs.go:68] Setting up /home/jenkins/minikube-integration/19662-11085/.minikube/profiles/old-k8s-version-190698 for IP: 192.168.61.143
I0917 18:18:24.766652 70593 certs.go:194] generating shared ca certs ...
I0917 18:18:24.766676 70593 certs.go:226] acquiring lock for ca certs: {Name:mka88aa799a46cbbcd9c06f5d7ca84ae282f447e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0917 18:18:24.766938 70593 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19662-11085/.minikube/ca.key
I0917 18:18:24.767012 70593 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19662-11085/.minikube/proxy-client-ca.key
I0917 18:18:24.767032 70593 certs.go:256] generating profile certs ...
I0917 18:18:24.767114 70593 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19662-11085/.minikube/profiles/old-k8s-version-190698/client.key
I0917 18:18:24.767139 70593 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19662-11085/.minikube/profiles/old-k8s-version-190698/client.crt with IP's: []
I0917 18:18:24.935581 70593 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19662-11085/.minikube/profiles/old-k8s-version-190698/client.crt ...
I0917 18:18:24.935612 70593 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19662-11085/.minikube/profiles/old-k8s-version-190698/client.crt: {Name:mk46ff34d0ddc6064bec71d49662d8284e7fcf7f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0917 18:18:24.935825 70593 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19662-11085/.minikube/profiles/old-k8s-version-190698/client.key ...
I0917 18:18:24.935845 70593 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19662-11085/.minikube/profiles/old-k8s-version-190698/client.key: {Name:mke056c719416246146b088311af7be9ed6ce6bd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0917 18:18:24.935961 70593 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19662-11085/.minikube/profiles/old-k8s-version-190698/apiserver.key.8ffdb4af
I0917 18:18:24.935980 70593 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19662-11085/.minikube/profiles/old-k8s-version-190698/apiserver.crt.8ffdb4af with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.61.143]
I0917 18:18:25.102645 70593 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19662-11085/.minikube/profiles/old-k8s-version-190698/apiserver.crt.8ffdb4af ...
I0917 18:18:25.102683 70593 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19662-11085/.minikube/profiles/old-k8s-version-190698/apiserver.crt.8ffdb4af: {Name:mk52c0128422e8e9851e498745319d7e336d6960 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0917 18:18:25.102874 70593 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19662-11085/.minikube/profiles/old-k8s-version-190698/apiserver.key.8ffdb4af ...
I0917 18:18:25.102891 70593 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19662-11085/.minikube/profiles/old-k8s-version-190698/apiserver.key.8ffdb4af: {Name:mkc14c2bd610f7c23ac66e9417c65836ae872b01 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0917 18:18:25.102991 70593 certs.go:381] copying /home/jenkins/minikube-integration/19662-11085/.minikube/profiles/old-k8s-version-190698/apiserver.crt.8ffdb4af -> /home/jenkins/minikube-integration/19662-11085/.minikube/profiles/old-k8s-version-190698/apiserver.crt
I0917 18:18:25.103103 70593 certs.go:385] copying /home/jenkins/minikube-integration/19662-11085/.minikube/profiles/old-k8s-version-190698/apiserver.key.8ffdb4af -> /home/jenkins/minikube-integration/19662-11085/.minikube/profiles/old-k8s-version-190698/apiserver.key
I0917 18:18:25.103186 70593 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19662-11085/.minikube/profiles/old-k8s-version-190698/proxy-client.key
I0917 18:18:25.103213 70593 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19662-11085/.minikube/profiles/old-k8s-version-190698/proxy-client.crt with IP's: []
I0917 18:18:25.349210 70593 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19662-11085/.minikube/profiles/old-k8s-version-190698/proxy-client.crt ...
I0917 18:18:25.349269 70593 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19662-11085/.minikube/profiles/old-k8s-version-190698/proxy-client.crt: {Name:mkbf07b294f95eac28091fd87f2652f6b3f079c4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0917 18:18:25.349480 70593 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19662-11085/.minikube/profiles/old-k8s-version-190698/proxy-client.key ...
I0917 18:18:25.349498 70593 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19662-11085/.minikube/profiles/old-k8s-version-190698/proxy-client.key: {Name:mkf30eb1427481fd3c74411423c3b36f8e366273 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0917 18:18:25.349735 70593 certs.go:484] found cert: /home/jenkins/minikube-integration/19662-11085/.minikube/certs/18259.pem (1338 bytes)
W0917 18:18:25.349790 70593 certs.go:480] ignoring /home/jenkins/minikube-integration/19662-11085/.minikube/certs/18259_empty.pem, impossibly tiny 0 bytes
I0917 18:18:25.349806 70593 certs.go:484] found cert: /home/jenkins/minikube-integration/19662-11085/.minikube/certs/ca-key.pem (1679 bytes)
I0917 18:18:25.349839 70593 certs.go:484] found cert: /home/jenkins/minikube-integration/19662-11085/.minikube/certs/ca.pem (1082 bytes)
I0917 18:18:25.349872 70593 certs.go:484] found cert: /home/jenkins/minikube-integration/19662-11085/.minikube/certs/cert.pem (1123 bytes)
I0917 18:18:25.349905 70593 certs.go:484] found cert: /home/jenkins/minikube-integration/19662-11085/.minikube/certs/key.pem (1679 bytes)
I0917 18:18:25.349979 70593 certs.go:484] found cert: /home/jenkins/minikube-integration/19662-11085/.minikube/files/etc/ssl/certs/182592.pem (1708 bytes)
I0917 18:18:25.350549 70593 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19662-11085/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0917 18:18:25.382467 70593 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19662-11085/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0917 18:18:25.411152 70593 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19662-11085/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0917 18:18:25.439729 70593 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19662-11085/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0917 18:18:25.466632 70593 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19662-11085/.minikube/profiles/old-k8s-version-190698/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0917 18:18:25.496783 70593 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19662-11085/.minikube/profiles/old-k8s-version-190698/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0917 18:18:25.527161 70593 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19662-11085/.minikube/profiles/old-k8s-version-190698/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0917 18:18:25.556092 70593 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19662-11085/.minikube/profiles/old-k8s-version-190698/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0917 18:18:25.586429 70593 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19662-11085/.minikube/files/etc/ssl/certs/182592.pem --> /usr/share/ca-certificates/182592.pem (1708 bytes)
I0917 18:18:25.615401 70593 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19662-11085/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0917 18:18:25.641878 70593 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19662-11085/.minikube/certs/18259.pem --> /usr/share/ca-certificates/18259.pem (1338 bytes)
I0917 18:18:25.670727 70593 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0917 18:18:25.701186 70593 ssh_runner.go:195] Run: openssl version
I0917 18:18:25.708076 70593 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/182592.pem && ln -fs /usr/share/ca-certificates/182592.pem /etc/ssl/certs/182592.pem"
I0917 18:18:25.727872 70593 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/182592.pem
I0917 18:18:25.739453 70593 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 17 17:13 /usr/share/ca-certificates/182592.pem
I0917 18:18:25.739523 70593 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/182592.pem
I0917 18:18:25.747047 70593 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/182592.pem /etc/ssl/certs/3ec20f2e.0"
I0917 18:18:25.765921 70593 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0917 18:18:25.779595 70593 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0917 18:18:25.785780 70593 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 17 16:56 /usr/share/ca-certificates/minikubeCA.pem
I0917 18:18:25.785856 70593 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0917 18:18:25.792575 70593 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0917 18:18:25.805699 70593 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/18259.pem && ln -fs /usr/share/ca-certificates/18259.pem /etc/ssl/certs/18259.pem"
I0917 18:18:25.819325 70593 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/18259.pem
I0917 18:18:25.824466 70593 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 17 17:13 /usr/share/ca-certificates/18259.pem
I0917 18:18:25.824551 70593 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/18259.pem
I0917 18:18:25.830890 70593 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/18259.pem /etc/ssl/certs/51391683.0"
I0917 18:18:25.848216 70593 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0917 18:18:25.853020 70593 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0917 18:18:25.853087 70593 kubeadm.go:392] StartCluster: {Name:old-k8s-version-190698 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19649/minikube-v1.34.0-1726481713-19649-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726589491-19662@sha256:6370b9fec173944088c2d87d44b01819c0ec611a83d9e2f38d36352dff8121a4 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-190698 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.143 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0917 18:18:25.853156 70593 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0917 18:18:25.853211 70593 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0917 18:18:25.894872 70593 cri.go:89] found id: ""
I0917 18:18:25.894950 70593 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0917 18:18:25.907112 70593 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0917 18:18:25.918883 70593 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0917 18:18:25.930372 70593 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0917 18:18:25.930395 70593 kubeadm.go:157] found existing configuration files:
I0917 18:18:25.930473 70593 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0917 18:18:25.941089 70593 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0917 18:18:25.941145 70593 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0917 18:18:25.952179 70593 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0917 18:18:25.962858 70593 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0917 18:18:25.962924 70593 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0917 18:18:25.974519 70593 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0917 18:18:25.985334 70593 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0917 18:18:25.985406 70593 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0917 18:18:25.995876 70593 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0917 18:18:26.005976 70593 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0917 18:18:26.006044 70593 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0917 18:18:26.018194 70593 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0917 18:18:26.159906 70593 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0917 18:18:26.159990 70593 kubeadm.go:310] [preflight] Running pre-flight checks
I0917 18:18:26.323223 70593 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0917 18:18:26.323397 70593 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0917 18:18:26.323561 70593 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0917 18:18:26.583609 70593 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0917 18:18:26.586440 70593 out.go:235] - Generating certificates and keys ...
I0917 18:18:26.586547 70593 kubeadm.go:310] [certs] Using existing ca certificate authority
I0917 18:18:26.586631 70593 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0917 18:18:26.789804 70593 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0917 18:18:27.322523 70593 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0917 18:18:27.472139 70593 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0917 18:18:27.678822 70593 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0917 18:18:27.779537 70593 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0917 18:18:27.779945 70593 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-190698] and IPs [192.168.61.143 127.0.0.1 ::1]
I0917 18:18:27.919175 70593 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0917 18:18:27.919505 70593 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-190698] and IPs [192.168.61.143 127.0.0.1 ::1]
I0917 18:18:28.621495 70593 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0917 18:18:28.809018 70593 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0917 18:18:29.069249 70593 kubeadm.go:310] [certs] Generating "sa" key and public key
I0917 18:18:29.069673 70593 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0917 18:18:29.231216 70593 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0917 18:18:29.332620 70593 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0917 18:18:29.582345 70593 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0917 18:18:29.645105 70593 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0917 18:18:29.667576 70593 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0917 18:18:29.667987 70593 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0917 18:18:29.668063 70593 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0917 18:18:29.814080 70593 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0917 18:18:29.815980 70593 out.go:235] - Booting up control plane ...
I0917 18:18:29.816100 70593 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0917 18:18:29.825865 70593 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0917 18:18:29.826789 70593 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0917 18:18:29.827647 70593 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0917 18:18:29.832262 70593 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0917 18:19:09.774796 70593 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0917 18:19:09.775641 70593 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0917 18:19:09.775924 70593 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0917 18:19:14.775168 70593 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0917 18:19:14.775496 70593 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0917 18:19:24.774789 70593 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0917 18:19:24.775031 70593 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0917 18:19:44.775306 70593 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0917 18:19:44.775518 70593 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0917 18:20:24.777276 70593 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0917 18:20:24.777519 70593 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0917 18:20:24.777558 70593 kubeadm.go:310]
I0917 18:20:24.777633 70593 kubeadm.go:310] Unfortunately, an error has occurred:
I0917 18:20:24.777689 70593 kubeadm.go:310] timed out waiting for the condition
I0917 18:20:24.777712 70593 kubeadm.go:310]
I0917 18:20:24.777753 70593 kubeadm.go:310] This error is likely caused by:
I0917 18:20:24.777785 70593 kubeadm.go:310] - The kubelet is not running
I0917 18:20:24.777873 70593 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0917 18:20:24.777887 70593 kubeadm.go:310]
I0917 18:20:24.777974 70593 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0917 18:20:24.778023 70593 kubeadm.go:310] - 'systemctl status kubelet'
I0917 18:20:24.778073 70593 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0917 18:20:24.778083 70593 kubeadm.go:310]
I0917 18:20:24.778175 70593 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0917 18:20:24.778250 70593 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0917 18:20:24.778265 70593 kubeadm.go:310]
I0917 18:20:24.778411 70593 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0917 18:20:24.778518 70593 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0917 18:20:24.778612 70593 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0917 18:20:24.778711 70593 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0917 18:20:24.778726 70593 kubeadm.go:310]
I0917 18:20:24.779031 70593 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0917 18:20:24.779155 70593 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0917 18:20:24.779320 70593 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
W0917 18:20:24.779376 70593 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-190698] and IPs [192.168.61.143 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-190698] and IPs [192.168.61.143 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-190698] and IPs [192.168.61.143 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-190698] and IPs [192.168.61.143 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0917 18:20:24.779425 70593 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0917 18:20:27.026490 70593 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (2.247031505s)
I0917 18:20:27.026588 70593 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0917 18:20:27.043924 70593 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0917 18:20:27.057170 70593 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0917 18:20:27.057202 70593 kubeadm.go:157] found existing configuration files:
I0917 18:20:27.057274 70593 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0917 18:20:27.067392 70593 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0917 18:20:27.067451 70593 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0917 18:20:27.077819 70593 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0917 18:20:27.087660 70593 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0917 18:20:27.087729 70593 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0917 18:20:27.097708 70593 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0917 18:20:27.108695 70593 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0917 18:20:27.108764 70593 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0917 18:20:27.120109 70593 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0917 18:20:27.130243 70593 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0917 18:20:27.130315 70593 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0917 18:20:27.140657 70593 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0917 18:20:27.217630 70593 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0917 18:20:27.217714 70593 kubeadm.go:310] [preflight] Running pre-flight checks
I0917 18:20:27.363268 70593 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0917 18:20:27.363471 70593 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0917 18:20:27.363622 70593 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0917 18:20:27.549735 70593 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0917 18:20:27.552035 70593 out.go:235] - Generating certificates and keys ...
I0917 18:20:27.552155 70593 kubeadm.go:310] [certs] Using existing ca certificate authority
I0917 18:20:27.552247 70593 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0917 18:20:27.552352 70593 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0917 18:20:27.552447 70593 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0917 18:20:27.552574 70593 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0917 18:20:27.552658 70593 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0917 18:20:27.552754 70593 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0917 18:20:27.552841 70593 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0917 18:20:27.552928 70593 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0917 18:20:27.553339 70593 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0917 18:20:27.553486 70593 kubeadm.go:310] [certs] Using the existing "sa" key
I0917 18:20:27.553581 70593 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0917 18:20:27.659199 70593 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0917 18:20:27.762376 70593 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0917 18:20:27.915552 70593 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0917 18:20:28.162320 70593 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0917 18:20:28.176962 70593 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0917 18:20:28.178023 70593 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0917 18:20:28.178095 70593 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0917 18:20:28.326382 70593 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0917 18:20:28.328571 70593 out.go:235] - Booting up control plane ...
I0917 18:20:28.328695 70593 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0917 18:20:28.332956 70593 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0917 18:20:28.333929 70593 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0917 18:20:28.342652 70593 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0917 18:20:28.351400 70593 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0917 18:21:08.351777 70593 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0917 18:21:08.351904 70593 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0917 18:21:08.352161 70593 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0917 18:21:13.352555 70593 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0917 18:21:13.352793 70593 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0917 18:21:23.353352 70593 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0917 18:21:23.353635 70593 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0917 18:21:43.354736 70593 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0917 18:21:43.354939 70593 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0917 18:22:23.357704 70593 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0917 18:22:23.357975 70593 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0917 18:22:23.358021 70593 kubeadm.go:310]
I0917 18:22:23.358089 70593 kubeadm.go:310] Unfortunately, an error has occurred:
I0917 18:22:23.358148 70593 kubeadm.go:310] timed out waiting for the condition
I0917 18:22:23.358158 70593 kubeadm.go:310]
I0917 18:22:23.358202 70593 kubeadm.go:310] This error is likely caused by:
I0917 18:22:23.358242 70593 kubeadm.go:310] - The kubelet is not running
I0917 18:22:23.358385 70593 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0917 18:22:23.358400 70593 kubeadm.go:310]
I0917 18:22:23.358533 70593 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0917 18:22:23.358577 70593 kubeadm.go:310] - 'systemctl status kubelet'
I0917 18:22:23.358622 70593 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0917 18:22:23.358642 70593 kubeadm.go:310]
I0917 18:22:23.358748 70593 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0917 18:22:23.358854 70593 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0917 18:22:23.358871 70593 kubeadm.go:310]
I0917 18:22:23.359003 70593 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0917 18:22:23.359125 70593 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0917 18:22:23.359240 70593 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0917 18:22:23.359342 70593 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0917 18:22:23.359351 70593 kubeadm.go:310]
I0917 18:22:23.359959 70593 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0917 18:22:23.360046 70593 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0917 18:22:23.360161 70593 kubeadm.go:394] duration metric: took 3m57.507077246s to StartCluster
I0917 18:22:23.360193 70593 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0917 18:22:23.360206 70593 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0917 18:22:23.360294 70593 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0917 18:22:23.404415 70593 cri.go:89] found id: ""
I0917 18:22:23.404445 70593 logs.go:276] 0 containers: []
W0917 18:22:23.404456 70593 logs.go:278] No container was found matching "kube-apiserver"
I0917 18:22:23.404463 70593 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0917 18:22:23.404544 70593 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0917 18:22:23.444237 70593 cri.go:89] found id: ""
I0917 18:22:23.444267 70593 logs.go:276] 0 containers: []
W0917 18:22:23.444278 70593 logs.go:278] No container was found matching "etcd"
I0917 18:22:23.444286 70593 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0917 18:22:23.444351 70593 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0917 18:22:23.480425 70593 cri.go:89] found id: ""
I0917 18:22:23.480452 70593 logs.go:276] 0 containers: []
W0917 18:22:23.480463 70593 logs.go:278] No container was found matching "coredns"
I0917 18:22:23.480470 70593 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0917 18:22:23.480546 70593 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0917 18:22:23.516036 70593 cri.go:89] found id: ""
I0917 18:22:23.516060 70593 logs.go:276] 0 containers: []
W0917 18:22:23.516068 70593 logs.go:278] No container was found matching "kube-scheduler"
I0917 18:22:23.516074 70593 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0917 18:22:23.516134 70593 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0917 18:22:23.550042 70593 cri.go:89] found id: ""
I0917 18:22:23.550071 70593 logs.go:276] 0 containers: []
W0917 18:22:23.550083 70593 logs.go:278] No container was found matching "kube-proxy"
I0917 18:22:23.550091 70593 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0917 18:22:23.550147 70593 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0917 18:22:23.584479 70593 cri.go:89] found id: ""
I0917 18:22:23.584512 70593 logs.go:276] 0 containers: []
W0917 18:22:23.584522 70593 logs.go:278] No container was found matching "kube-controller-manager"
I0917 18:22:23.584528 70593 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0917 18:22:23.584590 70593 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0917 18:22:23.621780 70593 cri.go:89] found id: ""
I0917 18:22:23.621808 70593 logs.go:276] 0 containers: []
W0917 18:22:23.621817 70593 logs.go:278] No container was found matching "kindnet"
I0917 18:22:23.621826 70593 logs.go:123] Gathering logs for kubelet ...
I0917 18:22:23.621837 70593 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0917 18:22:23.673807 70593 logs.go:123] Gathering logs for dmesg ...
I0917 18:22:23.673853 70593 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0917 18:22:23.687707 70593 logs.go:123] Gathering logs for describe nodes ...
I0917 18:22:23.687734 70593 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0917 18:22:23.813402 70593 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0917 18:22:23.813427 70593 logs.go:123] Gathering logs for CRI-O ...
I0917 18:22:23.813438 70593 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0917 18:22:23.916282 70593 logs.go:123] Gathering logs for container status ...
I0917 18:22:23.916322 70593 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0917 18:22:23.974624 70593 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0917 18:22:23.974692 70593 out.go:270] *
*
W0917 18:22:23.974760 70593 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0917 18:22:23.974781 70593 out.go:270] *
*
W0917 18:22:23.975677 70593 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0917 18:22:23.978846 70593 out.go:201]
W0917 18:22:23.980017 70593 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0917 18:22:23.980060 70593 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0917 18:22:23.980078 70593 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0917 18:22:23.981415 70593 out.go:201]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-190698 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-190698 -n old-k8s-version-190698
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-190698 -n old-k8s-version-190698: exit status 6 (233.344522ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0917 18:22:24.258796 77135 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-190698" does not appear in /home/jenkins/minikube-integration/19662-11085/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-190698" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (299.81s)